LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use Agents

Source facts

LEASH uses a weak agent by default and escalates to a stronger agent when latent uncertainty indicates that help is needed. It adds a shadow observer after handoff to oversee the strong black-box agent. The authors report gains over standalone weak agents and random escalation on OSWorld; with Qwen3.5-35B-A3B, the abstract reports 73.66% task success at $0.4117 per task, comparable to always-on Claude Opus 5 at lower reported inference cost.

Analysis

The framework treats escalation and post-handoff monitoring as separate control problems. If reproduced, this could make long-horizon computer-use systems more economical without treating the weak model's confidence as sufficient evidence that a strong model is safe to run unattended.

Uncertainty/Doubt

• This is an arXiv preprint. The uncertainty estimator, OSWorld setup, cost accounting, and comparisons with named models were not independently reproduced here.