How Do Agent Harnesses Create Value? Planning Information and Release Control in Stateful LLM Agents

Source facts

Across 265 matched cells in Retail experiments and an Airline pilot in τ²-bench, the paper compares task-specific plans with shuffled text, and evaluates a read-only terminal verifier. It reports a 7.17-point oracle-verified success improvement for fixed planning and says the verifier rejected 61% of oracle-invalid Retail episodes while withholding 17% of correct ones at less than one cent per episode.

Analysis

The paper separates planning value from verification value and links their usefulness to the cost of erroneous acceptance. That framing is helpful for deciding whether an agent product needs more reasoning guidance, stronger release gates, or both.

Uncertainty/Doubt

• This is an arXiv preprint; the reported task-clustered intervals, liability framing, and costs were not independently reproduced here.