Do LLM Agents Execute the Plans They Declare? From Planning-Mode Declaration to Pattern-Specific Execution

Source facts

The preprint defines a Plan Declaration–Execution Gap and evaluates four declared planning modes: Predefined, Sequential, Hierarchical, and Search. Across four benchmarks and three LLMs, the abstract reports that only 22–45% of generic Plan+ReAct trajectories preserve the declared planning structure on three benchmarks. Pattern-specific executors improved reported task success from 0.48 to 0.92 on ALFWorld and from 0.36 to 0.44 on SWE-bench Verified, while the models did not reliably select the strongest mode for each task.

Analysis

The paper separates plan selection from faithful execution. A deterministic router can improve execution by enforcing a suitable pattern, but the unresolved problem is selecting the right mode under changing task and model conditions.

Uncertainty/Doubt

• This is an arXiv preprint. The benchmark-to-deployment transfer and the reported gains under alternate routers or tool environments were not independently reproduced here.