Shockingly Simple Self-retrospection Improves Agentic Models Without RL

Source facts

The preprint introduces Retrospection-Only Fine-Tuning (ROFT), an online procedure in which an agent attempts a task, observes feedback, generates a retrospective explanation, and fine-tunes only on the explanation tokens. The method uses neither an external teacher nor a reward-based policy update. In the described software-engineering experiments with Qwen3.5-4B, the abstract reports SWE-bench Verified and Pro solve rates of 49.2% and 26.8% after 20 updates, compared with 48.0% and 25.3% for GRPO after 40 updates in the evaluated runs.

Analysis

The concept treats self-generated explanations as a training target that can indirectly assign credit to actions. It is a lightweight alternative to reward-based agent training, but its value depends on the quality and stability of the model's retrospections.

Uncertainty/Doubt

• This is an arXiv preprint. The benchmark comparisons, update-budget fairness, and explanation-to-action transfer were not independently reproduced here.