Recursive Harness Self-Improvement for Frontier Reasoning Data Synthesis

Source facts

The preprint introduces task-harness co-evolution for recursive reasoning-data synthesis. Online self-improvement turns solver failures into reusable skills, while post-task updates revise skills, prompts, and workflows only when harder valid tasks are produced within a bounded cost increase. The abstract reports fixed model weights and verification criteria, declining mean solver accuracy from 100.0% to 54.8% over fourteen evolution rounds, and downstream gains from synthesized data; a 27B student trained on 10K mathematics examples reached 62.5% mean-16 accuracy on APEX.

Analysis

The paper treats the synthesis harness as an adaptive component rather than a fixed wrapper around task generation. That makes evaluator stability, difficulty calibration, and cost controls central to the training-data pipeline.

Uncertainty/Doubt

• This is an arXiv preprint. The reported downstream gains, benchmark construction, and bounded-cost adoption criteria were not independently reproduced here.