Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiency

Source facts

The preprint studies whether reasoning efficiency can improve without directly optimizing length or adding an inference-time stopping mechanism. It fine-tunes models to predict confidence at intermediate points in their own reasoning trajectories using 600 training problems. The abstract reports up to 25% fewer generated tokens at matched accuracy across Gemma, Qwen, Nemotron, and GPT-OSS models on mathematical, scientific, and coding benchmarks.

Analysis

The proposed mechanism treats confidence as a training signal that may indirectly produce shorter reasoning. If it generalizes, this could reduce inference cost while retaining the standard generation procedure, but the result still depends on how confidence labels and matched-accuracy comparisons are constructed.

Uncertainty/Doubt

• This is an arXiv preprint. The efficiency gains, model coverage, and matched-accuracy comparisons were not independently reproduced here.