Recursive Self-Improvement through Multi-Agent Self-Supervision

Source facts

The work describes MASS, which alternates evolutionary workflow optimization with supervised fine-tuning on self-generated trajectories. The abstract reports discovery of multi-agent workflows and, over two cycles with Qwen3.6-27B, 1.2–1.6x higher performance per output token on four open-ended benchmarks. It also reports that a student trained on the generated traces outperforms a single-agent student trained on 1.4x more tokens.

Analysis

The proposed loop couples search over agent organization with distillation into a student model. The key measurement question is whether gains come from reusable workflow structure, additional effective supervision, or benchmark-specific search.

Uncertainty/Doubt

• This is an arXiv preprint. The benchmark results, training setup, and self-improvement claims were not independently reproduced here.