Self-Play Pretraining with Zero Data

Source facts

The paper presents a proof-of-concept in which a generator and learner train in tandem without natural training data. The generator proposes programs interpreted by a universal Turing machine to produce byte sequences, while reinforcement learning drives it toward sequences at the learner's capability frontier; the learner predicts the sequences with standard cross-entropy. The abstract reports predictable zero-shot scaling on several natural datasets, in-context learning, and discovery of recognizable mathematical sequences.

Analysis

This is a proposal for compute-driven synthetic pretraining: the model searches over computable data-generating processes rather than relying on a human-curated corpus. The main question for broader impact is whether the clean transfer result survives at larger scales and across domains without hidden leakage or narrow synthetic structure.

Uncertainty/Doubt

• This is an arXiv proof-of-concept preprint. The transfer, scaling, and mathematical-discovery claims were not independently reproduced here; “zero data” refers to no natural-data training in the described experiment, not to zero compute or zero generated data.