Learning Meta-Skills for Agent Harness Design in Test-Time AI4AI

Source facts

The preprint studies a Builder model that learns to construct better execution environments for a frozen Target model. Its Meta-Skill encodes when support is needed and what resources to provide; the Builder learns these principles from Target feedback and uses them to construct harnesses for unseen tasks. The abstract reports macro-average gains of 8.95 percentage points over no-skill construction and 12.02 points over direct delivery of the same skill bank across Harness-Bench and NewtonBench.

Analysis

This is a system-level self-improvement pattern in which the model improves the environment around another model without changing either model's weights. It makes the harness itself a learned artifact rather than a fixed prompt or tool bundle.

Uncertainty/Doubt

• This is an arXiv preprint. The benchmark design, development-set feedback assumptions, and transfer to production agent environments were not independently audited here.