Up and Down the Abstraction Ladder: Code-Based Skills for Language Agents

Source facts

The preprint studies reusable code-based skills for agents that otherwise must repeatedly choose low-level actions. In NetHack, the authors compare primitive actions, semantic skills, and combinations of both across zero-shot prompting, supervised fine-tuning, and reinforcement learning. The abstract reports nearly triple game progression and 86% lower inference cost per episode for skills in zero-shot evaluation, while combining skills with primitives preserves a path back to low-level actions; in reinforcement learning, skill-based agents achieved a 7.2x larger average gain in dungeon level over the same budget. CodeHack and training/evaluation code are released.

Analysis

The work suggests a concrete abstraction pattern for long-horizon agents: use reusable code for recurring local decisions while retaining primitive actions for out-of-distribution situations. The key systems tradeoff is productivity and cost versus the risk of leaky or over-specialized skills.

Uncertainty/Doubt

• This is an arXiv preprint. The reported gains are from NetHack and the described skill library; transfer to other environments and agent stacks was not independently audited here.