Sherpa: Teaching LLMs to Teach Adaptively

Source facts

The preprint introduces Sherpa, a multi-turn reinforcement-learning framework that trains an LLM teacher against multiple student archetypes with distinct learning preferences. The teacher is optimized directly against simulated student learning outcomes. The abstract reports average student-performance gains of 20.5 percentage points, a MathTutorBench pedagogy-score increase from 52.5% to 79.2%, and human preference for the trained teacher in 79.6% of pairwise comparisons.

Analysis

Sherpa makes learner outcomes, rather than fixed pedagogical rubrics alone, the training target. The approach is relevant to adaptive tutoring, but transfer from simulated students to real learners remains the key deployment question.

Uncertainty/Doubt

• This is an arXiv preprint. The simulated-student design, human-study protocol, and reported learning gains were not independently reproduced here.