FIELD NOTES TOPIC
machine learning techniques
1 note, newest first.
Beyond Teacher Likelihood: Group-Calibrated On-Policy Distillation for Long-Context Reasoning
Researchers introduce Group-Calibrated On-Policy Distillation (GC-OPD), a method for long-context reasoning tasks that aims to address the mismatch between on-policy distillation and task-specific verifiers. The new…
