FIELD NOTES TOPIC
loss function
1 note, newest first.
Privileged, but Biased: How PI-Conditioned Teachers Break Self-Distillation
The research investigates self-distillation (SD), a method used in reinforcement learning with verifiable rewards, where a teacher conditioned on privileged information supplies supervision to a student. The study…
