FIELD NOTES TOPIC
privileged information bias
1 note, newest first.
Privileged, but Biased: How PI-Conditioned Teachers Break Self-Distillation
The study investigates self-distillation (SD), a method used in reinforcement learning for efficient teaching by a 'teacher' using privileged information about the answer. The research finds that while SD reproduces…
