FIELD NOTES TOPIC
failure of reinforcement learning methods
1 note, newest first.
Privileged, but Biased: How PI-Conditioned Teachers Break Self-Distillation
The study investigates self-distillation (SD), a method used in reinforcement learning for efficient teaching by a 'teacher' using privileged information about the answer. The research finds that while SD reproduces…
