FIELD NOTES TOPIC
exploration
2 notes, newest first.
TREK: Distill to Explore, Reinforce to Refine
The research presents TREK (Teacher-Routed Exploration via Forward KL), a method that uses distillation for exploration support expansion, rather than imitation. This method can be used with various types of teachers…
TREK: Distill to Explore, Reinforce to Refine
The paper proposes a method called TREK (Teacher-Routed Exploration via Forward KL) to improve Group Relative Policy Optimization (GRPO). TREK uses distillation for exploration support expansion and can work with…
