FIELD NOTES TOPIC
in-domain task performance
1 note, newest first.
Neuron-Aware Data Selection for Annotation-Free LLM Self-Distillation
Researchers have developed a new method called Neuron On-Policy Self-Distillation (Neuron-OPSD) for training large language models without the need for real-world interaction feedback or human-labeled supervision…
