FIELD NOTES TOPIC
specialized domains
1 note, newest first.
Neuron-Aware Data Selection for Annotation-Free LLM Self-Distillation
Researchers propose a new method called Neuron On-Policy Self-Distillation (Neuron-OPSD) for training large language models without human annotations in specialized domains where they are costly to obtain. This method…
