FIELD NOTES TOPIC
scaling laws
1 note, newest first.
Scaling Laws for Task-Specific LLM Distillation
This paper presents empirical scaling laws for compressing Large Language Models (LLMs) in specific domains, focusing on quantitative finance as an application. The research explores different methods of distillation…
