FIELD NOTES TOPIC
llm compression
1 note, newest first.
Scaling Laws for Task-Specific LLM Distillation
This paper presents empirical scaling laws for compressing Large Language Models (LLMs) in specific domains, focusing on quantitative finance as an application. The research explores different methods of distillation…
