FIELD NOTES TOPIC
optimization techniques
2 notes, newest first.
Less Experts, Faster Decoding: Cost-Aware Speculative Decoding for Mixture-of-Experts
Researchers propose a new method called EcoSpec for optimizing the performance of Large Language Models (LLMs) using Sparse Mixture-of-Experts (MoE). This method aims to improve decoding speed by considering the cost…
CausalMix: Data Mixture as Causal Inference for Language Model Training
The paper presents CausalMix, a method that addresses the limitation of existing data mixing methods in Large Language Model (LLM) training by casting it as a causal inference problem. By using causal modeling to…
