FIELD NOTES TOPIC
attention weights
1 note, newest first.
The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs
The authors investigate how the quantization process used to deploy large language models in resource-limited settings can lead to unnoticed behavioral changes, even when task performance seems unaffected. They…
