FIELD NOTES TOPIC
post-training quantization
1 note, newest first.
The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs
This research paper introduces a new evaluation metric called 'correctness agreement' for large language models that undergo post-training quantization, a method used to deploy these models in resource-constrained…
