KLD is misunderstood
I see a lot of people here on Reddit treating the KLD number as some holy metric that can distinguish every quantized model out there and rank them by quality. TL;DR: It can't. So what does KLD actually measure? If you feed the same text to both the base model and the quantized model, you can compa…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-24 20:12 · r/LocalLLaMA
KLD is misunderstood