Qwen3.8-27B Q4_K_M with 45.3% lower KLD
This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.
I have been experimenting with different ways to quantize Qwen3.8-27B. For the fraQtl version, I used a more linear-algebra-driven calibration process and compared it with Q4_K_M builds from Unsloth and ggml-org at the same size. The normal benchmarks made all three look basically identical: GSM8K…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-08-21 18:10 · r/LocalLLM
Qwen3.8-27B Q4_K_M with 45.3% lower KLD