MagicQuant Qwen3.8 27B GGUFs with Unsloth v3 & Imatrix
This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.
I just updated MagicQuant with the new Unsloth dynamic v3 and utilizing their imatrix: HuggingFace Repo Here Qwen3.8 27B was a more conservative run with some kld and size savings. But it was super interesting seeing the run between dynamic v2 vs v3. The V3 was a pretty substantial boost for sure.…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-08-21 14:15 · r/LocalLLaMA
MagicQuant Qwen3.8 27B GGUFs with Unsloth v3 & Imatrix