Made a quantization-aware trained (QAT) Qwen3.8 27b 2 bit gguf quant
This story is from 2026-08-22. It is preserved in the archive; the latest stories are on the live feed.
https://huggingface.co/sdkyuan/qwen3.8-27B-qat-q2_0-gguf Outperforms Unsloth 2 bit quants at reasoning and code at smaller file size. Unlike most other community quants that are PTQ, this one is QAT.
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-08-22 19:38 · r/LocalLLM
Made a quantization-aware trained (QAT) Qwen3.8 27b 2 bit gguf quant