AINewsnow

Made a quantization-aware trained (QAT) Qwen3.8 27b 2 bit gguf quant

This story is from 2026-08-22. It is preserved in the archive; the latest stories are on the live feed.

https://huggingface.co/sdkyuan/qwen3.8-27B-qat-q2_0-gguf Outperforms Unsloth 2 bit quants at reasoning and code at smaller file size. Unlike most other community quants that are PTQ, this one is QAT.

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-08-22 19:38 · r/LocalLLM
    Made a quantization-aware trained (QAT) Qwen3.8 27b 2 bit gguf quant

More stories

  1. Alibaba and DeepSeek champion open-source AI as industry debates costs and risks — South China Morning Post Tech
  2. Dharma-AI releases 2B Field Extractor for document-to-JSON — DEV Community — AI
  3. Hugging Face CEO Says His AI Extinction Risk Estimate Is 'Close to Zero' — Wired AI
  4. GSM8K on Hugging Face: 4 of the Top 12 Rows Show a Sibling Checkpoint's Score, and 20 of 28 Rows Are Unmerged PRs — DEV Community — Machine Learning
  5. SWE-bench Verified on Hugging Face: 9 Self-Reported Rows Top the Official Table's Best, and 6 Repos Fill 16 of 78 Rows — DEV Community — Machine Learning
  6. New TurboH3 FL2VA — r/StableDiffusion
  7. What If You Could Tell a Machine Exactly *What* and *How* to Move? DreamX Breaks the Mold — DEV Community — AI
  8. ricursiveAI/Ripple-65B-Preview · Hugging Face — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →