AINewsnow

My Qwen3.8-27B task-aware quant reaches 99% of BF16 reasoning performance at 15% of the size.

This story is from 2026-09-07. It is preserved in the archive; the latest stories are on the live feed.

TL;DR My TAK quant of Qwen 3.8 27b scored 82.81% on reasoning, comparted with 77.34% for the byte matched Unsloth UD IQ2_S and 83.59% for BF16. Edit: Some of you have tried coding with this reasoning-specialized quant and encountered repetition loops. Coding is outside its intended domain, but I’ll…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-07 21:42 · r/LocalLLaMA
    My Qwen3.8-27B task-aware quant reaches 99% of BF16 reasoning performance at 15% of the size.

More stories

  1. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  2. Post-training image models for fandom — Character.AI Blog
  3. Testing Qwen 3.8 27B running locally on a single 5090 — r/LocalLLM
  4. qwen4exp: add hc ops by am17an · Pull Request #28901 · ggml-org/llama.cpp — r/LocalLLaMA
  5. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  6. Qwen Developers on X: "Qwen-Image 2.1 is going open source" — r/StableDiffusion
  7. Optimizing DGX with Qwen 3.8 Flash Next (open to other models!) — r/LocalLLM
  8. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →