AINewsnow

Nace releases data-aware quantization for Qwen models, improving local inference fidelity

This story is from 2026-11-12. It is preserved in the archive; the latest stories are on the live feed.

Nace engineer Alish shared KQuant, a data-aware quantization method achieving 3.7× closer KL-divergence to full precision on Qwen 3.8 Flash Next 180B and 1.5–2.6× gains on 9B–35B models, released as GGUF and MLX quants.

Read the full story at r/LocalLLM ↗

Timeline · 8 reports

  1. 2026-11-14 10:04 · r/LocalLLM
    Qwen 3.8 Flash Next + RTX 5090, 160GB, RAID0 NVMe
  2. 2026-11-14 09:55 · r/LocalLLaMA
    Qwen 3.8 Flash Next for gamedev - it's very capable!
  3. 2026-11-14 06:46 · DEV Community — Machine Learning
    Weight-space programming at 50 forward passes: Qwen hit 48.1%, Gemma 7.0%
  4. 2026-11-13 19:23 · r/LocalLLaMA
    Weight Space Programming for Quantization: Nace quants achieve up to 2x better KL divergence for Qwen 9B, 27B, 35B & Flash Next [GGUF]
  5. 2026-11-13 19:00 · DEV Community — Machine Learning
    Weight-space programming is not autonomous self-improvement
  6. 2026-11-13 04:06 · r/LocalLLaMA
    Artificial Analysis updated Qwen 3.8 Flash Next score as 29
  7. 2026-11-12 19:50 · r/LocalLLM
    How many tokens/s do I get with rtx 5090 32gb and 64 gb ram for qwen 3.8 flash next?
  8. 2026-11-12 11:17 · r/LocalLLM
    KQuant - data-aware quantization, 3.7× closer to full precision on Qwen Flash-Next 180B, 1.5–2.6× on 27B / 35B / 9B (KL-divergence) (MLX)

More stories

  1. Qwen Image 2.1 Turbo: Eight Steps Against Twenty-Five, and Eight ControlNet Modes — DEV Community — AI
  2. FLUX.3 Klein Qwen 2.1: A Pose-and-Outfit Matrix Built From 1407 Garments and 1439 Pose Images — DEV Community — AI
  3. Running Llama 3.2 & Qwen 2.5 100% Offline in React Native & Expo 52: Solving Thermal Throttling, OOMs, and Background Streaming — DEV Community — AI
  4. [ Video ] Local AI: Running Alpie Seed on a 16GB MacBook Pro — DEV Community — AI
  5. Qwen 4 Max Preview is now load-bearing - and that means the bear will no long be able to bear the loads it used to — r/artificial
  6. ChatR Labs Shrinks Alibaba's Qwen-Image-2.1 to Run on 4 GB Consumer GPUs — AlphaSignal
  7. How many tokens/s do I get with rtx 5090 32gb and 64 gb ram for qwen 3.8 flash next? — r/LocalLLM
  8. Qwen Image 2.1: exact type at native 2K on PixelDojo — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →