AINewsnow

Qwen 3.8 27B KV f16 vs q8_0 are not equivalents

This story is from 2026-08-20. It is preserved in the archive; the latest stories are on the live feed.

I'm testing it since release, now with UD 3.0 in my AMD R9700 with ROCm, I always read everywhere that F16 and q8_0 for KV cache are essentially the same... well, I tested it and I can see differences. Some differences are minimal, F16 is more careful and detailed with structured and free output, t…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-08-20 07:01 · r/LocalLLaMA
    Qwen 3.8 27B KV f16 vs q8_0 are not equivalents

More stories

  1. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  2. Qwen 3.8 27B Running for 63 hours on a RTX 3090 to solve the Riemann hypothesis — r/LocalLLM
  3. Qwen q4 3.8 27b 16 tok/s 32k RTX 3060 :D — r/LocalLLM
  4. 10 hours left fo Qwen Image 2.1 Public Open Source Release — r/StableDiffusion
  5. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  6. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
  7. Qwen Developers on X: "Qwen-Image 2.1 is going open source" — r/StableDiffusion
  8. Ternary Bonsai 2 27B — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →