AINewsnow

yall are sleeping on qwen 3.8 27b q2 + q2 dflash + q5 kv

This story is from 2026-08-28. It is preserved in the archive; the latest stories are on the live feed.

ok bit more context: it's actually a QAT Q2 for Qwen 3.8 27 B: https://huggingface.co/sdkyuan/qwen3.8-27B-qat-q2_0-gguf QAT Q2 for DFlash model: https://huggingface.co/HermiHg/Qwen3.8-27B-DFlash2-Q2_K_S-MIX-GGUF Q5 KV seems to cause 0 problems for me; I've used it up to 200K tokens of context. Tota…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-08-28 00:36 · r/LocalLLaMA
    yall are sleeping on qwen 3.8 27b q2 + q2 dflash + q5 kv

More stories

  1. qwen4exp: add hc ops by am17an · Pull Request #28901 · ggml-org/llama.cpp — r/LocalLLaMA
  2. Thank you :) Swift Qwen 3.8 27B now has 100k+ downloads, is #1 finetune and #9 model on HuggingFace Trending — r/LocalLLaMA
  3. Qwen 3.6 35b nvfp4 hot expert hack in vllm — r/LocalLLM
  4. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  5. Post-training image models for fandom — Character.AI Blog
  6. Testing Qwen 3.8 27B running locally on a single 5090 — r/LocalLLM
  7. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  8. Qwen Developers on X: "Qwen-Image 2.1 is going open source" — r/StableDiffusion

Get the daily brief of stories like this at 6:30 every morning →