AINewsnow

Qwen 3.8 Flash Next Gains SSD Offload and Fast Quantized Support

This story is from 2026-08-27. It is preserved in the archive; the latest stories are on the live feed.

Community reports show Qwen 3.8 Flash Next achieving 23.5-39 tok/s on AMD Strix Halo with SSD-offloaded ngram tables, plus 25 tok/s with Unsloth's 0-day IQ4_XS quant and llama.cpp support.

Read the full story at r/LocalLLM ↗

Timeline · 3 reports

  1. 2026-08-29 00:56 · r/LocalLLaMA
    Qwen 3.8 Flash Next ngram look up table offloaded to SSD and streamed in SGLang
  2. 2026-08-27 22:30 · r/LocalLLM
    Unsloth Qwen 3.8 Flash Next 4bit = 25 tok/s
  3. 2026-08-27 21:59 · r/LocalLLM
    EngramHalo.cpp: Qwen 3.8 Flash-Next on Strix Halo — 23.5 → 39 tok/s, working MTP, 27 GB engram table on SSD

More stories

  1. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  2. Alibaba open-sources medical AI model that can detect cancer and nearly 150 conditions — South China Morning Post Tech
  3. Post-training image models for fandom — Character.AI Blog
  4. Testing Qwen 3.8 27B running locally on a single 5090 — r/LocalLLM
  5. qwen4exp: add hc ops by am17an · Pull Request #28901 · ggml-org/llama.cpp — r/LocalLLaMA
  6. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  7. Qwen Developers on X: "Qwen-Image 2.1 is going open source" — r/StableDiffusion
  8. Optimizing DGX with Qwen 3.8 Flash Next (open to other models!) — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →