AINewsnow

Qwen3.8-Flash-Next Benchmarks Show Wide Performance Range Across Hardware

This story is from 2026-08-27. It is preserved in the archive; the latest stories are on the live feed.

Community benchmarks for Qwen3.8-Flash-Next report speeds from 33 to 203 tok/s depending on hardware, quantization, and inference engine, with vLLM outperforming llama.cpp at long context.

Read the full story at r/LocalLLM ↗

Timeline · 8 reports

  1. 2026-08-29 14:47 · r/LocalLLM
    Qwen3.8-Flash-Next IQ1_S on a single 5070 (12GB VRAM)
  2. 2026-08-29 08:25 · r/LocalLLM
    Qwen3.8-Flash-Next (qwen4exp): llama.cpp isn't ready for agentic work, vLLM is ~4x faster at long context (RTX PRO 6000, full numbers)
  3. 2026-08-28 22:00 · r/LocalLLaMA
    Today I hit 181 toks/s (aggregate) on Qwen3.8-Flash-Next on 2x DGX Sparks
  4. 2026-08-28 10:55 · r/LocalLLaMA
    Qwen3.8-Flash-Next (UD-IQ4_XS) on 2x RTX 3060 + 7800X3D, from initial 36 tps prefill to 400 tps and other benchmarks (-sm tensor trap) + VRAM/RAM usage
  5. 2026-08-27 20:56 · r/LocalLLM
    Qwen3.8-Flash-Next on 2x RTX 3090s, 33-43 tok/s
  6. 2026-08-27 18:10 · r/LocalLLM
    unsloth/Qwen3.8-Flash-Next-GGUF on NVIDIA GeForce RTX 5090 — 43.4 tok/s — llm-bench.io
  7. 2026-08-27 15:32 · r/LocalLLM
    Qwen3.8-Flash-Next NVFP4 running on vLLM across 2x DGX Spark — 63 tok/s single stream, 203 tok/s at 8 concurrent. Needed a 3-line patch, repo inside
  8. 2026-08-27 08:51 · r/LocalLLM
    Qwen3.8-Flash-Next-Q:UD-Q4_K_XL on a 32GB R9700

More stories

  1. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  2. Alibaba open-sources medical AI model that can detect cancer and nearly 150 conditions — South China Morning Post Tech
  3. Qwen 3.8 27B Running for 63 hours on a RTX 3090 to solve the Riemann hypothesis — r/LocalLLM
  4. Alibaba's Damo Academy open sources RADAR, a medical vision-language model it says can read CT scans and identify ~150 abdominal conditions, including cancers (Ann Cao/South China Morning Post) — Techmeme
  5. Qwen q4 3.8 27b 16 tok/s 32k RTX 3060 :D — r/LocalLLM
  6. 10 hours left fo Qwen Image 2.1 Public Open Source Release — r/StableDiffusion
  7. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  8. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →