AINewsnow

I hit 310 t/s running Qwen/Qwen3.8-Flash-Next-FP8 on 4x RTX PRO 6000

This story is from 2026-08-30. It is preserved in the archive; the latest stories are on the live feed.

I've never experienced anything like this before, coding at these speeds. I literally gasped out loud after the first coding prompt. I truly have no more use for Claude. I don't think I will be participating in their IPO either.

Read the full story at r/LocalLLM ↗

Timeline · 6 reports

  1. 2026-09-01 05:30 · r/LocalLLM
    MTP released for Qwen3.8-Flash-Next-GGUF
  2. 2026-09-01 05:10 · r/LocalLLaMA
    MTP released for Qwen3.8-Flash-Next-GGUF
  3. 2026-08-31 17:16 · r/LocalLLM
    Qwen3.8-Flash-Next beat every Claude model on my API bug-fixing bench, locally on an RTX 3060
  4. 2026-08-31 01:09 · r/LocalLLaMA
    Qwen3.8-Flash-Next-NVFP4 vs Qwen3.8-27B-FP Test Results
  5. 2026-08-30 11:32 · r/LocalLLM
    Qwen3.8-Flash-Next on single RTX PRO 6000 96GB + 64g RAM, full 262K context with NVMe offloading recipe
  6. 2026-08-30 00:09 · r/LocalLLM
    I hit 310 t/s running Qwen/Qwen3.8-Flash-Next-FP8 on 4x RTX PRO 6000

More stories

  1. M2 Mac ultra128gb Qwen flash next — r/LocalLLM
  2. Pay $39.99 once to put ChatGPT, Claude, Gemini, and more in a single workspace for life — Mashable AI
  3. Multi-hour llama.cpp optimization experiments on Qwen MoE models, patches, benchmarks, and reproduction guides — r/LocalLLM
  4. The bear can dance: Qwen 3.8 27B on one 3090 for 3 weeks — r/LocalLLaMA
  5. I gave 6 different AIs the same 5 questions — r/AI_Agents
  6. CUDA: enable sparse fa for qwen4 by am17an · Pull Request #28770 · ggml-org/llama.cpp — r/LocalLLaMA
  7. Is it just me or does Qwen 2.1 look like a heavily distilled GTP image version? — r/StableDiffusion
  8. Using local/non-Anthropic LLMs in Claude Desktop on Windows? — r/ClaudeAI

Get the daily brief of stories like this at 6:30 every morning →