AINewsnow

Qwen3.8 Flash-Next (FP4) on a single RTX PRO 6000: 287 tok/s single-stream coding, 965 tok/s at 8 concurrent

Wanted to share my numbers for Qwen3.8 Flash-Next for anyone thinking about running it on just one RTX PRO 6000 (96 GB). Coding numbers (450 W power limit) : - C1 (single request): 287 tok/s - C8 (8 concurrent requests): 965 tok/s total - Prefill: about 14.5K tok/s at 4K context, still about 13.5K…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-30 08:32 · r/LocalLLM
    Qwen3.8 Flash-Next (FP4) on a single RTX PRO 6000: 287 tok/s single-stream coding, 965 tok/s at 8 concurrent

More stories

  1. Anthropic files paperwork for IPO as investors weigh funds and credit outlook — New York Times Technology
  2. Mistral releases weights for trillion-parameter Le Chonk model with 1M-token context — Wired AI
  3. DeepSeek open-sources prototype of always-on autonomous coding agent — Techmeme
  4. Big Tech sheds nearly $900bn as AI spending fears trigger market rout — Financial Times AI
  5. DeepSeek Releases Enhanced Coding Agent to Rival Anthropic's Claude Code — Bloomberg AI
  6. Foxconn hints at new OpenAI tie-up for AI hardware, says no AI bubble — Economic Times Tech
  7. OpenAI cuts latest funding round target to $20 billion amid tech stock selloff — Financial Times AI
  8. Renesas projects 26.4% revenue growth in 2026 on AI data center demand; Nebius leases 50 MW capacity — DigiTimes Asia

Get the daily brief of stories like this at 6:30 every morning →