NInfer6000 - Qwen 3.8 Flash Next @ 400 tg/s & 13K pp/s
I've tinkered some more with my fork of NInfer for the Qwen 3.8 Flash Next model on RTX6000, and I've just hit 400tg/s under ideal conditions with it, so I thought it was worth a share. Decode MTP3 with --lm-head-draft Context 16-bit 8-bit Change 512 197.1 tok/s 274.8 tok/s +39% 8K 303.1 tok/s 401.…
Read the full story at r/LocalLLaMA ↗
Timeline · 6 reports
- 2026-10-08 11:07 · r/LocalLLaMA
Halogen + Qwen Flash Next keeps getting better - 2026-10-08 10:55 · r/LocalLLaMA
Qwen 3.8 Flash Next is so much fun for three.js - 2026-10-07 22:26 · r/LocalLLM
Is anyone running Qwen Flash Next on Strata with q6 or higher? - 2026-10-07 22:02 · r/LocalLLM
Water cooling 2x RTX 6000 Pro Workstations; temps down 50% at max load, 500W max under Qwen 3.8 Flash Next - 2026-10-07 20:43 · r/LocalLLaMA
Qwen 3.8 Flash-Next on 64GB RAM + 16GB VRAM, worth it over a fully-loaded 3.6 35B-A3B? - 2026-10-06 10:37 · r/LocalLLaMA
NInfer6000 - Qwen 3.8 Flash Next @ 400 tg/s & 13K pp/s