Qwen3.8-Flash-Next on 2x3090: 9–12% faster decode at ~119k context, with a completed quality screen
This story is from 2026-09-08. It is preserved in the archive; the latest stories are on the live feed.
An update to my previous post on running Flash-Next with the expert cache and MTP . I found another useful improvement on the same dual-3090 setup: replacing the CUDA top-k fallback used by my build. On long project-document prompts, median decode went from about 30.2 to 33.3 t/s , with an improvem…
Read the full story at r/LocalLLM ↗
Timeline · 2 reports
- 2026-09-10 02:39 · r/LocalLLaMA
Qwen3.8-Flash-Next on 2x3090 + DDR4, part 4: 2.2-2.5x faster prefill by kicking the expert cache off the GPU while the prompt runs - 2026-09-08 02:53 · r/LocalLLM
Qwen3.8-Flash-Next on 2x3090: 9–12% faster decode at ~119k context, with a completed quality screen