Qwen3.8-Flash-Next NVFP4 at 256K context with Strata — 4,100+ prefill and up to 125 tok/s decode
This story is from 2026-10-03. It is preserved in the archive; the latest stories are on the live feed.
I tested two Qwen3.8-Flash-Next NVFP4 checkpoints at a full 256K context using an experimental dual-GPU Strata configuration. Hardware: • RTX 4090 D 48 GB as the primary GPU • RTX 5070 Ti 16 GB as a helper GPU • Intel Core Ultra 7 265KF • 128 GB RAM • Linux • NVMe storage The RTX 4090 D handled the…
Read the full story at r/LocalLLM ↗
Timeline · 2 reports
- 2026-10-04 17:43 · r/LocalLLM
Qwen3.8-Flash-Next (IQ2_XS) - Single 4090 + 32GB DDR5 = 512k Context (STRATA) - 2026-10-03 02:54 · r/LocalLLM
Qwen3.8-Flash-Next NVFP4 at 256K context with Strata — 4,100+ prefill and up to 125 tok/s decode