Qwen 3.8 Flash Next nvfp4 or qwen 3.8 27b iq3_xss for coding?
Hardware: RTX 5080 16gb Blackwell Ryzen 9 9950x3d 64gb ddr5 About 7gbit/s on reading NVMe from which llm is read My hardware allows me to use Basalt (fork of strata) with nvfp4 quant at about 50-70 Tps decode and 2500-3500 prefill (can't fully fit experts into RAM, so some is still in ssd and somet…
Read the full story at r/LocalLLM ↗
Timeline · 5 reports
- 2026-10-31 18:06 · r/LocalLLaMA
Betelgeuse running Qwen 3.8 Flash Next IQ4_XS at 24 tok/s on 2x8GB DDR4 (14 tok/s on a single 16GB stick) + RTX 3060 12GB — 0 dropped experts, 100% byte-exact - 2026-10-31 12:41 · r/LocalLLM
Betelgeuse: Running Qwen 3.8 Flash Next at 22 tok/s sustained (spiking to 48 tok/s) on an RTX 3060 12GB + 16GB DDR4 RAM 100% bit-exact!Discussion - 2026-10-31 12:20 · r/LocalLLaMA
Betelgeuse: Running Qwen 3.8 Flash Next at 22 tok/s sustained (spiking to 48 tok/s) on an RTX 3060 12GB + 16GB DDR4 RAM 100% bit-exact! - 2026-10-30 08:57 · r/huggingface
Qwen 3.8 Flash Next 'Flare' images for 1M context - 2026-10-30 08:31 · r/LocalLLM
Qwen 3.8 Flash Next nvfp4 or qwen 3.8 27b iq3_xss for coding?