Basalt 0.2.0: Qwen 3.8 Flash Next NVFP4, 300 t/s prose, 600 t/s struct, 10K t/s prefill on a 5090 + 5060 Ti and 128GB RAM
This story is from 2026-11-03. It is preserved in the archive; the latest stories are on the live feed.
Basalt 0.2.0: Quality & Speed Hey all! I wanted to share a quick update on Basalt , a Blackwell only inference engine for Qwen 3.8 Flash Next. As usual, speed is the headline but that's not what I want to open this post with, I've been reading lot of discussions talking about quality recently, and…
Read the full story at r/LocalLLaMA ↗
Timeline · 5 reports
- 2026-11-06 09:51 · r/LocalLLaMA
pi + strata + qwen 3.8 flash next q4 k xl --> funny stuff in logs - 2026-11-04 17:50 · r/LocalLLaMA
Qwen 3.8 Flash Next GSQ RCO quant as good as BF16 - 2026-11-04 15:12 · r/LocalLLM
Qwen 3.8 - Flash Next Strata Navier - Strokes - Whirl - 2026-11-04 10:52 · r/LocalLLM
Low cost $1500 AI rig - QWEN 3.8 Flash Next, 52.5 t/s decode in FP8 - 6xM10 = 192GB VRAM - 2026-11-03 20:49 · r/LocalLLaMA
Basalt 0.2.0: Qwen 3.8 Flash Next NVFP4, 300 t/s prose, 600 t/s struct, 10K t/s prefill on a 5090 + 5060 Ti and 128GB RAM