Community optimizes Qwen 3.8 Flash Next for local hardware
Users report successful local deployment of Qwen 3.8 Flash Next on diverse hardware, including AMD GPUs and Macs, utilizing SSD streaming and custom inference engines like Basalt to achieve high context windows and performance.
Read the full story at r/LocalLLaMA ↗
Timeline · 8 reports
- 2026-10-14 05:37 · r/LocalLLM
Qwen 3.8 Flash Next on 24GB + 32GB ram? - 2026-10-13 20:58 · r/LocalLLM
Qwen 3.8 flash next - 12vram+32gb ram - 2026-10-13 14:08 · r/LocalLLaMA
Basalt: Fast Blackwell inference engine for Qwen 3.8 Flash Next (and how we got vision for free) - 2026-10-13 13:06 · r/LocalLLM
GLM 5.3 flash vs Qwen Flash Next? - 2026-10-13 09:57 · r/LocalLLaMA
Based on advice from LocalLLama implemented a n+2 lookahead prediction for ssd streaming Qwen Flash Next - and it worked! - 2026-10-13 04:04 · r/LocalLLM
When to use qwen 3.8 flash next 4 bit vs 27b 6 bit - 2026-10-12 23:18 · r/LocalLLaMA
Qwen 3.8 Flash Next Q3 S - Benchmark creation - 2026-10-11 21:44 · r/LocalLLaMA
I ran Qwen 3.8 Flash-Next on my AMD 7900 XTX at 500k context. All local and what a shift it has been.