Qwen 3.8 Flash Next gains traction for efficient local inference
Users report running Qwen 3.8 Flash Next on consumer hardware, including AMD and Apple Silicon, achieving high context lengths and optimized token speeds through various harnesses and quantization techniques.
Read the full story at r/LocalLLaMA ↗
Timeline · 8 reports
- 2026-10-13 20:58 · r/LocalLLM
Qwen 3.8 flash next - 12vram+32gb ram - 2026-10-13 14:08 · r/LocalLLaMA
Basalt: Fast Blackwell inference engine for Qwen 3.8 Flash Next (and how we got vision for free) - 2026-10-13 13:06 · r/LocalLLM
GLM 5.3 flash vs Qwen Flash Next? - 2026-10-13 09:57 · r/LocalLLaMA
Based on advice from LocalLLama implemented a n+2 lookahead prediction for ssd streaming Qwen Flash Next - and it worked! - 2026-10-13 04:04 · r/LocalLLM
When to use qwen 3.8 flash next 4 bit vs 27b 6 bit - 2026-10-12 23:18 · r/LocalLLaMA
Qwen 3.8 Flash Next Q3 S - Benchmark creation - 2026-10-11 21:44 · r/LocalLLaMA
I ran Qwen 3.8 Flash-Next on my AMD 7900 XTX at 500k context. All local and what a shift it has been. - 2026-10-11 08:23 · r/LocalLLaMA
What setup do you use, which harness? and how do you customize it to run qwen 3.8 flash next swift with a high context length and a reasonable amount of tok/sec?