What setup do you use, which harness? and how do you customize it to run qwen 3.8 flash next swift with a high context length and a reasonable amount of tok/sec?
As i use a rather tiny setup 12gb vram gpu and 32bg ram, i was wondering: What setup do you use, which harness? and how do you customize it to run qwen 3.8 flash next swift with a high context length and a reasonable amount of tok/sec?
Read the full story at r/LocalLLaMA ↗
Timeline · 7 reports
- 2026-10-13 14:08 · r/LocalLLaMA
Basalt: Fast Blackwell inference engine for Qwen 3.8 Flash Next (and how we got vision for free) - 2026-10-13 13:06 · r/LocalLLM
GLM 5.3 flash vs Qwen Flash Next? - 2026-10-13 09:57 · r/LocalLLaMA
Based on advice from LocalLLama implemented a n+2 lookahead prediction for ssd streaming Qwen Flash Next - and it worked! - 2026-10-13 04:04 · r/LocalLLM
When to use qwen 3.8 flash next 4 bit vs 27b 6 bit - 2026-10-12 23:18 · r/LocalLLaMA
Qwen 3.8 Flash Next Q3 S - Benchmark creation - 2026-10-11 21:44 · r/LocalLLaMA
I ran Qwen 3.8 Flash-Next on my AMD 7900 XTX at 500k context. All local and what a shift it has been. - 2026-10-11 08:23 · r/LocalLLaMA
What setup do you use, which harness? and how do you customize it to run qwen 3.8 flash next swift with a high context length and a reasonable amount of tok/sec?