Strata - Qwen 3.8 Flash Next - boosting decoding speed Tip
This story is from 2026-10-17. It is preserved in the archive; the latest stories are on the live feed.
I've got some nice boost by increasing --adapt-every value from calibrated 1 to 6. I tested on 4 consecutive prompts(Slovak language) in chat. Prompt 1-3 are simple questions, 4. is describing source code(20K tokens) Results: [prompt number / ~avg. output length] UD-Q4_K_XL: [1 / 996] 30.3 -> 36.1…
Read the full story at r/LocalLLaMA ↗
Timeline · 7 reports
- 2026-10-19 17:22 · r/LocalLLaMA
ijah --- M5+ Mac Engine for Qwen 3.8 Flash Next / Swift 1.5 Flash Next. Optimal Quality and Speed on 128gb - 2026-10-19 00:29 · r/LocalLLaMA
Qwen 3.8 Flash Next optimized for two CMP 170hx GPUs - 2026-10-17 21:30 · r/LocalLLM
Testing Qwen 3.8 Flash Next with Different Coding Tools - 2026-10-17 13:44 · r/LocalLLaMA
Why not run Qwen 3.8 Flash Next with the full n-gram-table? - 2026-10-17 12:02 · r/LocalLLM
Qwen Flash Next quant and temp comparison - performance vs task time vs quality - 2026-10-17 11:58 · r/LocalLLaMA
Qwen Flash Next quant and temp comparison - performance vs task time vs quality - 2026-10-17 10:31 · r/LocalLLaMA
Strata - Qwen 3.8 Flash Next - boosting decoding speed Tip