MTP released for Qwen3.8-Flash-Next-GGUF
This story is from 2026-09-01. It is preserved in the archive; the latest stories are on the live feed.
Can't wait to test! This should significantly boost TPS! Now we just need more llama cpp optimizations to be merged in! Edit: For anyone who wants to test this: https://github.com/unslothai/llama.cpp/pull/144/changes More info: https://huggingface.co/unsloth/Qwen3.8-Flash-Next-GGUF/blob/main/MTP/RE…
Read the full story at r/LocalLLaMA ↗
Timeline · 6 reports
- 2026-09-04 00:39 · r/LocalLLM
UPDATE: Qwen3.8-Flash-Next on 2x3090 + DDR4 (Part 2): 25-29 -> 37-41 t/s decode (UD-Q4_K_XL + expert cache + MTP), plus a branch you can build - 2026-09-04 00:21 · r/LocalLLaMA
UPDATE: Qwen3.8-Flash-Next on 2x3090 + DDR4 (Part 2): 25-29 -> 37-41 t/s decode (UD-Q4_K_XL + expert cache + MTP), plus a branch you can build - 2026-09-03 03:04 · r/LocalLLaMA
Qwen3.8-Flash-Next on 2x3090 + DDR4: 17 → 25-29 t/s decode with the expert cache PR - 2026-09-01 09:26 · r/LocalLLM
Qwen3.8-Flash-Next-Uncensored (125B MoE) running on a 16GB GPU! Pushing 50% context (132K tokens) on AMD RX 9070 XT & llama.cpp ROCm - 2026-09-01 05:30 · r/LocalLLM
MTP released for Qwen3.8-Flash-Next-GGUF - 2026-09-01 05:10 · r/LocalLLaMA
MTP released for Qwen3.8-Flash-Next-GGUF