Qwen3.8-Flash-Next-Uncensored (125B MoE) running on a 16GB GPU! Pushing 50% context (132K tokens) on AMD RX 9070 XT & llama.cpp ROCm

This story is from 2026-09-01. It is preserved in the archive; the latest stories are on the live feed.

# Cracking the "Memory Wall": A Guide to Running 100GB+ MoE Models on a 16GB GPU via SSD mmap in llama.cpp > 🚨 **WARNING:** The text of this article was edited and polished into its final form with the help of an LLM, since English is not my native language. I will also answer technical comments i…

Read the full story at r/LocalLLM ↗

Timeline · 4 reports

1. 2026-09-04 00:39 · r/LocalLLM
   UPDATE: Qwen3.8-Flash-Next on 2x3090 + DDR4 (Part 2): 25-29 -> 37-41 t/s decode (UD-Q4_K_XL + expert cache + MTP), plus a branch you can build
2. 2026-09-04 00:21 · r/LocalLLaMA
   UPDATE: Qwen3.8-Flash-Next on 2x3090 + DDR4 (Part 2): 25-29 -> 37-41 t/s decode (UD-Q4_K_XL + expert cache + MTP), plus a branch you can build
3. 2026-09-03 03:04 · r/LocalLLaMA
   Qwen3.8-Flash-Next on 2x3090 + DDR4: 17 → 25-29 t/s decode with the expert cache PR
4. 2026-09-01 09:26 · r/LocalLLM
   Qwen3.8-Flash-Next-Uncensored (125B MoE) running on a 16GB GPU! Pushing 50% context (132K tokens) on AMD RX 9070 XT & llama.cpp ROCm