Qwen 3.8 on llama.cpp (Vulkan) for AMD - any token generation speedup tips?
This story is from 2026-09-03. It is preserved in the archive; the latest stories are on the live feed.
I have the following: Windows 11 Ryzen 9900X 64GB DDR5 9070XT 16GB 9700 AI Pro 32GB I've managed to split Unsloth/Qwen Q6_K over both GPUs using the --fit-target flag and I've got draft-spec-mtp enabled, about to enable ngram mod as well. My token speed seems to vary from 20 t/s to 50 t/s. I was wo…
Read the full story at r/LocalLLM ↗
Timeline · 5 reports
- 2026-09-05 14:20 · r/LocalLLaMA
NInfer vs llama.cpp vs vLLM: quality + speed comparison for Qwen3.8-27B NVFP4 on RTX 5090 - 2026-09-04 20:20 · r/LocalLLM
Moving 2× RX 7900 XTX (+2× MI50) from a 2013 Xeon board to EPYC to finally get PCIe P2P for tensor parallel — can anyone confirm this config before I buy? - 2026-09-04 20:15 · r/LocalLLM
Qwen3.8 27B on RX 7900 XTX: Ollama ROCm vs llama.cpp Vulkan results - 2026-09-04 06:25 · r/LocalLLM
RX 9060 XT 16G + MI50 16G for layer split using llama.cpp + Vulkan - 2026-09-03 12:15 · r/LocalLLM
Qwen 3.8 on llama.cpp (Vulkan) for AMD - any token generation speedup tips?