Qwen3.8-27B on a single RX 9070 XT: ~150 tok/s on code, 96k context, one-line install
After seeing so many posts and recipes from Mia's AI Lab ( https://github.com/MiaAI-Lab ) for Nvidia GPUs and DGX Sparks using EXL3, I got such bad buyer's remorse that I wanted it on my 9070 XT. Well, turns out upstream ExLlamaV3 already supported ROCm. All I had to do was experiment a lot more. O…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-14 09:40 · r/LocalLLM
Qwen3.8-27B on a single RX 9070 XT: ~150 tok/s on code, 96k context, one-line install