Qwen3.8 27B on single R9700 some numbers
This story is from 2026-09-04. It is preserved in the archive; the latest stories are on the live feed.
Seeing mostly dual R9700 numbers and improving my local single R9700 setup, here is my current setup and some numbers. Fully local inference on a single AsRock Radeon AI PRO R9700 (RDNA4, 32 GB) (PCIe 3.0, x4), running Qwen3.8-27B-MXFP4 at 160k context, capped at 220W. The vLLM setup This uses stil…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-04 21:32 · r/LocalLLM
Qwen3.8 27B on single R9700 some numbers