Radeon AI Pro R9700 w/ Qwen3.8-27B Q8 hitting 90.8toks
This story is from 2026-09-15. It is preserved in the archive; the latest stories are on the live feed.
BOOM: Token Maxxed https://www.localmaxxing.com/en/runs/cmu2x80ei068ulq01ec0aaxd4 So thanks to this group and another user here, I found the RDNA Boosts repo. And have been playing around with it. My single stream vLLM numbers just slightly beat this. They bet prefill by a lot - but this is really…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-15 18:07 · r/LocalLLM
Radeon AI Pro R9700 w/ Qwen3.8-27B Q8 hitting 90.8toks