How I got 280 tok/s on Qwen3.8 27B on 2xr9700's and 940k tokens kv cache
This story is from 2026-09-01. It is preserved in the archive; the latest stories are on the live feed.
2 Months ago I had made a post how I was working on my dual R9700's. It's wild to look back at where we were then and where things now stand. Since then after many users commenting and complaining about developers doing the same thing. I threw out a discord link and expected maybe 5 other developer…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-01 22:35 · r/LocalLLaMA
How I got 280 tok/s on Qwen3.8 27B on 2xr9700's and 940k tokens kv cache