People with RTX PRO 6000, what tokens per second are you getting with Qwen 3.8 27B?
This story is from 2026-09-01. It is preserved in the archive; the latest stories are on the live feed.
I have a dual RTX PRO 4000 setup. I get around 35 tokens per second with Qwen 3.8 27B Q6. But above 100k context, it drops down to around 20. I was considering an upgrade in the near future and I’m just curious what numbers people with the RTX 6000 are getting. On paper the RTX 6000 is paper becaus…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-01 18:14 · r/LocalLLM
People with RTX PRO 6000, what tokens per second are you getting with Qwen 3.8 27B?