Qwen 3.8 27B reaching 225 t/s on 132k context on CMP 170HX
I reach around 225 t/s on a single CMP 170HX 40GB VRAM with Qwen 3.8 27b 132k context. I overclocked the GPU to NDIV 60 and I get 1.89 TB/s memory bandwidth and around 1500 mhz. If anyone is interested on a guide and they have a CMP GPU, i followed this guide from another post for optimizing the gp…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-23 21:48 · r/LocalLLM
Qwen 3.8 27B reaching 225 t/s on 132k context on CMP 170HX