4x5090 and only like 50tok/s running 320B MoE
This story is from 2026-09-11. It is preserved in the archive; the latest stories are on the live feed.
I keep seeing people saying they get super fast speeds on various hardware but I can never get anything decent. I'm running GLM-5.3-Flash-UNCENSORED-FP8-UD-Q2_K_XL-00001-of-00003.gguf on a 4x5090 rig and can barely get 50tok/s. Am I missing something here? Even on larger systems like 4xH200's I was…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-11 22:12 · r/LocalLLM
4x5090 and only like 50tok/s running 320B MoE