Running GLM 5.3 Flash on RTX 6000 Max-Q and DDR4 = ~35 tok/s with 512K context. Do you recommend DDR5?
Switch to DDR5 would cost me 4k EUR, it would be worth it if I get ~50 tok/s. I achieved 35 tok/s just thanks to Project Maya. Don't you have an experience please? EDIT: quant is Q3_K_XL
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-27 23:15 · r/LocalLLM
Running GLM 5.3 Flash on RTX 6000 Max-Q and DDR4 = ~35 tok/s with 512K context. Do you recommend DDR5?