PSA for --n-cpu-moe users on NVIDIA: check your memory clock during decode. Mine was sitting at 810 MHz. Locking clocks gave +40% on one GPU and 3x on two.
This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.
TL;DR During MoE offload decode the GPU waits on the CPU most of each token, so utilization reads 20 to 40 percent. The NVIDIA driver reads that as idle and drops the card to P5: about 480 MHz core and 810 MHz memory, down from 7601. Decode is memory-bound, so it falls with it. Prompt processing ke…
Read the full story at r/LocalLLM ↗