vLLM's Kimi K3 Backend Hits 842 Tokens per Second on NVIDIA Blackwell GPUs
A unified CuTe DSL decode path on GB300 pushes Kimi K3 to 842 tokens/s at batch 1, up to 2x faster than stock vLLM.
Read the full story at AlphaSignal ↗
Timeline · 1 report
- 2026-10-18 01:55 · AlphaSignal
vLLM's Kimi K3 Backend Hits 842 Tokens per Second on NVIDIA Blackwell GPUs