The rule that a cache has to earn its keep just stopped being true
https://sathishkumars637097.substack.com/p/vllm-v1-prefix-cache-free-at-zero-hits?r=1jbi98&utm_campaign=post-expanded-share&utm_medium=web
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-09-21 20:48 · r/learnmachinelearning
The rule that a cache has to earn its keep just stopped being true