Four of Eight KV-Cache Bugs Are Bit-Identical at Step 1, So the Check Everybody Writes Has Recall Exactly 0.500
This story is from 2026-08-23. It is preserved in the archive; the latest stories are on the live feed.
A KV cache is not an approximation. Under causal attention, appending a token cannot move an earlier position's residual stream, keys or values - measured at exactly 0 per layer - so a cached decode and a full recompute are the same function. Turn the mask off and the cache is still exact at layer…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-08-23 12:41 · DEV Community — Machine Learning
Four of Eight KV-Cache Bugs Are Bit-Identical at Step 1, So the Check Everybody Writes Has Recall Exactly 0.500