One Misplaced Block Made Every Message Rewrite 19,000 Cached Tokens
This story is from 2026-10-18. It is preserved in the archive; the latest stories are on the live feed.
Prompt caching is the cheapest win in an AI coding agent. The system prompt and tool definitions are the same on every request, so the provider can keep them and charge a fraction for reading them back. Atlarix has marked its prompt for caching for a long time, and the logs looked right. Then a QA…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-18 01:10 · DEV Community — AI
One Misplaced Block Made Every Message Rewrite 19,000 Cached Tokens