The Budget Guard Refunded Twice, So the Batch Outlived Its Cap
The short version: my token budget guard refunded the same reservation on every retry. The counter drifted upward, the batch ran past its cap, and half the shards died at the worst moment. The fix was one rule: a reservation can be closed exactly once. One note before we start. The log shapes below…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-08 19:44 · DEV Community — AI
The Budget Guard Refunded Twice, So the Batch Outlived Its Cap