Retry Amplification: A Circuit Breaker for Batch Model Jobs
This story is from 2026-09-14. It is preserved in the archive; the latest stories are on the live feed.
A nightly job walked a folder of 4,000 JSON files and called a model once per file. At 02:14 the upstream started returning 429s. By 02:40 the job had issued roughly 61,000 calls and written zero results. The queue was not slow. It was multiplying itself. That shape of incident is common in batch m…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-09-14 21:36 · DEV Community — AI
Retry Amplification: A Circuit Breaker for Batch Model Jobs