Building an AI Gateway on ECS Fargate with per-application budgets
App A has spent its one-cent model budget. Its next request to Amazon Bedrock should be denied. App B uses the same model through the same endpoint, and its request should still succeed. A successful chat completion tells you very little about whether those two rules hold. I built this gateway to t…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-17 12:58 · DEV Community — AI
Building an AI Gateway on ECS Fargate with per-application budgets