Measured a real agent workload: input tokens outnumber output 30:1, so your provider bill is prefill, not generation
This story is from 2026-09-09. It is preserved in the archive; the latest stories are on the live feed.
I run inference infra and pulled a day of real agent traffic. The token ratio changed how I read provider pricing. 24 hours, 4100 requests: 201.8M input tokens vs 2.27M output. That's 89:1. Average request was 50,239 in, 564 out. Obvious in hindsight — agents re-send the whole conversation plus too…
Read the full story at r/AI_Agents ↗
Timeline · 1 report
- 2026-09-09 22:49 · r/AI_Agents
Measured a real agent workload: input tokens outnumber output 30:1, so your provider bill is prefill, not generation
More stories
- Gemini Hacked Three Companies in First Known Breakout by Google’s AI — Wall Street Journal Technology
- Google Joins OpenAI, Anthropic, Meta in Disclosing AI Hacks — Bloomberg AI
- Introducing Kimi K3 on Amazon Bedrock — AWS Machine Learning Blog
- Introducing Amazon SageMaker HyperPod Inference Gateway — AWS Machine Learning Blog
- Introducing Astra for Law — OpenAI News
- Newsom signs executive order to explore new AI rules, consider ‘kill switch’ — Politico Technology
- Anthropic, OpenAI, SpaceXAI, Google sued over call to ‘pace’ AI development — Politico Technology
- Sources: Anthropic considers releasing a new AI model to counter OpenAI's momentum since Astra's launch, ahead of an IPO and after Amodei's call for a slowdown (Reuters) — Techmeme
Get the daily brief of stories like this at 6:30 every morning →