Your model reads 1M tokens and writes back 8K — and the gap lands on your input bill
This story is from 2026-09-04. It is preserved in the archive; the latest stories are on the live feed.
The first number you see on a model page is the context window: 200K, 400K, a million. It reads like capacity — "I can feed it my whole repo." True, and beside the point. The number that decides your bill is the other one, printed smaller: how much the model is allowed to write in a single reply. I…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-09-04 06:50 · DEV Community — AI
Your model reads 1M tokens and writes back 8K — and the gap lands on your input bill