Count Tokens per Span, Not per Run
This story is from 2026-10-17. It is preserved in the archive; the latest stories are on the live feed.
Count Tokens per Span, Not per Run A run total is an invoice. It tells you what you owe, and nothing about what to change. The moment an agent run costs more than you expected, the useful question is which span spent the tokens: the retrieval call, the tool schema you re-sent twelve times, the retr…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-17 06:35 · DEV Community — AI
Count Tokens per Span, Not per Run