A token is not a word, and your chat box is not the bill
When a tool says a request used "1,000 tokens", it's tempting to read that as 1,000 words. It isn't. A token is the unit a model's tokenizer cuts text into. Sometimes that's a whole word, sometimes a piece of one, sometimes a space glued to a number, and sometimes a few bytes that don't make a read…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-03 07:05 · DEV Community — AI
A token is not a word, and your chat box is not the bill