The same prompt costs 1.64x more in Hindi than in English — one tokenizer ago it was 5.28x
This story is from 2026-10-22. It is preserved in the archive; the latest stories are on the live feed.
You pay for an LLM by the token, not by the word. So here's a question nobody asks until the invoice arrives: does the same message cost the same in every language? It doesn't. I measured it on one small text, and the answer ranges from "a bit more" to "five times more", depending on the language a…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-22 11:00 · DEV Community — AI
The same prompt costs 1.64x more in Hindi than in English — one tokenizer ago it was 5.28x