Gemini 4 Argon has a new tokenizer: Korean and Japanese got 8% cheaper, Indian languages up to 19% dearer
This story is from 2026-10-21. It is preserved in the archive; the latest stories are on the live feed.
Gemini 4 Argon ships with a new tokenizer. The same text no longer gives the same token count as on Gemini 3.x, and token counts are what you pay for and what fills the context window. So I measured what changed, in 41 languages. The short version: Korean needs 8% fewer tokens and Japanese 7% fewer…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-21 12:13 · DEV Community — AI
Gemini 4 Argon has a new tokenizer: Korean and Japanese got 8% cheaper, Indian languages up to 19% dearer