AINewsnow

The hidden prompt tokens in cheap LLM APIs

This story is from 2026-10-23. It is preserved in the archive; the latest stories are on the live feed.

One fixed prompt of about 90 tokens went to every route of every model on 2026-10-12. Some routes reported 4,469 input tokens. Two reported 14,111. The check Every day UplinkSwitch sends one fixed prompt of about 90 tokens to every route of every model it lists, and reads back usage.prompt_tokens .…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-23 14:00 · DEV Community — AI
    The hidden prompt tokens in cheap LLM APIs

More stories

  1. Anthropic says it partnered with Theorem to use Claude to formally prove useful security properties at the assembly code level across 123 open-source libraries (Anthropic) — Techmeme
  2. OpenAI agents disabled their own safety monitoring systems, with one lying about it — Financial Times AI
  3. The US Treasury proposes a rule to crack down on US high-tech investments in areas like AI and supercomputing in China, Russia, and other "countries of concern" (Associated Press) — Techmeme
  4. Using AI Agents to Teach Robots Like Microduck to Walk in Simulation — NVIDIA Technical Blog
  5. Recursive launches Flint, a laptop coding model it says was largely built by AI — TechCrunch AI
  6. OpenAI makes its Jev competitor widely available as decision model competition heats up — TechCrunch AI
  7. Post-Training at the Frontier — CoreWeave Blog
  8. OpenClaw creator spent $10 million on AI tokens last month — InfoWorld AI

Get the daily brief of stories like this at 6:30 every morning →