Free Tokens Are Not Context: A Haystack Test for Long-Context Decay
This story is from 2026-09-04. It is preserved in the archive; the latest stories are on the live feed.
Last week I pasted three lecture transcripts into a free chat model and asked, "What does Theorem 3 in section five say?" The model answered that section five did not contain a theorem. The theorem was there, in the second paragraph, about forty thousand tokens into the prompt. The model was not ly…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-09-04 10:58 · DEV Community — AI
Free Tokens Are Not Context: A Haystack Test for Long-Context Decay