AINewsnow

Length Is Cheap, Competition Is Not: Attention Predicts Context Rot in Retrieval [R]

This story is from 2026-11-04. It is preserved in the archive; the latest stories are on the live feed.

Author here. A short summary, since the title is a claim. Setup: key-value retrieval, 512 to 32K tokens, five open models (0.5B to 3B, four families). At equal length and equal evidence position, we fill the context either with neutral text or with statements in the format of the evidence. On every…

Read the full story at r/MachineLearning ↗

Timeline · 1 report

  1. 2026-11-04 21:08 · r/MachineLearning
    Length Is Cheap, Competition Is Not: Attention Predicts Context Rot in Retrieval [R]

More stories

  1. 48-Hour Field Notes: Free-Tier LLM Batch Jobs Reveal Hidden Reliability and Cost Pitfalls — DEV Community — AI
  2. US AI Safety Center Staff Now Report to White House, Raising Independence Concerns — AP News
  3. Man sues OpenAI, alleging ChatGPT helped his wife plot to poison him — Bloomberg AI
  4. Nous Research releases Arete-27B, cutting Qwen3.8-27B propaganda rate from 22% to 0.9% — AlphaSignal
  5. Hydra-PSIE expands 'Coeziune OM–IA' DOI registry to 38 published works — DEV Community — AI
  6. AI stocks tumble as midterm results spark fears over data center buildout — CNN Business
  7. Claude Code ecosystem expands with memory, browser, and workspace tools — DEV Community — AI
  8. Microsoft Research dissolves AI Frontiers group as researcher John Langford exits — Hacker News Front Page

Get the daily brief of stories like this at 6:30 every morning →