The Mean Lied: How a Second Statistic Fixed Long-Context Memory
Two document chunks walk into a model. Both score 0.20 on average relevance to your question. One contains the exact fact you need; the other contains nothing but vaguely related words. A router that only looks at the average cannot tell them apart — it splits its attention 50/50 and dilutes the an…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-30 15:56 · DEV Community — Machine Learning
The Mean Lied: How a Second Statistic Fixed Long-Context Memory