RAG Retrieval Accuracy Drops 40 Points as Distracting Passages Reach 2.68M
A reproducible test of BM25, embeddings, and parent-document retrieval found accuracy fell 40 points when distracting passages grew to 2.68 million, suggesting author-written evals overrate search and answer position in context matters.
Read the full story at Towards Data Science ↗
Timeline · 1 report
- 2026-11-12 16:30 · Towards Data Science
RAG Retrieval Lost 40 Points When Distracting Passages Grew to 2.68M