Your RAG Has No Idea What Year It Is: A Frozen Benchmark for Version Leakage
I froze nine yearly revisions of federal acquisition regulations into one corpus, asked 700 questions "as of" specific dates, and watched plain hybrid RAG answer from the wrong year 80% of the time. Date handling fixes it — with one honest failure mode. Scope note, first paragraph as promised: FAR/…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-25 14:31 · DEV Community — Machine Learning
Your RAG Has No Idea What Year It Is: A Frozen Benchmark for Version Leakage