Controlled benchmark clarifies failures in language-model data attribution
The paper studies why language-model data-attribution methods fail, noting evaluations often vary several dataset properties at once. It introduces CATT, a controlled fact-tracing benchmark using fine-tuning on entirely fictitious knowledge with unambiguous ground truth. Why it matters Reliable att…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-01 07:01 · DEV Community — Machine Learning
Controlled benchmark clarifies failures in language-model data attribution