Contamination Inflates Scores but Rarely Reorders Large Language Model Leaderboards
This story is from 2026-09-04. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.02899v1 Announce Type: new Abstract: Benchmark contamination, the leakage of test items into training data, is widely described as a threat to the reliability of large language model (LLM) leaderboards. We argue that this concern conflates two distinct questions: whether contamination in…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-09-04 04:00 · arXiv cs.CL
Contamination Inflates Scores but Rarely Reorders Large Language Model Leaderboards