Whose Data, Whose Benchmark? A User-Centric Framework for Auditing Evaluation Resources
arXiv:2610.19268v1 Announce Type: new Abstract: Benchmarks shape how model capabilities are measured and interpreted, yet their scores can obscure whose conventions, contexts, and judgments define successful performance. We introduce a user-centric audit framework that distinguishes users who contr…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-15 04:00 · arXiv cs.CL
Whose Data, Whose Benchmark? A User-Centric Framework for Auditing Evaluation Resources