Auditing a Model-Hub Benchmark: Data Quality, Training Budgets, and Side Information in HuggingBench
arXiv:2611.03727v1 Announce Type: new Abstract: Benchmarks built from model hubs combine interaction data, knowledge graphs (KGs) and resource documentation, but valid files do not ensure that these artifacts describe the same objects. Treating the release as a data product, we audit HuggingBench (…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-11-04 05:00 · arXiv cs.LG
Auditing a Model-Hub Benchmark: Data Quality, Training Budgets, and Side Information in HuggingBench
More stories
- Runway News | Runway Dev is in Claude Code, Codex and Cursor — Runway Research
- Marvell to Acquire Lumentum in $115 Billion All-Stock AI Optics Deal — DigiTimes Asia
- Schools Will Lose Google Search If They Say No To Google AI — Forbes AI
- OpenAI hires former Army Secretary Dan Driscoll as senior counselor for national security — OpenAI News
- OpenAI is finally merging ChatGPT’s Chat and Work tabs — TechCrunch AI
- Anthropic plans to sell $3.5 billion of shares to Japan investors in IPO, filing shows — Reuters AI
- Abu Dhabi's ADNOC, G42 sign deal with OpenAI as Sam Altman travels to UAE — Reuters AI
- Oracle cancels $7bn Tencent AI deal under Trump pressure — Financial Times AI
Get the daily brief of stories like this at 6:30 every morning →