GPQA Diamond Has 198 Questions: What the Hugging Face Leaderboard's 115 Rows Can and Cannot Rank
This story is from 2026-10-21. It is preserved in the archive; the latest stories are on the live feed.
TL;DR On October 22, 2026 the Hugging Face official GPQA Diamond leaderboard returned 115 rows for 97 repos, and 0 rows marked verified . 60 rows link to a model card, 22 come from an EvalEval source, 33 have another or no source. GPQA Diamond has 198 questions . One question is 0.505 points. A sco…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-21 16:05 · DEV Community — AI
GPQA Diamond Has 198 Questions: What the Hugging Face Leaderboard's 115 Rows Can and Cannot Rank