AINewsnow

How Hugging Face Official Benchmark Leaderboards Actually Work: .eval_results YAML, the base_model Filter, and the 30% the Default View Hides

This story is from 2026-10-05. It is preserved in the archive; the latest stories are on the live feed.

TL;DR: Hugging Face currently tags 48 datasets as official benchmarks ( benchmark:official ). Their leaderboards are not uploaded by the benchmark owners: they are assembled automatically from small .eval_results/*.yaml files that model authors commit to their own model repos (or propose through pu…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-05 08:56 · DEV Community — Machine Learning
    How Hugging Face Official Benchmark Leaderboards Actually Work: .eval_results YAML, the base_model Filter, and the 30% the Default View Hides

More stories

  1. California Sues OpenAI For Allegedly Misleading and Endangering the Public — Forbes AI
  2. Hugging Face routes Inference Providers language model traffic through OpenRouter — r/LocalLLaMA
  3. How to Run Apple's FastFrames-L Video Model Locally (It Won't Run on a Mac) — DEV Community — Machine Learning
  4. IFBench on Hugging Face: 0 of 23 Rows Are Verified, and Ranks 1 to 6 Sit Inside One 300-Prompt Error Band — DEV Community — Machine Learning
  5. Olala 7A1B says 8 GB, but the BF16 file is 13.59 GB: what a 1B-active hybrid MoE needs to run — DEV Community — Machine Learning
  6. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  7. Cloudflare opens weights for Clairic extraction models — DEV Community — AI
  8. ETNews: 70.7% of the World's 300 Most Downloaded Language Models Are Chinese, and One Korean Model Is on the List — DEV Community — AI

Read the Daily Brief: the day's most important AI stories →