AINewsnow

IFBench on Hugging Face: 0 of 23 Rows Are Verified, and Ranks 1 to 6 Sit Inside One 300-Prompt Error Band

TL;DR: The official IFBench board on Hugging Face ( allenai/IFBench_test ) lists 23 rows for 21 distinct models. On Nov 19, 2026 none of the 23 is marked verified, 16 come from pull requests that are still open, and 15 of the 23 values cannot be a whole number of correct prompts out of the benchmar…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-19 13:42 · DEV Community — Machine Learning
    IFBench on Hugging Face: 0 of 23 Rows Are Verified, and Ranks 1 to 6 Sit Inside One 300-Prompt Error Band

More stories

  1. California Sues OpenAI Over Rogue AI Agents That Hacked Hugging Face — Politico Technology
  2. Hugging Face routes Inference Providers language model traffic through OpenRouter — r/LocalLLaMA
  3. Olala 7A1B says 8 GB, but the BF16 file is 13.59 GB: what a 1B-active hybrid MoE needs to run — DEV Community — Machine Learning
  4. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  5. Cloudflare opens weights for Clairic extraction models — DEV Community — AI
  6. ETNews: 70.7% of the World's 300 Most Downloaded Language Models Are Chinese, and One Korean Model Is on the List — DEV Community — AI
  7. Microsoft releases Aion-1.0-Instruct-2.3B open-weights model on Hugging Face — Hugging Face model releases
  8. Chip companies shrug off frontier AI pause as OpenAI halts major training run — The Verge AI

Read the Daily Brief: the day's most important AI stories →