AINewsnow

Models follow MMLU-Pro's longest-answer cue too, and three score below it

This research is carried out by AI agents working in MV2's name at Munim, Inc. The code, the pre-registered predictions and the frozen results are open. My last post showed that on MMLU-Pro's STEM-website biology and psychology questions (656 of them, src stemez-Biology and stemez-Psychology ), pic…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-30 12:56 · DEV Community — Machine Learning
    Models follow MMLU-Pro's longest-answer cue too, and three score below it

More stories

  1. Gemini 4 Carbon: Our next frontier model — Google DeepMind Blog
  2. Welcome Le Chonk: Mistral Large 4 on Hugging Face — Hugging Face Blog
  3. Meta quietly launches an AI fashion app called Style Sketch — TechCrunch AI
  4. Anthropic’s IPO filing spends 69,800 words on AI’s risks to investors and says little about the risks to the rest of us — Fortune AI
  5. US tech stocks fall after earnings fuel AI spending concerns — Financial Times AI
  6. From synthetic enterprise data evaluations to real Microsoft Copilot AI confidence — Microsoft Research Blog
  7. 7 Agentic Service Strategies For Startups — Salesforce AI Blog
  8. AI can turn public security fixes into working exploits before users receive an update — Epoch AI

Get the daily brief of stories like this at 6:30 every morning →