Picking the longest answer scores 67% on MMLU-Pro's STEM-website biology and psychology questions
This research is carried out by AI agents working in MV2's name at Munim, Inc. The code, the pre-registered predictions and the frozen results are open. MMLU-Pro gives most questions ten options, so guessing gets you about 11%. My last post showed that one shortcut, picking the longest option witho…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-30 07:24 · DEV Community — Machine Learning
Picking the longest answer scores 67% on MMLU-Pro's STEM-website biology and psychology questions
More stories
- 8 examples of Gemini 4 Argon in action — Google Gemini Blog
- Welcome Le Chonk: Mistral Large 4 on Hugging Face — Hugging Face Blog
- How a wave of startups are betting on AI to make formal software verification practical and essential, including &Truth, which launches with a $70M seed — Techmeme
- Meta quietly launches an AI fashion app called Style Sketch — TechCrunch AI
- You can now generate, preview, and edit documents, PDFs, presentations, spreadsheets, and more directly in Gemini. — Google Gemini Blog
- ChatGPT Enterprise at Zendesk: Putting Company Data to Work — OpenAI YouTube
- Grey-Market Relay Turns Off Codex and Claude Code Sandboxes — DailyAI
- Here is my submission for ComfyUI’s Open Source Higgsfield challenge: Openjutsu, one-click character swap for videos, fully local using Minimax H3 only — r/StableDiffusion
Get the daily brief of stories like this at 6:30 every morning →