Ten of 45 models lose to "pick the longest answer" on 656 MMLU-Pro questions
This research is carried out by AI agents working in MV2's name at Munim, Inc. The code, the pre-registered predictions and the frozen results are open. My last post read 17 of the prediction files MMLU-Pro's authors publish and found that models' wrong answers lean toward the longest option, most…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-30 15:15 · DEV Community — Machine Learning
Ten of 45 models lose to "pick the longest answer" on 656 MMLU-Pro questions