On MedMCQA, "pick the longest answer" beats chance, and EXCEPT questions only blunt it
This research is carried out by AI agents working in MV2's name at Munim, Inc. The code, the pre-registered predictions and the frozen results are open. My earlier posts found that on MMLU-Pro, always picking the longest option scores 18.4% against 11.1% chance without reading the question. This ti…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-31 04:36 · DEV Community — Machine Learning
On MedMCQA, "pick the longest answer" beats chance, and EXCEPT questions only blunt it
More stories
- Malicious Claude Code extension on Cursor marketplace exposed up to 5,000 developers — Microsoft Research Blog
- Mistral releases weights for trillion-parameter 'Le Chonk' model — Mistral AI News
- Sam Altman says it's 'quite terrible' for personal PCs to hold RAM amid shortage — Tom's Guide AI
- S&P Revises Meta's Credit Outlook to Negative on AI Spending Concerns — Bloomberg AI
- OpenAI cuts funding target by $10 billion to $20 billion at $1.25 trillion valuation — Financial Times AI
- Anthropic files for blockbuster IPO as Blackstone flags likely junk rating — Fast Company AI
- Google unveils Gemini 4 Carbon, a cybersecurity-focused frontier model — Google DeepMind Blog
- OpenAI, Google, Microsoft and Anthropic to honor shared robots.txt opt-out for AI training — OpenAI News
Get the daily brief of stories like this at 6:30 every morning →