LLMs Fail Modified Monty Hall Problem Despite Step-by-Step Reasoning

Five large language models scored near 33% accuracy on a modified Monty Hall problem, with one model correctly quoting the host's rule before ignoring it in its answer.

Read the full story at Towards Data Science ↗

Timeline · 1 report

2026-11-08 13:00 · Towards Data Science
Change One Monty Hall Rule and Five LLMs Still Say Switch

More stories

Election backlash against data centers rattles AI stocks and expansion plans — TechCrunch AI
Anthropic strikes $3.4bn deal for gas-fired generators to power AI data centres — Financial Times AI
OpenAI to keep expanding AI data centers despite election results favoring restrictions — DigiTimes Asia
Tencent AI chief warns AI will soon master biology, raising new safety risks — SCMP China Tech
Hydra-PSIE expands 'Coeziune OM–IA' DOI registry to 39 published works — DEV Community — AI
Developer's 48-Hour Field Notes Detail Free-Tier LLM Batch Job Failures — DEV Community — AI
Apple's John Ternus reportedly pushing for faster AI progress beyond Siri upgrades — Techmeme
US AI Safety Center Staff Now Report to White House, Raising Independence Concerns — AP News

Get the daily brief of stories like this at 6:30 every morning →