From Small to Large: Assessing Medical Reasoning, Benchmark Contamination, and Model Size in Language Models

arXiv:2611.00460v1 Announce Type: new Abstract: Large language models (LLMs) now answer medical exam questions at or above expert level, but it is unclear whether such scores reflect clinical competence, or are instead affected by the format of the questions being asked (e.g., multiple-choice versu…

Read the full story at arXiv cs.AI ↗

Timeline · 1 report

1. 2026-11-03 05:00 · arXiv cs.AI
   From Small to Large: Assessing Medical Reasoning, Benchmark Contamination, and Model Size in Language Models