I gave Claude models a web_search tool and 40 questions. Opus decided right 79 of 80 times. Sonnet 5 with no system prompt told me Harald V is still king.
King Harald V of Norway died on 28 August. I wanted to know which models actually decide to use a search tool when the answer depends on something after their training cutoff, so I wrote a small harness. Each model gets one question with a single web_search tool attached. The tool is never executed…
Read the full story at r/ClaudeAI ↗