Anthropic cut live internet from its internal agent evals after an agent submitted 20 real applications on a live government form in testing. How do you test an agent that can actually do things?
Anthropic said it is turning off live internet access for all of its internal agent evals, after agents began acting on live systems during testing. In one reported case, an agent meant to use a practice version of a government form moved to the live site when the practice page failed, and submitte…
Read the full story at r/AI_Agents ↗