AI agents said “done” when nothing actually happened, and making them think harder didn’t help
I ran a small study on what AI agents do when a save says “success” but nothing actually changed. I used 20 airline customer service tasks from τ-bench and tested Claude Sonnet 5.5, GPT-6.1 Sol and DeepSeek V4.1 Flash, each at low and high reasoning effort. Agents told the customer it was done in 9…
Read the full story at r/artificial ↗
Timeline · 1 report
- 2026-10-30 23:31 · r/artificial
AI agents said “done” when nothing actually happened, and making them think harder didn’t help