Stop telling agents not to do dangerous things. Remove the capability instead.
In April 2026, a Cursor agent running Claude Opus 4.6 deleted a startup's production database. The company, PocketOS, had explicit guardrails against destructive commands, both in its project configuration and in the agent's system prompt. When asked to explain afterward, the agent said: "I violate…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-08 10:08 · DEV Community — AI
Stop telling agents not to do dangerous things. Remove the capability instead.