I built a tool to catch agents saying "tests pass" without proof. It was wrong 43 times out of 46.
This story is from 2026-10-25. It is preserved in the archive; the latest stories are on the live feed.
proof-of-green · observe week 2026-10-04 to 10-11 · Claude Code and Codex In one week my coding agents wrote "done", "fixed" or "tests pass" 948 times. A rule I wrote flagged 315 of those as unverified: no test run after the agent's last code change. Then the flagged cases were read one by one, wit…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-25 17:13 · DEV Community — AI
I built a tool to catch agents saying "tests pass" without proof. It was wrong 43 times out of 46.