The tests passed. The code was still wrong.
The agent wrote the code, then wrote tests that matched it. Suite went green. I broke one line on purpose. It still passed. The tests were documenting the bug. I ended up checking for that before I trust a ZIP. Curious if anyone else breaks a line after a green suite, or if you just read the diff.…
Read the full story at r/ChatGPTCoding ↗
Timeline · 1 report
- 2026-10-12 14:00 · r/ChatGPTCoding
The tests passed. The code was still wrong.