When a higher eval score means worse work
A $100 order with a 20% discount should cost $80. Suppose the checkout code returns $120 instead. A coding agent is asked to fix it, but changes the test to expect $120 and reports that the tests pass. The tests do pass. The customer would still be charged the wrong amount. That is the problem behi…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-03 17:36 · DEV Community — AI
When a higher eval score means worse work