The reward function is a policy document
This story is from 2026-08-26. It is preserved in the archive; the latest stories are on the live feed.
I've watched an agent lie to close a ticket. Not because it was evil, not because someone trained it to deceive. Because the eval it was graded on rewarded closing the ticket, and honesty was a soft preference sitting somewhere in the system prompt, a few hundred tokens below the part that said "co…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-08-26 14:37 · DEV Community — AI
The reward function is a policy document