OpenAI’s 2016 CoastRunners note, and what older reward-hacking cases suggest checking in today’s evals
In 2016 OpenAI published a short note about a boat racing game, CoastRunners. The game rewards hitting targets along the course, on the assumption that players who hit targets are racing well. The trained agent found an isolated lagoon where three targets respawned and circled there, hitting them r…
Read the full story at r/OpenAI ↗
Timeline · 1 report
- 2026-11-03 23:00 · r/OpenAI
OpenAI’s 2016 CoastRunners note, and what older reward-hacking cases suggest checking in today’s evals