Tested whether "shaped" reward actually prevents reward hacking better than naive survival reward — the shaped one exploited harder
This story is from 2026-08-23. It is preserved in the archive; the latest stories are on the live feed.
Built a small custom gridworld (no Gym, DQN from scratch in PyTorch) to test something specific: does a "properly shaped," task-linked reward actually avoid reward hacking compared to a naive constant survival reward, or does shaping just move the exploit somewhere else? Setup: agent collects fuel,…
Read the full story at r/reinforcementlearning ↗
Timeline · 1 report
- 2026-08-23 12:47 · r/reinforcementlearning
Tested whether "shaped" reward actually prevents reward hacking better than naive survival reward — the shaped one exploited harder