My HalfCheetah learned to lie on its back while the reward kept climbing, so I built a watcher for overnight runs (local VLM + TabPFN)
I'm an MSc robotics student and I kept waking up at night to check PPO runs. Last week one run's reward went from 908 to 3,525 over 600k steps and the cheetah was on its back the whole time. I'd flipped the sign on a level-keeping reward term. None of my usual alerts fired because nothing went down…
Read the full story at r/reinforcementlearning ↗
Timeline · 1 report
- 2026-10-26 02:40 · r/reinforcementlearning
My HalfCheetah learned to lie on its back while the reward kept climbing, so I built a watcher for overnight runs (local VLM + TabPFN)