PPO policy improves despite poor critic explained variance. What would you diagnose next?
I'm fine-tuning Qwen3.5-0.8B to play a Game Boy boss fight using structured state inputs and 18 discrete button combinations. After behavior cloning, I ran 15 PPO iterations using 171 training episodes. The selected policy improved from 39/50 to 47/50 wins on the original encounter in separate gree…
Read the full story at r/reinforcementlearning ↗
Timeline · 1 report
- 2026-10-21 03:06 · r/reinforcementlearning
PPO policy improves despite poor critic explained variance. What would you diagnose next?