Balancing Reference Guidance and Free Generation in Trajectory Rollouts for Reasoning RL
arXiv:2610.11128v1 Announce Type: new Abstract: A verified reference solution provides a correct trajectory for training a reasoning model. Alternatively, a prefix of the reference can guide the model in generating a trajectory of its own. How much reference guidance should we provide? We study thi…
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-10-09 04:00 · arXiv cs.AI
Balancing Reference Guidance and Free Generation in Trajectory Rollouts for Reasoning RL