When to Follow the Teacher: Advantage-Based On-Policy Distillation
arXiv:2610.31563v1 Announce Type: cross Abstract: Online Policy Distillation (OPD) often outperforms offline methods such as Supervised Fine-Tuning (SFT) by training on trajectories sampled directly from the student. However, standard OPD trains the student to follow the teacher at every state of t…
Read the full story at arXiv stat.ML ↗
Timeline · 1 report
- 2026-10-23 04:00 · arXiv stat.ML
When to Follow the Teacher: Advantage-Based On-Policy Distillation