Stochastic Teacher Intervention for Agentic On-Policy Distillation
arXiv:2610.10878v1 Announce Type: new Abstract: On-policy distillation (OPD) efficiently transfers capabilities from a stronger teacher to a student language model through dense token-level supervision on student-generated rollouts and has shown promise on complex tasks such as mathematical reasoni…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-09 04:00 · arXiv cs.CL
Stochastic Teacher Intervention for Agentic On-Policy Distillation