PreSO: Privileged Representation Isolation for On-Policy Self-Distillation
arXiv:2610.14001v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) uses a self-teacher conditioned on privileged information to turn the sparse outcome signal of reinforcement learning with verifiable rewards (RLVR) into dense token-level supervision. Yet the teacher's advantage may…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-14 04:00 · arXiv cs.LG
PreSO: Privileged Representation Isolation for On-Policy Self-Distillation