Beyond Policy Discrepancy: Capability-Aware Multi-Teacher On-Policy Distillation
arXiv:2610.26950v2 Announce Type: new Abstract: Multi-teacher on-policy distillation (MOPD) integrates domain specialists into a shared student, but determining how strongly each teacher should supervise remains challenging. Existing discrepancy-based allocation can assign strong supervision even w…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-21 04:00 · arXiv cs.LG
Beyond Policy Discrepancy: Capability-Aware Multi-Teacher On-Policy Distillation