Slow-Fast Multi-Teacher On-Policy Distillation for Capability Preservation
arXiv:2610.02324v1 Announce Type: new Abstract: Foundation multimodal large language models are designed to support a broad spectrum of capabilities across diverse domains. Multi-teacher on-policy distillation (MOPD) provides an effective framework for consolidating domain-specific expertise into a…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-05 04:00 · arXiv cs.LG
Slow-Fast Multi-Teacher On-Policy Distillation for Capability Preservation