Progressive Misalignment Can Emerge from Benign Recursive Self-Distillation
arXiv:2610.22467v1 Announce Type: new Abstract: Training models on their own outputs has attracted widespread attention as a possible route to advance AI capabilities. One prominent approach is self-distillation, where a model is trained to match the token-level predictions it would have produced w…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-19 04:00 · arXiv cs.LG
Progressive Misalignment Can Emerge from Benign Recursive Self-Distillation