Stabilizing language models under continual learning via condition-anchored distillation
arXiv:2610.06940v1 Announce Type: new Abstract: Continual adaptation of language models can change their output distribution on prompts learned earlier, while retaining every old prompt-answer pair may be undesirable or impossible. We study condition-anchored generative distillation (CAGD): retain…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-07 04:00 · arXiv cs.CL
Stabilizing language models under continual learning via condition-anchored distillation