Study Finds Stability and Plasticity Diverge Across Transformer Learning Modules
A new paper examines continual learning in Transformers at the module level, finding that stability does not mirror plasticity in declarative and procedural learning, challenging whole-model, task-agnostic analyses.
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-11-19 05:00 · arXiv cs.LG
Stability Does Not Mirror Plasticity: A Module-Level View of Declarative and Procedural Learning in Transformers