How much does an adapter forget?
Less than expected, and the honest story is why that answer took three extra checks to trust. Across a 3x3 grid of LoRA rank and training steps on Qwen2.5-3B-Instruct, general-task retention never once dropped below the unadapted baseline. Key takeaways The registered kill-gate for H1 (forgetting g…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-31 10:59 · DEV Community — Machine Learning
How much does an adapter forget?