Rotate the Coordinates and EWC's Penalty Loses 84.8% of Its Value. The Function Never Changed.
This story is from 2026-08-31. It is preserved in the archive; the latest stories are on the live feed.
Train a network on task A, then on task B. It does not degrade on A — it becomes task B: after 300 steps it scores 1.1139 on the old task and task B's own teacher scores 1.1180 on it. See it: https://dev48.infy.uk/dl/day77-catastrophic-forgetting-and-ewc.html Elastic weight consolidation prices the…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-08-31 21:20 · DEV Community — Machine Learning
Rotate the Coordinates and EWC's Penalty Loses 84.8% of Its Value. The Function Never Changed.