What EWC buys you that flat L2 does not
This story is from 2026-10-28. It is preserved in the archive; the latest stories are on the live feed.
A flat L2 penalty can match EWC's exact Task A retention number on Permuted MNIST: 97.63% against 97.63%. It does this by collapsing Task B accuracy to 18%, against EWC's 97%. The same headline number hides two very different costs. Key takeaways A registered gate asked whether flat, uniform L2 reg…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-28 06:52 · DEV Community — Machine Learning
What EWC buys you that flat L2 does not