Early learning in large residual networks
arXiv:2610.31783v1 Announce Type: new Abstract: We study the early training dynamics of nonlinear residual networks with blocks of zero hidden layers as a model of more general residual networks. We analyze networks in a sequential limit where first width and depth diverge, then the number of train…
Read the full story at arXiv stat.ML ↗
Timeline · 1 report
- 2026-10-26 04:00 · arXiv stat.ML
Early learning in large residual networks