Silent Alignment in Two-Layer Linear Networks: A High-Dimensional Perspective
arXiv:2610.29864v1 Announce Type: new Abstract: We study gradient flow in a two-layer linear network in the high-dimensional regime where the input, inner and output dimensions diverge proportionally. Under whitened inputs and isotropic imbalance, we combine a closed-form solution of the dynamics w…
Read the full story at arXiv stat.ML ↗
Timeline · 1 report
- 2026-10-22 04:00 · arXiv stat.ML
Silent Alignment in Two-Layer Linear Networks: A High-Dimensional Perspective