Scaling and Renormalization in Neural Networks: An Effective Renormalization-Group Description of Grokking
arXiv:2610.36113v1 Announce Type: new Abstract: Grokking is a delayed transition from memorization to generalization in deep neural networks (NNs). We examine whether scaling and renormalization group (RG) theories can describe this dynamics, establishing a quantitative physical framework for neura…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-28 04:00 · arXiv cs.LG
Scaling and Renormalization in Neural Networks: An Effective Renormalization-Group Description of Grokking