Why Clipping Matters in AdaGrad? Toward a High-Probability Theory under Generalized Smoothness
arXiv:2609.30276v1 Announce Type: new Abstract: We analyze the original same-step coordinate-wise AdaGrad under generalized smoothness and heavy-tailed noise with bounded variance. In this setting, local curvature may grow sub-quadratically with the gradient norm, and stochastic gradients are assum…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-09-28 04:00 · arXiv cs.LG
Why Clipping Matters in AdaGrad? Toward a High-Probability Theory under Generalized Smoothness