Study Examines Layerwise Learning-Rate Scaling in Vision Networks
A new arXiv paper proposes methods to identify effective learning rates in layerwise scaling for vision networks, using power-mean aggregation and analyzing dependence on training budget.
Read the full story at arXiv cs.LG ↗