Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2212.07295
Cited By
Maximal Initial Learning Rates in Deep ReLU Networks
14 December 2022
Gaurav M. Iyer
Boris Hanin
David Rolnick
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Maximal Initial Learning Rates in Deep ReLU Networks"
4 / 4 papers shown
Title
Catapult Dynamics and Phase Transitions in Quadratic Nets
David Meltzer
Junyu Liu
27
9
0
18 Jan 2023
Understanding Gradient Descent on Edge of Stability in Deep Learning
Sanjeev Arora
Zhiyuan Li
A. Panigrahi
MLT
80
89
0
19 May 2022
Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect
Yuqing Wang
Minshuo Chen
T. Zhao
Molei Tao
AI4CE
57
40
0
07 Oct 2021
The large learning rate phase of deep learning: the catapult mechanism
Aitor Lewkowycz
Yasaman Bahri
Ethan Dyer
Jascha Narain Sohl-Dickstein
Guy Gur-Ari
ODL
159
234
0
04 Mar 2020
1