ResearchTrend.AI
Provable Convergence of Nesterov's Accelerated Gradient Method for Over-Parameterized Neural Networks

Provable Convergence of Nesterov's Accelerated Gradient Method for Over-Parameterized Neural Networks

Xin Liu
Zhisong Pan
Wei Tao
ArXivPDFHTML

Papers citing "Provable Convergence of Nesterov's Accelerated Gradient Method for Over-Parameterized Neural Networks"

5 / 5 papers shown
Title
Nesterov acceleration in benignly non-convex landscapes
Nesterov acceleration in benignly non-convex landscapes
Kanan Gupta
Stephan Wojtowytsch
42
2
0
10 Oct 2024
A qualitative difference between gradient flows of convex functions in finite- and infinite-dimensional Hilbert spaces
A qualitative difference between gradient flows of convex functions in finite- and infinite-dimensional Hilbert spaces
Jonathan W. Siegel
Stephan Wojtowytsch
21
3
0
26 Oct 2023
Provable Acceleration of Nesterov's Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks
Provable Acceleration of Nesterov's Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks
Xin Liu
Wei Tao
Wei Li
Dazhi Zhan
Jun Wang
Zhisong Pan
ODL
30
1
0
08 Aug 2022
Quasi-hyperbolic momentum and Adam for deep learning
Quasi-hyperbolic momentum and Adam for deep learning
Jerry Ma
Denis Yarats
ODL
84
129
0
16 Oct 2018
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
Weijie Su
Stephen P. Boyd
Emmanuel J. Candes
108
1,157
0
04 Mar 2015