Provable Convergence of Nesterov's Accelerated Gradient Method for Over-Parameterized Neural Networks

5 July 2021

Papers citing "Provable Convergence of Nesterov's Accelerated Gradient Method for Over-Parameterized Neural Networks"

5 / 5 papers shown

Title
Nesterov acceleration in benignly non-convex landscapes Kanan Gupta Stephan Wojtowytsch 42 2 0 10 Oct 2024
A qualitative difference between gradient flows of convex functions in finite- and infinite-dimensional Hilbert spaces Jonathan W. Siegel Stephan Wojtowytsch 21 3 0 26 Oct 2023
Provable Acceleration of Nesterov's Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks Xin Liu Wei Tao Wei Li Dazhi Zhan Jun Wang Zhisong Pan ODL 32 1 0 08 Aug 2022
Quasi-hyperbolic momentum and Adam for deep learning Jerry Ma Denis Yarats ODL 84 129 0 16 Oct 2018
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights Weijie Su Stephen P. Boyd Emmanuel J. Candes 108 1,157 0 04 Mar 2015