A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights

4 March 2015

Weijie Su

Emmanuel J. Candes

Papers citing "A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights"

34 / 84 papers shown

Title
Projection Neural Network for a Class of Sparse Regression Problems with Cardinality Penalty Wenjing Li Wei Bian 6 10 0 02 Apr 2020
Stochastic Modified Equations for Continuous Limit of Stochastic ADMM Xiang Zhou Huizhuo Yuan C. J. Li Qingyun Sun 28 6 0 07 Mar 2020
On the Convergence of Nesterov's Accelerated Gradient Method in Stochastic Settings Mahmoud Assran Michael G. Rabbat 8 59 0 27 Feb 2020
A Newton Frank-Wolfe Method for Constrained Self-Concordant Minimization Deyi Liu V. Cevher Quoc Tran-Dinh 31 15 0 17 Feb 2020
On the Effectiveness of Richardson Extrapolation in Machine Learning Francis R. Bach 13 9 0 07 Feb 2020
From Nesterov's Estimate Sequence to Riemannian Acceleration Kwangjun Ahn S. Sra 14 72 0 24 Jan 2020
A Survey of Deep Learning Applications to Autonomous Vehicle Control Sampo Kuutti Richard Bowden Yaochu Jin P. Barber Saber Fallah 30 506 0 23 Dec 2019
Shadowing Properties of Optimization Algorithms Antonio Orvieto Aurelien Lucchi 27 18 0 12 Nov 2019
Machine Intelligence at the Edge with Learning Centric Power Allocation Shuai Wang Yik-Chung Wu Minghua Xia Rui-cang Wang H. Vincent Poor 27 66 0 12 Nov 2019
Partial differential equation regularization for supervised machine learning Jillian R. Fisher 24 2 0 03 Oct 2019
A Review on Deep Learning in Medical Image Reconstruction Hai-Miao Zhang Bin Dong MedIm 32 122 0 23 Jun 2019
Continuous Time Analysis of Momentum Methods Nikola B. Kovachki Andrew M. Stuart 13 31 0 10 Jun 2019
ODE Analysis of Stochastic Gradient Methods with Optimism and Anchoring for Minimax Problems Ernest K. Ryu Kun Yuan W. Yin 20 36 0 26 May 2019
Accelerated Flow for Probability Distributions Amirhossein Taghvaei P. Mehta 37 30 0 10 Jan 2019
Understanding the Acceleration Phenomenon via High-Resolution Differential Equations Bin Shi S. Du Michael I. Jordan Weijie J. Su 17 251 0 21 Oct 2018
Continuous-time Models for Stochastic Optimization Algorithms Antonio Orvieto Aurelien Lucchi 11 31 0 05 Oct 2018
On the Generalization of Stochastic Gradient Descent with Momentum Ali Ramezani-Kebrya Kimon Antonakopoulos V. Cevher Ashish Khisti Ben Liang MLT 14 23 0 12 Sep 2018
Online Adaptive Methods, Universality and Acceleration Kfir Y. Levy A. Yurtsever V. Cevher ODL 22 88 0 08 Sep 2018
Diffusion Approximations for Online Principal Component Estimation and Global Convergence C. J. Li Mengdi Wang Han Liu Tong Zhang 26 12 0 29 Aug 2018
Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Tasks Nikola B. Kovachki Andrew M. Stuart BDL 42 136 0 10 Aug 2018
Direct Runge-Kutta Discretization Achieves Acceleration Junzhe Zhang Aryan Mokhtari S. Sra Ali Jadbabaie 11 107 0 01 May 2018
Accelerated Gradient Boosting Gérard Biau B. Cadre L. Rouviere 16 108 0 06 Mar 2018
On Symplectic Optimization M. Betancourt Michael I. Jordan Ashia C. Wilson 14 90 0 10 Feb 2018
Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descent Chi Jin Praneeth Netrapalli Michael I. Jordan ODL 29 261 0 28 Nov 2017
Underdamped Langevin MCMC: A non-asymptotic analysis Xiang Cheng Niladri S. Chatterji Peter L. Bartlett Michael I. Jordan 36 293 0 12 Jul 2017
Stochastic Methods for Composite and Weakly Convex Optimization Problems John C. Duchi Feng Ruan 15 126 0 24 Mar 2017
Geometric descent method for convex composite minimization Shixiang Chen Shiqian Ma Wei Liu 28 10 0 29 Dec 2016
Stochastic Heavy Ball S. Gadat Fabien Panloup Sofiane Saadane 10 103 0 14 Sep 2016
Tradeoffs between Convergence Speed and Reconstruction Accuracy in Inverse Problems Raja Giryes Yonina C. Eldar A. Bronstein Guillermo Sapiro 17 85 0 30 May 2016
On the Powerball Method for Optimization Ye Yuan Mu Li Jun Liu Claire Tomlin 11 20 0 24 Mar 2016
A Variational Perspective on Accelerated Methods in Optimization Andre Wibisono Ashia C. Wilson Michael I. Jordan 23 566 0 14 Mar 2016
Local and Global Convergence of a General Inertial Proximal Splitting Scheme Patrick R. Johnstone P. Moulin 12 18 0 08 Feb 2016
Even Faster Accelerated Coordinate Descent Using Non-Uniform Sampling Zeyuan Allen-Zhu Zheng Qu Peter Richtárik Yang Yuan 38 172 0 30 Dec 2015
Stochastic modified equations and adaptive stochastic gradient algorithms Qianxiao Li Cheng Tai E. Weinan 21 279 0 19 Nov 2015