Continuized Acceleration for Quasar Convex Functions in Non-Convex Optimization

15 February 2023

Papers citing "Continuized Acceleration for Quasar Convex Functions in Non-Convex Optimization"

15 / 15 papers shown

Title
Averaging on the Bures-Wasserstein manifold: dimension-free convergence of gradient descent Jason M. Altschuler Sinho Chewi P. Gerber Austin J. Stromme 72 36 0 16 Jun 2021
Non-asymptotic convergence bounds for Wasserstein approximation using point clouds Q. Mérigot F. Santambrogio Clément Sarrazin 36 28 0 15 Jun 2021
A Continuized View on Nesterov Acceleration for Stochastic Gradient Descent and Randomized Gossip Mathieu Even Raphael Berthier Francis R. Bach Nicolas Flammarion Pierre Gaillard Hadrien Hendrikx Laurent Massoulié Adrien B. Taylor 104 20 0 10 Jun 2021
The Two Regimes of Deep Network Training Guillaume Leclerc Aleksander Madry 66 45 0 24 Feb 2020
Learning a Single Neuron with Gradient Methods Gilad Yehudai Ohad Shamir MLT 56 63 0 15 Jan 2020
Momentum-Based Variance Reduction in Non-Convex SGD Ashok Cutkosky Francesco Orabona ODL 84 407 0 24 May 2019
Understanding the Acceleration Phenomenon via High-Resolution Differential Equations Bin Shi S. Du Michael I. Jordan Weijie J. Su 58 259 0 21 Oct 2018
Fast and Faster Convergence of SGD for Over-Parameterized Models and an Accelerated Perceptron Sharan Vaswani Francis R. Bach Mark Schmidt 80 298 0 16 Oct 2018
Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview Yuejie Chi Yue M. Lu Yuxin Chen 65 426 0 25 Sep 2018
The Marginal Value of Adaptive Gradient Methods in Machine Learning Ashia Wilson Rebecca Roelofs Mitchell Stern Nathan Srebro Benjamin Recht ODL 65 1,030 0 23 May 2017
Gradient Descent Learns Linear Dynamical Systems Moritz Hardt Tengyu Ma Benjamin Recht 105 240 0 16 Sep 2016
The local convexity of solving systems of quadratic equations Christopher D. White Sujay Sanghavi Rachel A. Ward 57 72 0 25 Jun 2015
On Graduated Optimization for Stochastic Non-Convex Problems Elad Hazan Kfir Y. Levy Shai Shalev-Shwartz 72 117 0 12 Mar 2015
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights Weijie Su Stephen P. Boyd Emmanuel J. Candes 162 1,166 0 04 Mar 2015
Efficient Learning of Generalized Linear and Single Index Models with Isotonic Regression Sham Kakade Adam Tauman Kalai Varun Kanade Ohad Shamir 192 179 0 11 Apr 2011