Accelerated Linear Convergence of Stochastic Momentum Methods in Wasserstein Distances

22 January 2019

Papers citing "Accelerated Linear Convergence of Stochastic Momentum Methods in Wasserstein Distances"

15 / 15 papers shown

Title
Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks Hristo Papazov Scott Pesme Nicolas Flammarion 38 5 0 08 Mar 2024
Uniform-in-Time Wasserstein Stability Bounds for (Noisy) Stochastic Gradient Descent Lingjiong Zhu Mert Gurbuzbalaban Anant Raj Umut Simsekli 34 6 0 20 May 2023
Tradeoffs between convergence rate and noise amplification for momentum-based accelerated optimization algorithms Hesameddin Mohammadi Meisam Razaviyayn Mihailo R. Jovanović 34 7 0 24 Sep 2022
Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Łojasiewicz Functions when the Non-Convexity is Averaged-Out Jun-Kun Wang Chi-Heng Lin Andre Wibisono Bin Hu 35 20 0 22 Jun 2022
On the fast convergence of minibatch heavy ball momentum Raghu Bollapragada Tyler Chen Rachel A. Ward 32 17 0 15 Jun 2022
Does Momentum Help? A Sample Complexity Analysis Swetha Ganesh Rohan Deb Gugan Thoppe A. Budhiraja 21 2 0 29 Oct 2021
Quickly Finding a Benign Region via Heavy Ball Momentum in Non-Convex Optimization Jun-Kun Wang Jacob D. Abernethy 11 7 0 04 Oct 2020
Online Algorithms for Estimating Change Rates of Web Pages Konstantin Avrachenkov Kishor P. Patil Gugan Thoppe 6 16 0 17 Sep 2020
Differentially Private Accelerated Optimization Algorithms Nurdan Kuru cS. .Ilker Birbil Mert Gurbuzbalaban S. Yıldırım 25 23 0 05 Aug 2020
Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball Othmane Sebbouh Robert Mansel Gower Aaron Defazio 11 22 0 14 Jun 2020
On the Convergence of Nesterov's Accelerated Gradient Method in Stochastic Settings Mahmoud Assran Michael G. Rabbat 14 59 0 27 Feb 2020
Robust Distributed Accelerated Stochastic Gradient Methods for Multi-Agent Networks Alireza Fallah Mert Gurbuzbalaban Asuman Ozdaglar Umut Simsekli Lingjiong Zhu 32 28 0 19 Oct 2019
On the Generalization of Stochastic Gradient Descent with Momentum Ali Ramezani-Kebrya Kimon Antonakopoulos V. Cevher Ashish Khisti Ben Liang MLT 14 23 0 12 Sep 2018
Momentum and Stochastic Momentum for Stochastic Gradient, Newton, Proximal Point and Subspace Descent Methods Nicolas Loizou Peter Richtárik 19 200 0 27 Dec 2017
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights Weijie Su Stephen P. Boyd Emmanuel J. Candes 108 1,157 0 04 Mar 2015