Linearly convergent stochastic heavy ball method for minimizing generalization error

30 October 2017

Papers citing "Linearly convergent stochastic heavy ball method for minimizing generalization error"

11 / 11 papers shown

Title
Acceleration of stochastic gradient descent with momentum by averaging: finite-sample rates and asymptotic normality Kejie Tang Weidong Liu Yichen Zhang Xi Chen 21 2 0 28 May 2023
On the fast convergence of minibatch heavy ball momentum Raghu Bollapragada Tyler Chen Rachel A. Ward 34 17 0 15 Jun 2022
Distributed Second Order Methods with Fast Rates and Compressed Communication Rustem Islamov Xun Qian Peter Richtárik 34 51 0 14 Feb 2021
Optimization for Supervised Machine Learning: Randomized Algorithms for Data and Parameters Filip Hanzely 39 0 0 26 Aug 2020
Taming Momentum in a Distributed Asynchronous Environment Ido Hakimi Saar Barkai Moshe Gabel Assaf Schuster 19 23 0 26 Jul 2019
Continuous Time Analysis of Momentum Methods Nikola B. Kovachki Andrew M. Stuart 23 33 0 10 Jun 2019
Painless Stochastic Gradient: Interpolation, Line-Search, and Convergence Rates Sharan Vaswani Aaron Mishkin I. Laradji Mark Schmidt Gauthier Gidel Simon Lacoste-Julien ODL 29 205 0 24 May 2019
Accelerated Linear Convergence of Stochastic Momentum Methods in Wasserstein Distances Bugra Can Mert Gurbuzbalaban Lingjiong Zhu 16 45 0 22 Jan 2019
SEGA: Variance Reduction via Gradient Sketching Filip Hanzely Konstantin Mishchenko Peter Richtárik 25 71 0 09 Sep 2018
On the insufficiency of existing momentum schemes for Stochastic Optimization Rahul Kidambi Praneeth Netrapalli Prateek Jain Sham Kakade ODL 32 117 0 15 Mar 2018
Momentum and Stochastic Momentum for Stochastic Gradient, Newton, Proximal Point and Subspace Descent Methods Nicolas Loizou Peter Richtárik 19 200 0 27 Dec 2017