Stochastic Heavy Ball

14 September 2016

Papers citing "Stochastic Heavy Ball"

17 / 17 papers shown

Title
Almost sure convergence rates of stochastic gradient methods under gradient domination Simon Weissmann Sara Klein Waïss Azizian Leif Döring 39 3 0 22 May 2024
Central Limit Theorem for Two-Timescale Stochastic Approximation with Markovian Noise: Theory and Applications Jie Hu Vishwaraj Doshi Do Young Eun 36 4 0 17 Jan 2024
Stochastic Ratios Tracking Algorithm for Large Scale Machine Learning Problems Shigeng Sun Yuchen Xie 18 3 0 17 May 2023
Stability and Convergence of Distributed Stochastic Approximations with large Unbounded Stochastic Information Delays Adrian Redder Arunselvan Ramaswamy Holger Karl 20 1 0 11 May 2023
On the fast convergence of minibatch heavy ball momentum Raghu Bollapragada Tyler Chen Rachel A. Ward 26 17 0 15 Jun 2022
On Almost Sure Convergence Rates of Stochastic Gradient Methods Jun Liu Ye Yuan 21 36 0 09 Feb 2022
A Statistical Analysis of Polyak-Ruppert Averaged Q-learning Xiang Li Wenhao Yang Jiadong Liang Zhihua Zhang Michael I. Jordan 40 15 0 29 Dec 2021
Gradient Temporal Difference with Momentum: Stability and Convergence Rohan Deb S. Bhatnagar 16 5 0 22 Nov 2021
Improving Adversarial Robustness for Free with Snapshot Ensemble Yihao Wang AAML UQCV 17 1 0 07 Oct 2021
A Dynamical View on Optimization Algorithms of Overparameterized Neural Networks Zhiqi Bu Shiyun Xu Kan Chen 25 17 0 25 Oct 2020
A High Probability Analysis of Adaptive SGD with Momentum Xiaoyun Li Francesco Orabona 92 65 0 28 Jul 2020
Understanding the Role of Momentum in Stochastic Gradient Methods Igor Gitman Hunter Lang Pengchuan Zhang Lin Xiao 25 94 0 30 Oct 2019
Continuous Time Analysis of Momentum Methods Nikola B. Kovachki Andrew M. Stuart 17 32 0 10 Jun 2019
Optimal Matrix Momentum Stochastic Approximation and Applications to Q-learning Adithya M. Devraj Ana Bušić Sean P. Meyn 14 4 0 17 Sep 2018
On the Generalization of Stochastic Gradient Descent with Momentum Ali Ramezani-Kebrya Kimon Antonakopoulos V. Cevher Ashish Khisti Ben Liang MLT 14 23 0 12 Sep 2018
Momentum and Stochastic Momentum for Stochastic Gradient, Newton, Proximal Point and Subspace Descent Methods Nicolas Loizou Peter Richtárik 19 199 0 27 Dec 2017
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights Weijie Su Stephen P. Boyd Emmanuel J. Candes 108 1,154 0 04 Mar 2015