On the Influence of Momentum Acceleration on Online Learning

14 March 2016

Papers citing "On the Influence of Momentum Acceleration on Online Learning"

7 / 7 papers shown

Title
Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum H. Cai Sulaiman A. Alghunaim Ali H.Sayed 43 1 0 18 Jun 2024
Tradeoffs between convergence rate and noise amplification for momentum-based accelerated optimization algorithms Hesameddin Mohammadi Meisam Razaviyayn Mihailo R. Jovanović 18 7 0 24 Sep 2022
Incorporating the Barzilai-Borwein Adaptive Step Size into Sugradient Methods for Deep Network Training A. Robles-Kelly A. Nazari ODL 32 3 0 27 May 2022
Nesterov Accelerated Shuffling Gradient Method for Convex Optimization Trang H. Tran K. Scheinberg Lam M. Nguyen 40 11 0 07 Feb 2022
Does Momentum Help? A Sample Complexity Analysis Swetha Ganesh Rohan Deb Gugan Thoppe A. Budhiraja 16 2 0 29 Oct 2021
Training Deep Neural Networks with Adaptive Momentum Inspired by the Quadratic Optimization Tao Sun Huaming Ling Zuoqiang Shi Dongsheng Li Bao Wang ODL 22 13 0 18 Oct 2021
Demon: Improved Neural Network Training with Momentum Decay John Chen Cameron R. Wolfe Zhaoqi Li Anastasios Kyrillidis ODL 24 15 0 11 Oct 2019