Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball

14 June 2020

Papers citing "Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball"

4 / 4 papers shown

Title
Asymptotic study of stochastic adaptive algorithm in non-convex landscape S. Gadat Ioana Gavra 14 18 0 10 Dec 2020
Dual Averaging is Surprisingly Effective for Deep Learning Optimization Samy Jelassi Aaron Defazio 36 4 0 20 Oct 2020
Quickly Finding a Benign Region via Heavy Ball Momentum in Non-Convex Optimization Jun-Kun Wang Jacob D. Abernethy 16 7 0 04 Oct 2020
Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes Ohad Shamir Tong Zhang 104 572 0 08 Dec 2012