Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball

14 June 2020

Papers citing "Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball"

3 / 3 papers shown

Title
Dual Averaging is Surprisingly Effective for Deep Learning Optimization Samy Jelassi Aaron Defazio 36 4 0 20 Oct 2020
Quickly Finding a Benign Region via Heavy Ball Momentum in Non-Convex Optimization Jun-Kun Wang Jacob D. Abernethy 11 7 0 04 Oct 2020
Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes Ohad Shamir Tong Zhang 104 572 0 08 Dec 2012