Statistical Adaptive Stochastic Gradient Methods

Statistical Adaptive Stochastic Gradient Methods

25 February 2020

Pengchuan Zhang

Papers citing "Statistical Adaptive Stochastic Gradient Methods"

12 / 12 papers shown

Title
Understanding the Role of Momentum in Stochastic Gradient Methods Igor Gitman Hunter Lang Pengchuan Zhang Lin Xiao 43 94 0 30 Oct 2019
Using Statistics to Automate Stochastic Optimization Hunter Lang Pengchuan Zhang Lin Xiao 35 22 0 21 Sep 2019
Painless Stochastic Gradient: Interpolation, Line-Search, and Convergence Rates Sharan Vaswani Aaron Mishkin I. Laradji Mark Schmidt Gauthier Gidel Simon Lacoste-Julien ODL 70 207 0 24 May 2019
Quasi-hyperbolic momentum and Adam for deep learning Jerry Ma Denis Yarats ODL 110 129 0 16 Oct 2018
Fluctuation-dissipation relations for stochastic gradient descent Sho Yaida 59 75 0 28 Sep 2018
On the insufficiency of existing momentum schemes for Stochastic Optimization Rahul Kidambi Praneeth Netrapalli Prateek Jain Sham Kakade ODL 63 118 0 15 Mar 2018
The Marginal Value of Adaptive Gradient Methods in Machine Learning Ashia Wilson Rebecca Roelofs Mitchell Stern Nathan Srebro Benjamin Recht ODL 48 1,023 0 23 May 2017
Online Learning Rate Adaptation with Hypergradient Descent A. G. Baydin R. Cornish David Martínez-Rubio Mark Schmidt Frank Wood ODL 46 245 0 14 Mar 2017
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 152 2,783 0 26 Sep 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 736 149,474 0 22 Dec 2014
Minimizing Finite Sums with the Stochastic Average Gradient Mark Schmidt Nicolas Le Roux Francis R. Bach 241 1,245 0 10 Sep 2013
Batch means and spectral variance estimators in Markov chain Monte Carlo James M. Flegal Galin L. Jones 60 255 0 11 Nov 2008