Statistical Adaptive Stochastic Gradient Methods

Statistical Adaptive Stochastic Gradient Methods

25 February 2020

Pengchuan Zhang

Papers citing "Statistical Adaptive Stochastic Gradient Methods"

12 / 12 papers shown

Title
Understanding the Role of Momentum in Stochastic Gradient Methods Igor Gitman Hunter Lang Pengchuan Zhang Lin Xiao 38 94 0 30 Oct 2019
Using Statistics to Automate Stochastic Optimization Hunter Lang Pengchuan Zhang Lin Xiao 31 22 0 21 Sep 2019
Painless Stochastic Gradient: Interpolation, Line-Search, and Convergence Rates Sharan Vaswani Aaron Mishkin I. Laradji Mark Schmidt Gauthier Gidel Simon Lacoste-Julien ODL 65 207 0 24 May 2019
Quasi-hyperbolic momentum and Adam for deep learning Jerry Ma Denis Yarats ODL 110 129 0 16 Oct 2018
Fluctuation-dissipation relations for stochastic gradient descent Sho Yaida 50 75 0 28 Sep 2018
On the insufficiency of existing momentum schemes for Stochastic Optimization Rahul Kidambi Praneeth Netrapalli Prateek Jain Sham Kakade ODL 60 118 0 15 Mar 2018
The Marginal Value of Adaptive Gradient Methods in Machine Learning Ashia Wilson Rebecca Roelofs Mitchell Stern Nathan Srebro Benjamin Recht ODL 41 1,023 0 23 May 2017
Online Learning Rate Adaptation with Hypergradient Descent A. G. Baydin R. Cornish David Martínez-Rubio Mark Schmidt Frank Wood ODL 44 245 0 14 Mar 2017
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 130 2,783 0 26 Sep 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 535 149,474 0 22 Dec 2014
Minimizing Finite Sums with the Stochastic Average Gradient Mark Schmidt Nicolas Le Roux Francis R. Bach 221 1,245 0 10 Sep 2013
Batch means and spectral variance estimators in Markov chain Monte Carlo James M. Flegal Galin L. Jones 56 255 0 11 Nov 2008

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.