Adaptively Preconditioned Stochastic Gradient Langevin Dynamics

v1v2 (latest)

Adaptively Preconditioned Stochastic Gradient Langevin Dynamics

10 June 2019

ArXiv (abs)PDF HTML

Papers citing "Adaptively Preconditioned Stochastic Gradient Langevin Dynamics"

15 / 15 papers shown

Title
On the Convergence of Adam and Beyond Sashank J. Reddi Satyen Kale Surinder Kumar 106 2,505 0 19 Apr 2019
Adaptive Gradient Methods with Dynamic Bound of Learning Rate Liangchen Luo Yuanhao Xiong Yan Liu Xu Sun ODL 80 602 0 26 Feb 2019
Scalable Natural Gradient Langevin Dynamics in Practice Henri Palacci H. Hess BDL 22 8 0 07 Jun 2018
Natural Langevin Dynamics for Neural Networks Gaétan Marceau-Caron Yann Ollivier BDL 68 30 0 04 Dec 2017
Natasha 2: Faster Non-Convex Optimization Than SGD Zeyuan Allen-Zhu ODL 79 246 0 29 Aug 2017
The Marginal Value of Adaptive Gradient Methods in Machine Learning Ashia Wilson Rebecca Roelofs Mitchell Stern Nathan Srebro Benjamin Recht ODL 71 1,032 0 23 May 2017
Stochastic Gradient Descent as Approximate Bayesian Inference Stephan Mandt Matthew D. Hoffman David M. Blei BDL 57 599 0 13 Apr 2017
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 786 36,881 0 25 Aug 2016
Preconditioned Stochastic Gradient Langevin Dynamics for Deep Neural Networks Chunyuan Li Changyou Chen David Carlson Lawrence Carin ODL BDL 91 327 0 23 Dec 2015
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,426 0 10 Dec 2015
Weight Uncertainty in Neural Networks Charles Blundell Julien Cornebise Koray Kavukcuoglu Daan Wierstra UQCV BDL 192 1,892 0 20 May 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.0K 150,312 0 22 Dec 2014
In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Nathan Srebro AI4CE 99 662 0 20 Dec 2014
Stochastic Gradient Hamiltonian Monte Carlo Tianqi Chen E. Fox Carlos Guestrin BDL 109 913 0 17 Feb 2014
Bayesian Posterior Sampling via Stochastic Gradient Fisher Scoring S. Ahn Anoop Korattikara Balan Max Welling 77 306 0 27 Jun 2012