Partitioned integrators for thermodynamic parameterization of neural
networks

v1v2 (latest)

Partitioned integrators for thermodynamic parameterization of neural networks

30 August 2019

Benedict Leimkuhler

Charles Matthews

Tiffany J. Vlaar

ArXiv (abs)PDF HTML

Papers citing "Partitioned integrators for thermodynamic parameterization of neural networks"

9 / 9 papers shown

Title
The promises and pitfalls of Stochastic Gradient Langevin Dynamics N. Brosse Alain Durmus Eric Moulines 74 78 0 25 Nov 2018
Three Factors Influencing Minima in SGD Stanislaw Jastrzebski Zachary Kenton Devansh Arpit Nicolas Ballas Asja Fischer Yoshua Bengio Amos Storkey 80 463 0 13 Nov 2017
The Marginal Value of Adaptive Gradient Methods in Machine Learning Ashia Wilson Rebecca Roelofs Mitchell Stern Nathan Srebro Benjamin Recht ODL 91 1,032 0 23 May 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 351 4,636 0 10 Nov 2016
Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithm Alain Durmus Eric Moulines 81 415 0 17 Jul 2015
Empirical Evaluation of Rectified Activations in Convolutional Network Bing Xu Naiyan Wang Tianqi Chen Mu Li 142 2,916 0 05 May 2015
In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Nathan Srebro AI4CE 106 663 0 20 Dec 2014
Qualitatively characterizing neural network optimization problems Ian Goodfellow Oriol Vinyals Andrew M. Saxe ODL 116 524 0 19 Dec 2014
ADADELTA: An Adaptive Learning Rate Method Matthew D. Zeiler ODL 165 6,635 0 22 Dec 2012