Training neural networks using Metropolis Monte Carlo and an adaptive
variant

v1v2 (latest)

Training neural networks using Metropolis Monte Carlo and an adaptive variant

16 May 2022

ArXiv (abs)PDF HTML

Papers citing "Training neural networks using Metropolis Monte Carlo and an adaptive variant"

17 / 17 papers shown

Title
Gradients are Not All You Need Luke Metz C. Freeman S. Schoenholz Tal Kachman 87 93 0 10 Nov 2021
Correspondence between neuroevolution and gradient descent S. Whitelam V. Selin Sang-Won Park Isaac Tamblyn 43 20 0 15 Aug 2020
RSO: A Gradient Free Sampling Based Approach For Training Deep Neural Networks Rohun Tripathi Bharat Singh 38 6 0 12 May 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 568 42,677 0 03 Dec 2019
Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks Jinghui Chen Dongruo Zhou Yiqi Tang Ziyan Yang Yuan Cao Quanquan Gu ODL 101 193 0 18 Jun 2018
Evolution Strategies as a Scalable Alternative to Reinforcement Learning Tim Salimans Jonathan Ho Xi Chen Szymon Sidor Ilya Sutskever 122 1,544 0 10 Mar 2017
Capacity and Trainability in Recurrent Neural Networks Jasmine Collins Jascha Narain Sohl-Dickstein David Sussillo 109 205 0 29 Nov 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 435 10,541 0 21 Jul 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.3K 194,641 0 10 Dec 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.1K 150,433 0 22 Dec 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 450 20,606 0 10 Sep 2014
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization Yann N. Dauphin Razvan Pascanu Çağlar Gülçehre Kyunghyun Cho Surya Ganguli Yoshua Bengio ODL 134 1,394 0 10 Jun 2014
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho B. V. Merrienboer Çağlar Gülçehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk Yoshua Bengio AIMat 1.1K 23,414 0 03 Jun 2014
Deep Learning in Neural Networks: An Overview Jürgen Schmidhuber HAI 250 16,405 0 30 Apr 2014
Speech Recognition with Deep Recurrent Neural Networks Alex Graves Abdel-rahman Mohamed Geoffrey E. Hinton 230 8,529 0 22 Mar 2013
Advances in Optimizing Recurrent Networks Yoshua Bengio Nicolas Boulanger-Lewandowski Razvan Pascanu ODL 109 523 0 04 Dec 2012
On the difficulty of training Recurrent Neural Networks Razvan Pascanu Tomas Mikolov Yoshua Bengio ODL 209 5,361 0 21 Nov 2012

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.