Decoupled Neural Interfaces using Synthetic Gradients

v1v2 (latest)

Decoupled Neural Interfaces using Synthetic Gradients

18 August 2016

Wojciech M. Czarnecki

David Silver

Koray Kavukcuoglu

ArXiv (abs)PDF HTML

Papers citing "Decoupled Neural Interfaces using Synthetic Gradients"

12 / 212 papers shown

Title
Sparse Attentive Backtracking: Long-Range Credit Assignment in Recurrent Networks Nan Rosemary Ke Anirudh Goyal O. Bilaniuk Jonathan Binas Laurent Charlin C. Pal Yoshua Bengio 78 15 0 07 Nov 2017
Maximum Principle Based Algorithms for Deep Learning Qianxiao Li Long Chen Cheng Tai E. Weinan 131 224 0 26 Oct 2017
Training Spiking Neural Networks for Cognitive Tasks: A Versatile Framework Compatible to Various Temporal Codes Chaofei Hong 24 0 0 02 Sep 2017
The Reversible Residual Network: Backpropagation Without Storing Activations Aidan Gomez Mengye Ren R. Urtasun Roger C. Grosse 89 553 0 14 Jul 2017
Sobolev Training for Neural Networks Wojciech M. Czarnecki Simon Osindero Max Jaderberg G. Swirszcz Razvan Pascanu 93 248 0 15 Jun 2017
AMPNet: Asynchronous Model-Parallel Training for Dynamic Neural Networks Alexander L. Gaunt Matthew W. Johnson M. Riechert Daniel Tarlow Ryota Tomioka Dimitrios Vytiniotis Sam Webster BDL 75 32 0 27 May 2017
Introspection: Accelerating Neural Network Training By Learning Weight Evolution Abhishek Sinha Mausoom Sarkar Aahitagni Mukherjee Balaji Krishnamurthy ODL 46 20 0 17 Apr 2017
Understanding Synthetic Gradients and Decoupled Neural Interfaces Wojciech M. Czarnecki G. Swirszcz Max Jaderberg Simon Osindero Oriol Vinyals Koray Kavukcuoglu 92 82 0 01 Mar 2017
Unbiased Online Recurrent Optimization Corentin Tallec Yann Ollivier 98 100 0 16 Feb 2017
Long Timescale Credit Assignment in NeuralNetworks with External Memory Steven Hansen 23 0 0 14 Jan 2017
Neuromorphic Deep Learning Machines Emre Neftci C. Augustine Somnath Paul Georgios Detorakis BDL 220 260 0 16 Dec 2016
HyperNetworks David R Ha Andrew M. Dai Quoc V. Le 182 1,637 0 27 Sep 2016