v1v2v3 (latest)

Gated Orthogonal Recurrent Units: On Learning to Forget

8 June 2017

Papers citing "Gated Orthogonal Recurrent Units: On Learning to Forget"

21 / 21 papers shown

Title
Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNs Li Jing Yichen Shen T. Dubček J. Peurifoy S. Skirlo Yann LeCun Max Tegmark Marin Soljacic 71 178 0 15 Dec 2016
Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflections Zakaria Mhammedi Andrew D. Hellicar Ashfaqur Rahman James Bailey 89 129 0 01 Dec 2016
Input Switched Affine Networks: An RNN Architecture Designed for Interpretability Jakob N. Foerster Justin Gilmer J. Chorowski Jascha Narain Sohl-Dickstein David Sussillo 66 7 0 28 Nov 2016
Full-Capacity Unitary Recurrent Neural Networks Scott Wisdom Thomas Powers J. Hershey Jonathan Le Roux L. Atlas 64 293 0 31 Oct 2016
Learning Unitary Operators with Help From u(n) Stephanie L. Hyland Gunnar Rätsch 138 42 0 17 Jul 2016
Recurrent Batch Normalization Tim Cooijmans Nicolas Ballas César Laurent Çağlar Gülçehre Aaron Courville ODL 53 410 0 30 Mar 2016
Recurrent Orthogonal Networks and Long-Memory Tasks Mikael Henaff Arthur Szlam Yann LeCun 67 133 0 22 Feb 2016
Associative Long Short-Term Memory Ivo Danihelka Greg Wayne Benigno Uria Nal Kalchbrenner Alex Graves 66 178 0 09 Feb 2016
Unitary Evolution Recurrent Neural Networks Martín Arjovsky Amar Shah Yoshua Bengio ODL 75 771 0 20 Nov 2015
Gated Graph Sequence Neural Networks Yujia Li Daniel Tarlow Marc Brockschmidt R. Zemel GNN 347 3,285 0 17 Nov 2015
Listen, Attend and Spell William Chan Navdeep Jaitly Quoc V. Le Oriol Vinyals RALM 156 2,269 0 05 Aug 2015
Attention-Based Models for Speech Recognition J. Chorowski Dzmitry Bahdanau Dmitriy Serdyuk Kyunghyun Cho Yoshua Bengio 129 2,609 0 24 Jun 2015
Visualizing and Understanding Recurrent Networks A. Karpathy Justin Johnson Li Fei-Fei HAI 126 1,101 0 05 Jun 2015
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units Quoc V. Le Navdeep Jaitly Geoffrey E. Hinton ODL 88 721 0 03 Apr 2015
Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks Jason Weston Antoine Bordes S. Chopra Alexander M. Rush Bart van Merriënboer Armand Joulin Tomas Mikolov LRM ELM 150 1,181 0 19 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.0K 150,260 0 22 Dec 2014
Neural Turing Machines Alex Graves Greg Wayne Ivo Danihelka 103 2,330 0 20 Oct 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 437 20,584 0 10 Sep 2014
On the Properties of Neural Machine Translation: Encoder-Decoder Approaches Kyunghyun Cho B. V. Merrienboer Dzmitry Bahdanau Yoshua Bengio AI4CE AIMat 254 6,784 0 03 Sep 2014
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho B. V. Merrienboer Çağlar Gülçehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk Yoshua Bengio AIMat 1.1K 23,370 0 03 Jun 2014
On the difficulty of training Recurrent Neural Networks Razvan Pascanu Tomas Mikolov Yoshua Bengio ODL 198 5,360 0 21 Nov 2012