Recurrent Orthogonal Networks and Long-Memory Tasks

22 February 2016

Papers citing "Recurrent Orthogonal Networks and Long-Memory Tasks"

12 / 12 papers shown

Title
On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learning Alvaro Arroyo Alessio Gravina Benjamin Gutteridge Federico Barbero Claudio Gallicchio Xiaowen Dong Michael M. Bronstein P. Vandergheynst 119 11 0 15 Feb 2025
Oja's plasticity rule overcomes several challenges of training neural networks under biological constraints Navid Shervani-Tabar Marzieh Alireza Mirhoseini Robert Rosenbaum AAML AI4CE 104 0 0 15 Aug 2024
Regularizing RNNs by Stabilizing Activations David M. Krueger Roland Memisevic 71 80 0 26 Nov 2015
Unitary Evolution Recurrent Neural Networks Martín Arjovsky Amar Shah Yoshua Bengio ODL 75 770 0 20 Nov 2015
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units Quoc V. Le Navdeep Jaitly Geoffrey E. Hinton ODL 86 720 0 03 Apr 2015
Learning Longer Memory in Recurrent Neural Networks Tomas Mikolov Armand Joulin S. Chopra Michaël Mathieu MarcÁurelio Ranzato 92 259 0 24 Dec 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 437 20,568 0 10 Sep 2014
Recurrent Neural Network Regularization Wojciech Zaremba Ilya Sutskever Oriol Vinyals ODL 137 2,776 0 08 Sep 2014
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 173 1,845 0 20 Dec 2013
Generating Sequences With Recurrent Neural Networks Alex Graves GAN 155 4,034 0 04 Aug 2013
Speech Recognition with Deep Recurrent Neural Networks Alex Graves Abdel-rahman Mohamed Geoffrey E. Hinton 226 8,517 0 22 Mar 2013
On the difficulty of training Recurrent Neural Networks Razvan Pascanu Tomas Mikolov Yoshua Bengio ODL 196 5,346 0 21 Nov 2012