Regularizing RNNs by Stabilizing Activations

26 November 2015

Papers citing "Regularizing RNNs by Stabilizing Activations"

17 / 17 papers shown

Title
Oja's plasticity rule overcomes several challenges of training neural networks under biological constraints Navid Shervani-Tabar Marzieh Alireza Mirhoseini Robert Rosenbaum AAML AI4CE 45 0 0 15 Aug 2024
Sparsely Changing Latent States for Prediction and Planning in Partially Observable Domains Christian Gumbsch Martin Volker Butz Georg Martius AI4CE 26 21 0 29 Oct 2021
Recurrent Neural Network from Adder's Perspective: Carry-lookahead RNN Haowei Jiang Fei-wei Qin Jin Cao Yong Peng Yanli Shao LRM ODL 16 42 0 22 Jun 2021
Fast ES-RNN: A GPU Implementation of the ES-RNN Algorithm A. Redd Kaung Khin Aldo Marini AI4TS 18 12 0 07 Jul 2019
Data-dependent Sample Complexity of Deep Neural Networks via Lipschitz Augmentation Colin Wei Tengyu Ma 25 109 0 09 May 2019
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun DRL 42 4,724 0 04 Mar 2018
Recent Advances in Recurrent Neural Networks Hojjat Salehinejad Sharan Sankar Joseph Barfett E. Colak S. Valaee AI4TS 30 574 0 29 Dec 2017
Neural Language Modeling by Jointly Learning Syntax and Lexicon Songlin Yang Zhouhan Lin Chin-Wei Huang Aaron Courville 40 178 0 02 Nov 2017
Revisiting Activation Regularization for Language RNNs Stephen Merity Bryan McCann R. Socher 33 44 0 03 Aug 2017
On orthogonality and learning recurrent networks with long term dependencies Eugene Vorontsov C. Trabelsi Samuel Kadoury C. Pal ODL 36 238 0 31 Jan 2017
Hierarchical Multiscale Recurrent Neural Networks Junyoung Chung Sungjin Ahn Yoshua Bengio BDL 40 534 0 06 Sep 2016
Faster Training of Very Deep Networks Via p-Norm Gates Trang Pham T. Tran Dinh Q. Phung Svetha Venkatesh AI4CE 27 19 0 11 Aug 2016
Learning Unitary Operators with Help From u(n) Stephanie L. Hyland Gunnar Rätsch 97 41 0 17 Jul 2016
On Multiplicative Integration with Recurrent Neural Networks Yuhuai Wu Saizheng Zhang Wenjie Qu Yoshua Bengio Ruslan Salakhutdinov 34 154 0 21 Jun 2016
Path-Normalized Optimization of Recurrent Neural Networks with ReLU Activations Behnam Neyshabur Yuhuai Wu Ruslan Salakhutdinov Nathan Srebro AI4CE ODL 22 30 0 23 May 2016
Recurrent Batch Normalization Tim Cooijmans Nicolas Ballas César Laurent Çağlar Gülçehre Aaron Courville ODL 19 410 0 30 Mar 2016
Recurrent Orthogonal Networks and Long-Memory Tasks Mikael Henaff Arthur Szlam Yann LeCun 14 130 0 22 Feb 2016