A Simple Way to Initialize Recurrent Networks of Rectified Linear Units

3 April 2015

Papers citing "A Simple Way to Initialize Recurrent Networks of Rectified Linear Units"

25 / 125 papers shown

Title
Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification Jiacheng Xu Danlu Chen Xipeng Qiu Xuangjing Huang 26 155 0 17 Oct 2016
Efficient softmax approximation for GPUs Edouard Grave Armand Joulin Moustapha Cissé David Grangier Hervé Jégou 23 270 0 14 Sep 2016
RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanism Edward Choi M. T. Bahadori Joshua A. Kulas A. Schuetz Walter F. Stewart Jimeng Sun AI4TS 39 1,230 0 19 Aug 2016
Learning Unitary Operators with Help From u(n) Stephanie L. Hyland Gunnar Rätsch 97 41 0 17 Jul 2016
Recurrent Highway Networks J. Zilly R. Srivastava Jan Koutník Jürgen Schmidhuber 15 413 0 12 Jul 2016
Dynamic Neural Turing Machine with Soft and Hard Addressing Schemes Çağlar Gülçehre A. Chandar Kyunghyun Cho Yoshua Bengio 17 64 0 30 Jun 2016
Compression of Neural Machine Translation Models via Pruning A. See Minh-Thang Luong Christopher D. Manning MedIm VLM 21 221 0 29 Jun 2016
FractalNet: Ultra-Deep Neural Networks without Residuals Gustav Larsson Michael Maire Gregory Shakhnarovich 45 933 0 24 May 2016
Deep Gate Recurrent Neural Network Yuan Gao D. Głowacka 19 61 0 11 Apr 2016
Minimal Gated Unit for Recurrent Neural Networks Guoxiang Zhou Jianxin Wu Chen-Da Liu-Zhang Zhi-Hua Zhou 31 326 0 31 Mar 2016
Recurrent Batch Normalization Tim Cooijmans Nicolas Ballas César Laurent Çağlar Gülçehre Aaron Courville ODL 19 410 0 30 Mar 2016
"What happens if..." Learning to Predict the Effect of Forces in Images Roozbeh Mottaghi Mohammad Rastegari Abhinav Gupta Ali Farhadi OOD 31 123 0 17 Mar 2016
Recurrent Dropout without Memory Loss Stanislau Semeniuta Aliaksei Severyn Erhardt Barth 26 222 0 16 Mar 2016
Noisy Activation Functions Çağlar Gülçehre Marcin Moczulski Misha Denil Yoshua Bengio 9 283 0 01 Mar 2016
Recurrent Orthogonal Networks and Long-Memory Tasks Mikael Henaff Arthur Szlam Yann LeCun 14 130 0 22 Feb 2016
Strongly-Typed Recurrent Neural Networks David Balduzzi Muhammad Ghifary PINN 16 60 0 06 Feb 2016
Conversion of Artificial Recurrent Neural Networks to Spiking Neural Networks for Low-power Neuromorphic Hardware P. U. Diehl Guido Zarrella A. Cassidy Bruno U. Pedroni Emre Neftci 26 217 0 16 Jan 2016
DNA-Level Splice Junction Prediction using Deep Recurrent Neural Networks Byunghan Lee Taehoon Lee Byunggook Na Sungroh Yoon 21 43 0 16 Dec 2015
Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks Sean Bell C. L. Zitnick Kavita Bala Ross B. Girshick ObjD 41 1,205 0 14 Dec 2015
BlackOut: Speeding up Recurrent Neural Network Language Models With Very Large Vocabularies Shihao Ji S.V.N. Vishwanathan N. Satish Michael J. Anderson Pradeep Dubey 28 77 0 21 Nov 2015
Unitary Evolution Recurrent Neural Networks Martín Arjovsky Amar Shah Yoshua Bengio ODL 10 761 0 20 Nov 2015
Deeply-Recursive Convolutional Network for Image Super-Resolution Jiwon Kim Jung Kwon Lee Kyoung Mu Lee SupR 57 2,491 0 14 Nov 2015
Improving performance of recurrent neural network with relu nonlinearity S. Talathi Aniket A. Vartak ODL 29 88 0 12 Nov 2015
RATM: Recurrent Attentive Tracking Model Samira Ebrahimi Kahou Vincent Michalski Roland Memisevic 40 84 0 29 Oct 2015
A Primer on Neural Network Models for Natural Language Processing Yoav Goldberg AI4CE 50 1,128 0 02 Oct 2015