Learning Longer Memory in Recurrent Neural Networks

24 December 2014

Papers citing "Learning Longer Memory in Recurrent Neural Networks"

50 / 53 papers shown

Title
Slower is Better: Revisiting the Forgetting Mechanism in LSTM for Slower Information Decay H. Chien Javier S. Turek Nicole M. Beckage Vy A. Vo C. Honey Ted Willke 27 15 0 12 May 2021
A Discrete Variational Recurrent Topic Model without the Reparametrization Trick Mehdi Rezaee Francis Ferraro BDL DRL 17 27 0 22 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 44 79 0 17 Sep 2020
Learning Multi-Sense Word Distributions using Approximate Kullback-Leibler Divergence P. Jayashree Ballijepalli Shreya P. K. Srijith 26 2 0 12 Nov 2019
A Statistical Investigation of Long Memory in Language and Music Alexander Greaves-Tunnell Zaïd Harchaoui AI4TS 32 24 0 08 Apr 2019
Slim LSTM networks: LSTM_6 and LSTM_C6 Atra Akandeh F. Salem 32 13 0 18 Jan 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai Zhilin Yang Yiming Yang J. Carbonell Quoc V. Le Ruslan Salakhutdinov VLM 38 3,685 0 09 Jan 2019
Counting in Language with RNNs He Fun Sergiy V. Bokhnyak Francesco Saverio Zuppichini 23 0 0 29 Oct 2018
The challenge of realistic music generation: modelling raw audio at scale Sander Dieleman Aaron van den Oord Karen Simonyan 23 184 0 26 Jun 2018
Retraining-Based Iterative Weight Quantization for Deep Neural Networks Dongsoo Lee Byeongwook Kim MQ 36 16 0 29 May 2018
Low-pass Recurrent Neural Networks - A memory architecture for longer-term correlation discovery T. Stepleton Razvan Pascanu Will Dabney Siddhant M. Jayakumar Hubert Soyer Rémi Munos 19 4 0 13 May 2018
Constrained Deep Learning using Conditional Gradient and Applications in Computer Vision Sathya Ravi Tuan Dinh Vishnu Suresh Lokhande Vikas Singh AI4CE 33 22 0 17 Mar 2018
Sales forecasting using WaveNet within the framework of the Kaggle competition Glib Kechyn L. Yu Yangguang Zang Svyatoslav Kechyn 29 26 0 11 Mar 2018
Learning Longer-term Dependencies in RNNs with Auxiliary Losses Trieu H. Trinh Andrew M. Dai Thang Luong Quoc V. Le 41 179 0 01 Mar 2018
Recent Advances in Recurrent Neural Networks Hojjat Salehinejad Sharan Sankar Joseph Barfett E. Colak S. Valaee AI4TS 40 574 0 29 Dec 2017
Neural Language Modeling by Jointly Learning Syntax and Lexicon Songlin Yang Zhouhan Lin Chin-Wei Huang Aaron Courville 46 178 0 02 Nov 2017
Self-organized Hierarchical Softmax Songlin Yang Shawn Tan C. Pal Aaron Courville BDL 38 7 0 26 Jul 2017
A New Unbiased and Efficient Class of LSH-Based Samplers and Estimators for Partition Function Computation in Log-Linear Models Ryan Spring Anshumali Shrivastava 18 53 0 15 Mar 2017
The Statistical Recurrent Unit Junier B. Oliva Barnabás Póczós J. Schneider 26 50 0 01 Mar 2017
Gate-Variants of Gated Recurrent Unit (GRU) Neural Networks Rahul Dey F. Salem 30 1,367 0 20 Jan 2017
A recurrent neural network without chaos T. Laurent J. V. Brecht LRM 32 62 0 19 Dec 2016
DeepBach: a Steerable Model for Bach Chorales Generation Gaëtan Hadjeres F. Pachet Frank Nielsen 39 433 0 03 Dec 2016
Prototypical Recurrent Unit Dingkun Long Richong Zhang Yongyi Mao 30 6 0 20 Nov 2016
Variable Computation in Recurrent Neural Networks Yacine Jernite Edouard Grave Armand Joulin Tomas Mikolov 35 59 0 18 Nov 2016
Learning long-term dependencies for action recognition with a biologically-inspired deep network Yemin Shi Yonghong Tian Yaowei Wang Tiejun Huang 29 63 0 16 Nov 2016
TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency Adji Bousso Dieng Chong-Jun Wang Jianfeng Gao John Paisley 27 243 0 05 Nov 2016
Efficient softmax approximation for GPUs Edouard Grave Armand Joulin Moustapha Cissé David Grangier Hervé Jégou 40 271 0 14 Sep 2016
Using the Output Embedding to Improve Language Models Ofir Press Lior Wolf 30 729 0 20 Aug 2016
A Recurrent Encoder-Decoder Network for Sequential Face Alignment Xi Peng Rogerio Feris Xiaoyu Wang Dimitris N. Metaxas CVBM 180 140 0 19 Aug 2016
TerpreT: A Probabilistic Programming Language for Program Induction Alexander L. Gaunt Marc Brockschmidt Rishabh Singh Nate Kushman Pushmeet Kohli Jonathan Taylor Daniel Tarlow 35 123 0 15 Aug 2016
Unsupervised Learning from Continuous Video in a Scalable Predictive Recurrent Network Filip Piekniewski Patryk A. Laurent Csaba Petre Micah Richert Dimitry Fisher Todd Hylton 20 17 0 22 Jul 2016
Learning Unitary Operators with Help From u(n) Stephanie L. Hyland Gunnar Rätsch 97 41 0 17 Jul 2016
The LAMBADA dataset: Word prediction requiring a broad discourse context Denis Paperno Germán Kruszewski Angeliki Lazaridou Q. N. Pham Raffaella Bernardi Sandro Pezzelle Marco Baroni Gemma Boleda Raquel Fernández 41 664 0 20 Jun 2016
Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations David M. Krueger Tegan Maharaj János Kramár Mohammad Pezeshki Nicolas Ballas Nan Rosemary Ke Anirudh Goyal Yoshua Bengio Aaron Courville C. Pal 21 317 0 03 Jun 2016
Minimal Gated Unit for Recurrent Neural Networks Guoxiang Zhou Jianxin Wu Chen-Da Liu-Zhang Zhi-Hua Zhou 31 326 0 31 Mar 2016
Resnet in Resnet: Generalizing Residual Architectures S. Targ Diogo Almeida Kevin Lyman SSeg 34 807 0 25 Mar 2016
Recurrent Dropout without Memory Loss Stanislau Semeniuta Aliaksei Severyn Erhardt Barth 32 222 0 16 Mar 2016
Recurrent Orthogonal Networks and Long-Memory Tasks Mikael Henaff Arthur Szlam Yann LeCun 16 130 0 22 Feb 2016
Strongly-Typed Recurrent Neural Networks David Balduzzi Muhammad Ghifary PINN 16 60 0 06 Feb 2016
Long Short-Term Memory-Networks for Machine Reading Jianpeng Cheng Li Dong Mirella Lapata AIMat RALM 39 1,111 0 25 Jan 2016
Conversion of Artificial Recurrent Neural Networks to Spiking Neural Networks for Low-power Neuromorphic Hardware P. U. Diehl Guido Zarrella A. Cassidy Bruno U. Pedroni Emre Neftci 35 217 0 16 Jan 2016
Structural-RNN: Deep Learning on Spatio-Temporal Graphs Ashesh Jain Amir Zamir Silvio Savarese Ashutosh Saxena GNN 78 1,082 0 17 Nov 2015
Larger-Context Language Modelling Tian Wang Kyunghyun Cho 28 87 0 11 Nov 2015
Top-down Tree Long Short-Term Memory Networks Xingxing Zhang Liang Lu Mirella Lapata AIMat 20 101 0 31 Oct 2015
A Primer on Neural Network Models for Natural Language Processing Yoav Goldberg AI4CE 50 1,129 0 02 Oct 2015
Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question Answering Haoyuan Gao Junhua Mao Jie Zhou Zhiheng Huang Lei Wang Wenyuan Xu 32 496 0 21 May 2015
Learning like a Child: Fast Novel Visual Concept Learning from Sentence Descriptions of Images Junhua Mao Xu Wei Yi Yang Jiang Wang Zhiheng Huang Alan Yuille 25 154 0 25 Apr 2015
Compositional Vector Space Models for Knowledge Base Completion Arvind Neelakantan Benjamin Roth Andrew McCallum BDL CoGe KELM 35 280 0 24 Apr 2015
Bidirectional Recurrent Neural Networks as Generative Models - Reconstructing Gaps in Time Series Mathias Berglund T. Raiko Mikko Honkala L. Kärkkäinen A. Vetek J. Karhunen BDL 43 125 0 07 Apr 2015
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units Quoc V. Le Navdeep Jaitly Geoffrey E. Hinton ODL 35 716 0 03 Apr 2015