On Multiplicative Integration with Recurrent Neural Networks

21 June 2016

Papers citing "On Multiplicative Integration with Recurrent Neural Networks"

50 / 72 papers shown

Title
A Tensor Decomposition Perspective on Second-order RNNs M. Lizaire Michael Rizvi-Martel Marawan Gamal Abdel Hameed Guillaume Rabusseau 52 0 0 07 Jun 2024
Language Modeling Using Tensor Trains Zhan Su Yuqin Zhou Fengran Mo J. Simonsen 51 2 0 07 May 2024
Stability Analysis of Various Symbolic Rule Extraction Methods from Recurrent Neural Network Neisarg Dave Daniel Kifer C. Lee Giles A. Mali 26 3 0 04 Feb 2024
High-Order Pooling for Graph Neural Networks with Tensor Decomposition Chenqing Hua Guillaume Rabusseau Jian Tang 75 25 0 24 May 2022
Explainable Natural Language Processing with Matrix Product States J. Tangpanitanon Chanatip Mangkang P. Bhadola Yuichiro Minato D. Angelakis Thiparat Chotibut 27 5 0 16 Dec 2021
Gates Are Not What You Need in RNNs Ronalds Zakovskis Andis Draguns Eliza Gaile Emīls Ozoliņš Kārlis Freivalds 14 1 0 01 Aug 2021
Recognizing and Verifying Mathematical Equations using Multiplicative Differential Neural Units A. Mali Alexander Ororbia Daniel Kifer C. Lee Giles 14 16 0 07 Apr 2021
Advancing RNN Transducer Technology for Speech Recognition G. Saon Zoltan Tueske Daniel Bolaños Brian Kingsbury 34 86 0 17 Mar 2021
On the Memory Mechanism of Tensor-Power Recurrent Models Hejia Qiu Chao Li Ying Weng Zhun Sun Xingyu He Qibin Zhao 16 6 0 02 Mar 2021
Connecting Weighted Automata, Tensor Networks and Recurrent Neural Networks through Spectral Learning Tianyu Li Doina Precup Guillaume Rabusseau 9 8 0 19 Oct 2020
Neural Language Generation: Formulation, Methods, and Evaluation Cristina Garbacea Qiaozhu Mei 45 30 0 31 Jul 2020
Funnel Activation for Visual Recognition Ningning Ma Xinming Zhang Jian Sun ObjD 61 85 0 23 Jul 2020
Recognizing Long Grammatical Sequences Using Recurrent Networks Augmented With An External Differentiable Stack A. Mali Alexander Ororbia Daniel Kifer C. Lee Giles 11 13 0 04 Apr 2020
Depth Enables Long-Term Memory for Recurrent Neural Networks A. Ziv 14 0 0 23 Mar 2020
Refined Gate: A Simple and Effective Gating Mechanism for Recurrent Units Zhanzhan Cheng Yunlu Xu Mingjian Cheng Yu Qiao Shiliang Pu Yi Niu Fei Wu 14 8 0 26 Feb 2020
A Survey of Deep Learning Techniques for Neural Machine Translation Shu Yang Yuxin Wang X. Chu VLM AI4TS AI4CE 22 138 0 18 Feb 2020
Multi-Zone Unit for Recurrent Neural Networks Fandong Meng Jinchao Zhang Yang Liu Jie Zhou AI4CE 14 2 0 17 Nov 2019
Connecting First and Second Order Recurrent Networks with Deterministic Finite Automata Qinglong Wang Kaixuan Zhang Xue Liu C. Lee Giles 17 3 0 12 Nov 2019
A Unifying Framework of Bilinear LSTMs Mohit Rajpal Bryan Kian Hsiang Low 18 0 0 23 Oct 2019
Stabilizing Transformers for Reinforcement Learning Emilio Parisotto H. F. Song Jack W. Rae Razvan Pascanu Çağlar Gülçehre ... Aidan Clark Seb Noury M. Botvinick N. Heess R. Hadsell OffRL 22 360 0 13 Oct 2019
Deep Independently Recurrent Neural Network (IndRNN) Shuai Li Wanqing Li Chris Cook Yanbo Gao 21 50 0 11 Oct 2019
Structured Pruning of Large Language Models Ziheng Wang Jeremy Wohlwend Tao Lei 24 281 0 10 Oct 2019
Scene-based Factored Attention for Image Captioning Chen Shen Rongrong Ji Fuhai Chen Xiaoshuai Sun Xiangming Li 19 0 0 07 Aug 2019
Adversarial Video Generation on Complex Datasets Aidan Clark Jeff Donahue Karen Simonyan VGen GAN 27 74 0 15 Jul 2019
Better Long-Range Dependency By Bootstrapping A Mutual Information Regularizer Yanshuai Cao Peng Xu 9 2 0 28 May 2019
A Generalized Language Model in Tensor Space Lipeng Zhang Peng-Zhen Zhang Xindian Ma Shuqin Gu Zhan Su D. Song 11 16 0 31 Jan 2019
Generalized Tensor Models for Recurrent Neural Networks Valentin Khrulkov Oleksii Hrinchuk Ivan Oseledets GNN 27 25 0 30 Jan 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai Zhilin Yang Yiming Yang J. Carbonell Quoc V. Le Ruslan Salakhutdinov VLM 36 3,673 0 09 Jan 2019
Verification of Recurrent Neural Networks Through Rule Extraction Qinglong Wang Kaixuan Zhang Xue Liu C. Lee Giles AAML 28 18 0 14 Nov 2018
Composable Action-Conditioned Predictors: Flexible Off-Policy Learning for Robot Navigation G. Kahn Adam R. Villaflor Pieter Abbeel Sergey Levine SSL OffRL 30 19 0 16 Oct 2018
Weighted Sigmoid Gate Unit for an Activation Function of Deep Neural Network Masayuki Tanaka 27 54 0 03 Oct 2018
Character-Level Language Modeling with Deeper Self-Attention Rami Al-Rfou Dokook Choe Noah Constant Mandy Guo Llion Jones 22 386 0 09 Aug 2018
Connecting Weighted Automata and Recurrent Neural Networks through Spectral Learning Guillaume Rabusseau Tianyu Li Doina Precup 34 41 0 04 Jul 2018
A Computational Study of the Role of Tonal Tension in Expressive Piano Performance Carlos Eduardo Cancino-Chacón M. Grachten 6 3 0 03 Jul 2018
Breaking the Activation Function Bottleneck through Adaptive Parameterization Sebastian Flennerhag Hujun Yin J. Keane Mark Elliot 16 12 0 22 May 2018
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun DRL 42 4,715 0 04 Mar 2018
Learning Longer-term Dependencies in RNNs with Auxiliary Losses Trieu H. Trinh Andrew M. Dai Thang Luong Quoc V. Le 25 179 0 01 Mar 2018
A Comparative Study of Rule Extraction for Recurrent Neural Networks Qinglong Wang Kaixuan Zhang Alexander Ororbia Masashi Sugiyama Xue Liu C. Lee Giles 16 11 0 16 Jan 2018
Character-level Recurrent Neural Networks in Practice: Comparing Training and Sampling Schemes Cedric De Boom Thomas Demeester Bart Dhoedt 8 8 0 02 Jan 2018
Improving End-to-End Speech Recognition with Policy Learning Yingbo Zhou Caiming Xiong R. Socher 19 40 0 19 Dec 2017
Visual Explanations from Hadamard Product in Multimodal Deep Networks Jin-Hwa Kim Byoung-Tak Zhang FAtt 21 3 0 18 Dec 2017
Wider and Deeper, Cheaper and Faster: Tensorized LSTMs for Sequence Learning Zhen He Shaobing Gao Liang Xiao Daxue Liu Hangen He David Barber AIMat 37 64 0 05 Nov 2017
Neural Language Modeling by Jointly Learning Syntax and Lexicon Songlin Yang Zhouhan Lin Chin-Wei Huang Aaron Courville 38 179 0 02 Nov 2017
Expressive power of recurrent neural networks Valentin Khrulkov Alexander Novikov Ivan Oseledets 19 112 0 02 Nov 2017
On the Long-Term Memory of Deep Recurrent Networks Yoav Levine Or Sharir Alon Ziv Amnon Shashua 13 24 0 25 Oct 2017
Spontaneous Symmetry Breaking in Neural Networks R. Fok Aijun An Xiaogang Wang 18 4 0 17 Oct 2017
Self-supervised Deep Reinforcement Learning with Generalized Computation Graphs for Robot Navigation G. Kahn Adam R. Villaflor Bosen Ding Pieter Abbeel Sergey Levine SSL 22 287 0 29 Sep 2017
Dynamic Evaluation of Neural Sequence Models Ben Krause Emmanuel Kahembwe Iain Murray Steve Renals 26 133 0 21 Sep 2017
Shifting Mean Activation Towards Zero with Bipolar Activation Functions L. Eidnes Arild Nøkland 21 18 0 12 Sep 2017
Simple Recurrent Units for Highly Parallelizable Recurrence Tao Lei Yu Zhang Sida I. Wang Huijing Dai Yoav Artzi LRM 42 271 0 08 Sep 2017