Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks

22 August 2017

Papers citing "Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks"

26 / 26 papers shown

Title
Rethinking Time Encoding via Learnable Transformation Functions Xi Chen Yateng Tang Jiarong Xu Jiawei Zhang Siwei Zhang Sijia Peng Xuehao Zheng Yun Xiong AI4TS 51 0 0 01 May 2025
SOI: Scaling Down Computational Complexity by Estimating Partial States of the Model Grzegorz Stefański P. Daniluk Artur Szumaczuk Jakub Tkaczuk 31 0 0 04 Oct 2024
An end-to-end multi-scale network for action prediction in videos Xiaofan Liu Jianqin Yin Yuanxi Sun Zhicheng Zhang Jin Tang 21 0 0 31 Dec 2022
Efficient Transformers with Dynamic Token Pooling Piotr Nawrot J. Chorowski Adrian Lañcucki E. Ponti 20 42 0 17 Nov 2022
Learning Robust Dynamics through Variational Sparse Gating A. Jain Shivakanth Sujit S. Joshi Vincent Michalski Danijar Hafner Samira Ebrahimi Kahou 27 8 0 21 Oct 2022
Sequence Learning Using Equilibrium Propagation Malyaban Bal Abhronil Sengupta 35 9 0 14 Sep 2022
Inference skipping for more efficient real-time speech enhancement with parallel RNNs Xiaohuai Le Tong Lei Kai-Jyun Chen Jing Lu 38 20 0 22 Jul 2022
Efficient Deep Visual and Inertial Odometry with Adaptive Visual Modality Selection Mingyu Yang Yu Chen Hun-Seok Kim 41 27 0 12 May 2022
Triangular Dropout: Variable Network Width without Retraining Edward W. Staley Jared Markowitz 28 2 0 02 May 2022
Sparsely Changing Latent States for Prediction and Planning in Partially Observable Domains Christian Gumbsch Martin Volker Butz Georg Martius AI4CE 26 21 0 29 Oct 2021
Part & Whole Extraction: Towards A Deep Understanding of Quantitative Facts for Percentages in Text Lei Fang Jian-Guang Lou 25 4 0 26 Oct 2021
Oscillatory Fourier Neural Network: A Compact and Efficient Architecture for Sequential Processing Bing Han Cheng Wang Kaushik Roy 34 7 0 14 Sep 2021
Coupled Oscillatory Recurrent Neural Network (coRNN): An accurate and (gradient) stable architecture for learning long time dependencies T. Konstantin Rusch Siddhartha Mishra 19 89 0 02 Oct 2020
TinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aids Igor Fedorov Marko Stamenovic Carl R. Jensen Li-Chia Yang Ari Mandell Yiming Gan Matthew Mattina P. Whatmough 16 96 0 20 May 2020
Computation on Sparse Neural Networks: an Inspiration for Future Hardware Fei Sun Minghai Qin Tianyun Zhang Liu Liu Yen-kuang Chen Yuan Xie 34 7 0 24 Apr 2020
Evaluating complexity and resilience trade-offs in emerging memory inference machines C. Bennett Ryan Dellana T. Xiao Ben Feinberg S. Agarwal S. Cardwell M. Marinella William M. Severa Brad Aimone 16 2 0 25 Feb 2020
SparseIDS: Learning Packet Sampling with Reinforcement Learning Maximilian Bachl Fares Meghdouri J. Fabini Tanja Zseby 18 6 0 10 Feb 2020
MEMO: A Deep Network for Flexible Combination of Episodic Memories Andrea Banino Adria Puigdomenech Badia Raphael Köster Martin Chadwick V. Zambaldi Demis Hassabis Caswell Barry M. Botvinick D. Kumaran Charles Blundell KELM 26 33 0 29 Jan 2020
Seq-U-Net: A One-Dimensional Causal U-Net for Efficient Sequence Modelling Ruizhe Zhao Brian K. Vogel Tanvir Ahmed Wayne Luk 17 37 0 14 Nov 2019
Learning to Adaptively Scale Recurrent Neural Networks Hao Hu Liqiang Wang Guo-Jun Qi AI4CE 15 9 0 15 Feb 2019
Understanding Recurrent Neural Architectures by Analyzing and Synthesizing Long Distance Dependencies in Benchmark Sequential Datasets Abhijit Mahalunkar John D. Kelleher 24 8 0 06 Oct 2018
Pyramidal Recurrent Unit for Language Modeling Sachin Mehta Rik Koncel-Kedziorski Mohammad Rastegari Hannaneh Hajishirzi 21 10 0 27 Aug 2018
The streaming rollout of deep networks - towards fully model-parallel execution Volker Fischer Jan M. Köhler Thomas Pfeil 24 16 0 13 Jun 2018
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun DRL 42 4,715 0 04 Mar 2018
Learning Longer-term Dependencies in RNNs with Auxiliary Losses Trieu H. Trinh Andrew M. Dai Thang Luong Quoc V. Le 30 179 0 01 Mar 2018
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 255 13,368 0 25 Aug 2014