Learning Compact Recurrent Neural Networks

9 April 2016

Papers citing "Learning Compact Recurrent Neural Networks"

25 / 25 papers shown

Title
D-TensoRF: Tensorial Radiance Fields for Dynamic Scenes Hankyu Jang Daeyoung Kim 78 24 0 05 Dec 2022
Structured in Space, Randomized in Time: Leveraging Dropout in RNNs for Efficient Training Anup Sarma Sonali Singh Huaipan Jiang Rui Zhang M. Kandemir Chita R. Das 26 1 0 22 Jun 2021
Block-term Tensor Neural Networks Jinmian Ye Guangxi Li Di Chen Haiqin Yang Shandian Zhe Zenglin Xu 77 30 0 10 Oct 2020
Rank and run-time aware compression of NLP Applications Urmish Thakker Jesse G. Beu Dibakar Gope Ganesh S. Dasika Matthew Mattina 38 11 0 06 Oct 2020
Sparse Linear Networks with a Fixed Butterfly Structure: Theory and Practice Nir Ailon Omer Leibovitch Vineet Nair 72 15 0 17 Jul 2020
Soft Threshold Weight Reparameterization for Learnable Sparsity Aditya Kusupati Vivek Ramanujan Raghav Somani Mitchell Wortsman Prateek Jain Sham Kakade Ali Farhadi 167 247 0 08 Feb 2020
Neural Machine Translation: A Review and Survey Felix Stahlberg 3DV AI4TS MedIm 131 332 0 04 Dec 2019
Image Captioning with Sparse Recurrent Neural Network J. Tan Chee Seng Chan Joon Huang Chuah VLM 47 6 0 28 Aug 2019
On the Effectiveness of Low-Rank Matrix Factorization for LSTM Model Compression Genta Indra Winata Andrea Madotto Jamin Shin Elham J. Barezi Pascale Fung 64 29 0 27 Aug 2019
Run-Time Efficient RNN Compression for Inference on Edge Devices Urmish Thakker Jesse G. Beu Dibakar Gope Ganesh S. Dasika Matthew Mattina 72 19 0 12 Jun 2019
Compression of Recurrent Neural Networks for Efficient Language Modeling Artem M. Grachev D. Ignatov Andrey V. Savchenko 58 39 0 06 Feb 2019
Online Embedding Compression for Text Classification using Low Rank Matrix Factorization Anish Acharya Rahul Goel A. Metallinou Inderjit Dhillon 94 62 0 01 Nov 2018
Learning Compressed Transforms with Low Displacement Rank Anna T. Thomas Albert Gu Tri Dao Atri Rudra Christopher Ré 101 40 0 04 Oct 2018
GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking Patrick H. Chen Si Si Yang Li Ciprian Chelba Cho-Jui Hsieh 67 70 0 18 Jun 2018
Grow and Prune Compact, Fast, and Accurate LSTMs Xiaoliang Dai Hongxu Yin N. Jha VLM SyDa 61 91 0 30 May 2018
Faster Neural Network Training with Approximate Tensor Operations Menachem Adelman Kfir Y. Levy Ido Hakimi M. Silberstein 81 27 0 21 May 2018
Recent Progresses in Deep Learning based Acoustic Models (Updated) Dong Yu Jinyu Li VLM 77 160 0 25 Apr 2018
Learning Compact Recurrent Neural Networks with Block-Term Tensor Decomposition Jinmian Ye Linnan Wang Guangxi Li Di Chen Shandian Zhe Xinqi Chu Zenglin Xu 104 132 0 14 Dec 2017
Learning Intrinsic Sparse Structures within Long Short-Term Memory W. Wen Yuxiong He Samyam Rajbhandari Minjia Zhang Wenhan Wang Fang Liu Bin Hu Yiran Chen H. Li MQ 135 142 0 15 Sep 2017
Neural Networks Compression for Language Modeling Artem M. Grachev D. Ignatov Andrey V. Savchenko 67 30 0 20 Aug 2017
An Embedded Deep Learning based Word Prediction Seunghak Yu Nilesh Kulkarni Haejun Lee J. Kim 46 0 0 06 Jul 2017
Compressing Recurrent Neural Network with Tensor Train Andros Tjandra S. Sakti Satoshi Nakamura 88 111 0 23 May 2017
Exploring Sparsity in Recurrent Neural Networks Sharan Narang Erich Elsen G. Diamos Shubho Sengupta 80 313 0 17 Apr 2017
Compression of Neural Machine Translation Models via Pruning A. See Minh-Thang Luong Christopher D. Manning MedIm VLM 72 220 0 29 Jun 2016
Sequence-Level Knowledge Distillation Yoon Kim Alexander M. Rush 136 1,123 0 25 Jun 2016