Structurally Sparsified Backward Propagation for Faster Long Short-Term
Memory Training

Structurally Sparsified Backward Propagation for Faster Long Short-Term Memory Training

1 June 2018

Papers citing "Structurally Sparsified Backward Propagation for Faster Long Short-Term Memory Training"

15 / 15 papers shown

Title
Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training Chengyue Wu Song Han Huizi Mao Yu Wang W. Dally 102 1,394 0 05 Dec 2017
meProp: Sparsified Back Propagation for Accelerated Deep Learning with Reduced Overfitting Xu Sun Xuancheng Ren Shuming Ma Houfeng Wang 51 156 0 19 Jun 2017
TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning W. Wen Cong Xu Feng Yan Chunpeng Wu Yandan Wang Yiran Chen Hai Helen Li 123 985 0 22 May 2017
Massive Exploration of Neural Machine Translation Architectures D. Britz Anna Goldie Minh-Thang Luong Quoc V. Le 56 516 0 11 Mar 2017
ESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGA Song Han Junlong Kang Huizi Mao Yiming Hu Xin Li ... Hong Luo Song Yao Yu Wang Huazhong Yang W. Dally 54 628 0 01 Dec 2016
Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challenge Oriol Vinyals Alexander Toshev Samy Bengio D. Erhan 65 853 0 21 Sep 2016
Learning Structured Sparsity in Deep Neural Networks W. Wen Chunpeng Wu Yandan Wang Yiran Chen Hai Helen Li 114 2,331 0 12 Aug 2016
EIE: Efficient Inference Engine on Compressed Deep Neural Network Song Han Xingyu Liu Huizi Mao Jing Pu A. Pedram M. Horowitz W. Dally 102 2,453 0 04 Feb 2016
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 473 27,231 0 02 Dec 2015
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 309 7,951 0 17 Aug 2015
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 226 6,628 0 08 Jun 2015
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 299 43,511 0 17 Sep 2014
Recurrent Neural Network Regularization Wojciech Zaremba Ilya Sutskever Oriol Vinyals ODL 102 2,768 0 08 Sep 2014
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 244 43,290 0 01 May 2014
Predicting Parameters in Deep Learning Misha Denil B. Shakibi Laurent Dinh MarcÁurelio Ranzato Nando de Freitas OOD 136 1,314 0 03 Jun 2013