Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding

1 October 2015

Song Han

Papers citing "Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding"

50 / 3,448 papers shown

Title
Deep Face Recognition: A Survey Mei Wang Weihong Deng NoLa 27 1,217 0 18 Apr 2018
UCNN: Exploiting Computational Reuse in Deep Neural Networks via Weight Repetition Kartik Hegde Jiyong Yu R. Agrawal Mengjia Yan Michael Pellauer Christopher W. Fletcher 22 165 0 18 Apr 2018
Training a Binary Weight Object Detector by Knowledge Transfer for Autonomous Driving Jiaolong Xu Peng Wang Hengzhang Yang Antonio M. López MQ 35 23 0 17 Apr 2018
IGCV $2$ : Interleaved Structured Sparse Convolutional Neural Networks Guotian Xie Jingdong Wang Ting Zhang Jianhuang Lai Richang Hong Guo-Jun Qi 25 105 0 17 Apr 2018
Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach Wenda Zhou Victor Veitch Morgane Austern Ryan P. Adams Peter Orbanz 46 211 0 16 Apr 2018
Fast inference of deep neural networks in FPGAs for particle physics Javier Mauricio Duarte Song Han Philip C. Harris S. Jindariani E. Kreinar ... J. Ngadiuba M. Pierini R. Rivera N. Tran Zhenbin Wu AI4CE 88 389 0 16 Apr 2018
Data-Dependent Coresets for Compressing Neural Networks with Applications to Generalization Bounds Cenk Baykal Lucas Liebenwein Igor Gilitschenski Dan Feldman Daniela Rus 25 79 0 15 Apr 2018
Select, Attend, and Transfer: Light, Learnable Skip Connections Saeid Asgari Taghanaki A. Bentaieb Anmol Sharma S. Kevin Zhou Yefeng Zheng ... Puneet Sharma Sasa Grbic Zhoubing Xu Dorin Comaniciu Ghassan Hamarneh 38 20 0 14 Apr 2018
Pieces of Eight: 8-bit Neural Machine Translation Jerry Quinn Miguel Ballesteros MQ 14 25 0 13 Apr 2018
The unreasonable effectiveness of the forget gate J. Westhuizen Joan Lasenby 30 86 0 13 Apr 2018
A Compact Network Learning Model for Distribution Regression C. Kou H. Lee Teck Khim Ng 18 10 0 13 Apr 2018
Hybrid Binary Networks: Optimizing for Accuracy, Efficiency and Memory Ameya Prabhu Vishal Batchu Rohit Gajawada Sri Aurobindo Munagala A. Namboodiri MQ 33 18 0 11 Apr 2018
Crafting a Toolchain for Image Restoration by Deep Reinforcement Learning K. Yu Chao Dong Liang Lin Chen Change Loy CLL OffRL 27 174 0 10 Apr 2018
A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multipliers Tianyun Zhang Shaokai Ye Kaiqi Zhang Jian Tang Wujie Wen M. Fardad Yanzhi Wang 30 434 0 10 Apr 2018
Distribution-Aware Binarization of Neural Networks for Sketch Recognition Ameya Prabhu Vishal Batchu Sri Aurobindo Munagala Rohit Gajawada A. Namboodiri MQ 27 5 0 09 Apr 2018
Universal and Succinct Source Coding of Deep Neural Networks Sourya Basu Lav Varshney BDL 19 3 0 09 Apr 2018
Estimating Depth from RGB and Sparse Sensing Zhao Chen Vijay Badrinarayanan Gilad Drozdov Andrew Rabinovich MDE 3DV 36 109 0 08 Apr 2018
The Loss Surface of XOR Artificial Neural Networks D. Mehta Xiaojun Zhao Edgar A. Bernal D. Wales 34 19 0 06 Apr 2018
Structured Evolution with Compact Architectures for Scalable Policy Optimization K. Choromanski Mark Rowland Vikas Sindhwani Richard Turner Adrian Weller 27 147 0 06 Apr 2018
Building Efficient CNN Architecture for Offline Handwritten Chinese Character Recognition Zhiyuan Li Nanjun Teng Min Jin Huaxiang Lu 23 51 0 04 Apr 2018
DeepSigns: A Generic Watermarking Framework for IP Protection of Deep Learning Models B. Rouhani Huili Chen F. Koushanfar 46 48 0 02 Apr 2018
Structured Weight Matrices-Based Hardware Accelerators in Deep Neural Networks: FPGAs and ASICs Caiwen Ding Ao Ren Geng Yuan Xiaolong Ma Jiayu Li Ning Liu Bo Yuan Yanzhi Wang 28 23 0 28 Mar 2018
Adversarial Network Compression Vasileios Belagiannis Azade Farshad Fabio Galasso GAN AAML 14 58 0 28 Mar 2018
FPGA Implementations of 3D-SIMD Processor Architecture for Deep Neural Networks Using Relative Indexed Compressed Sparse Filter Encoding Format and Stacked Filters Stationary Flow Yuechao Gao Nianhong Liu Shenmin Zhang 19 1 0 28 Mar 2018
Incremental Training of Deep Convolutional Neural Networks R. Istrate A. Malossi C. Bekas Dimitrios S. Nikolopoulos CLL 28 21 0 27 Mar 2018
Diagonalwise Refactorization: An Efficient Training Method for Depthwise Convolutions Zheng Qin Zhaoning Zhang Dongsheng Li Yiming Zhang Yuxing Peng 25 28 0 27 Mar 2018
Face Recognition with Hybrid Efficient Convolution Algorithms on FPGAs Chuanhao Zhuge Xinheng Liu Xiaofan Zhang S. Gummadi Jinjun Xiong Deming Chen CVBM 28 36 0 23 Mar 2018
Iterative Low-Rank Approximation for CNN Compression Maksym Kholiavchenko 19 9 0 23 Mar 2018
SqueezeNext: Hardware-Aware Neural Network Design A. Gholami K. Kwon Bichen Wu Zizheng Tai Xiangyu Yue Peter H. Jin Sicheng Zhao Kurt Keutzer 22 295 0 23 Mar 2018
Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network Namhyuk Ahn Byungkon Kang Kyung-ah Sohn SupR 39 1,106 0 23 Mar 2018
Design Principles for Sparse Matrix Multiplication on the GPU Carl Yang A. Buluç John Douglas Owens 19 107 0 22 Mar 2018
Task dependent Deep LDA pruning of neural networks Qing Tian Tal Arbel James J. Clark 24 0 0 21 Mar 2018
Efficient Recurrent Neural Networks using Structured Matrices in FPGAs Zhe Li Shuo Wang Caiwen Ding Qinru Qiu Yanzhi Wang Yun Liang GNN 22 21 0 20 Mar 2018
Local Binary Pattern Networks Jeng-Hau Lin Yunfan Yang Rajesh K. Gupta Zhuowen Tu MQ 21 13 0 19 Mar 2018
ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation Sachin Mehta Mohammad Rastegari A. Caspi Linda G. Shapiro Hannaneh Hajishirzi SSeg 43 779 0 19 Mar 2018
Constrained Deep Learning using Conditional Gradient and Applications in Computer Vision Sathya Ravi Tuan Dinh Vishnu Suresh Lokhande Vikas Singh AI4CE 35 22 0 17 Mar 2018
EVA $^2$ : Exploiting Temporal Redundancy in Live Computer Vision Mark Buckler Philip Bedoukian Suren Jayasuriya Adrian Sampson 44 75 0 16 Mar 2018
TBD: Benchmarking and Analyzing Deep Neural Network Training Hongyu Zhu Mohamed Akrout Bojian Zheng Andrew Pelegris Amar Phanishayee Bianca Schroeder Gennady Pekhimenko 31 80 0 16 Mar 2018
Efficient Hardware Realization of Convolutional Neural Networks using Intra-Kernel Regular Pruning Maurice Yang Mahmoud Faraj Assem Hussein V. Gaudet CVBM 22 12 0 15 Mar 2018
Toolflows for Mapping Convolutional Neural Networks on FPGAs: A Survey and Future Directions Stylianos I. Venieris Alexandros Kouris C. Bouganis 19 184 0 15 Mar 2018
Exploring Linear Relationship in Feature Map Subspace for ConvNets Compression Dong Wang Lei Zhou Xueni Zhang Xiao Bai Jun Zhou 27 47 0 15 Mar 2018
C-LSTM: Enabling Efficient LSTM using Structured Compression Techniques on FPGAs Shuo Wang Zhe Li Caiwen Ding Bo Yuan Yanzhi Wang Qinru Qiu Yun Liang 28 192 0 14 Mar 2018
LCANet: End-to-End Lipreading with Cascaded Attention-CTC Kai Xu Dawei Li N. Cassimatis Xiaolong Wang 33 96 0 13 Mar 2018
Quantization of Fully Convolutional Networks for Accurate Biomedical Image Segmentation Xiaowei Xu Q. Lu Yu Hu Lin Yang X. S. Hu Danny Chen Yiyu Shi MedIm 29 85 0 13 Mar 2018
FeTa: A DCA Pruning Algorithm with Generalization Error Guarantees Konstantinos Pitas Mike Davies P. Vandergheynst 16 2 0 12 Mar 2018
ShuffleSeg: Real-time Semantic Segmentation Network M. Gamal Mennatullah Siam Moemen Abdel-Razek SSeg 33 59 0 10 Mar 2018
Bit-Tactical: Exploiting Ineffectual Computations in Convolutional Neural Networks: Which, Why, and How A. Delmas Patrick Judd Dylan Malone Stuart Zissis Poulos Mostafa Mahmoud Sayeh Sharify Milos Nikolic Andreas Moshovos 32 24 0 09 Mar 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 82 3,400 0 09 Mar 2018
High-Accuracy Low-Precision Training Christopher De Sa Megan Leszczynski Jian Zhang Alana Marzoev Christopher R. Aberger K. Olukotun Christopher Ré 35 109 0 09 Mar 2018
Exponential Discriminative Metric Embedding in Deep Learning Bowen Wu Zhangling Chen Jun Wang Hua-Ming Wu 43 10 0 07 Mar 2018