Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding

1 October 2015

Song Han

Papers citing "Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding"

50 / 3,448 papers shown

Title
Recent Advances in Efficient Computation of Deep Convolutional Neural Networks Jian Cheng Peisong Wang Gang Li Qinghao Hu Hanqing Lu 32 3 0 03 Feb 2018
Build a Compact Binary Neural Network through Bit-level Sensitivity and Data Pruning Yixing Li Fengbo Ren MQ 22 12 0 03 Feb 2018
Intriguing Properties of Randomly Weighted Networks: Generalizing While Learning Next to Nothing Amir Rosenfeld John K. Tsotsos MLT 32 51 0 02 Feb 2018
VIBNN: Hardware Acceleration of Bayesian Neural Networks R. Cai Ao Ren Ning Liu Caiwen Ding Luhao Wang Xuehai Qian Massoud Pedram Yanzhi Wang BDL 51 87 0 02 Feb 2018
Adaptive Memory Networks Daniel Li Asim Kadav 34 5 0 01 Feb 2018
Alternating Multi-bit Quantization for Recurrent Neural Networks Chen Xu Jianqiang Yao Zhouchen Lin Wenwu Ou Yuanbin Cao Zhirong Wang H. Zha MQ 35 115 0 01 Feb 2018
Model compression for faster structural separation of macromolecules captured by Cellular Electron Cryo-Tomography JiaLiang Guo Bo Zhou Xiangrui Zeng Z. Freyberg Min Xu 22 10 0 31 Jan 2018
Recovering from Random Pruning: On the Plasticity of Deep Convolutional Neural Networks Deepak Mittal S. Bhardwaj Mitesh M. Khapra Balaraman Ravindran VLM 36 65 0 31 Jan 2018
On Psychoacoustically Weighted Cost Functions Towards Resource-Efficient Deep Neural Networks for Speech Denoising Kai Zhen Aswin Sivaraman Jongmo Sung Minje Kim 19 7 0 29 Jan 2018
Stacked Filters Stationary Flow For Hardware-Oriented Acceleration Of Deep Convolutional Neural Networks Yuechao Gao Nianhong Liu Shenmin Zhang 21 0 0 23 Jan 2018
Learning to Prune Filters in Convolutional Neural Networks Qiangui Huang S. Kevin Zhou Suya You Ulrich Neumann VLM 28 177 0 23 Jan 2018
Binary output layer of feedforward neural networks for solving multi-class classification problems Sibo Yang Chao Zhang Wei Wu MQ 14 8 0 22 Jan 2018
Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification Yinhao Zhu N. Zabaras UQCV BDL 27 639 0 21 Jan 2018
Toward Scalable Verification for Safety-Critical Deep Networks L. Kuper Guy Katz Justin Emile Gottschlich Kyle D. Julian Clark W. Barrett Mykel Kochenderfer 45 40 0 18 Jan 2018
StressedNets: Efficient Feature Representations via Stress-induced Evolutionary Synthesis of Deep Neural Networks M. Shafiee Brendan Chwyl Francis Li Rongyan Chen Michelle Karg C. Scharfenberger A. Wong 16 7 0 16 Jan 2018
Deep Net Triage: Analyzing the Importance of Network Layers via Structural Compression Theodore S. Nowak Jason J. Corso FAtt 16 3 0 15 Jan 2018
Fix your classifier: the marginal value of training the last weight layer Elad Hoffer Itay Hubara Daniel Soudry 35 101 0 14 Jan 2018
Focus: Querying Large Video Datasets with Low Latency and Low Cost Kevin Hsieh Ganesh Ananthanarayanan P. Bodík P. Bahl Matthai Philipose Phillip B. Gibbons O. Mutlu 27 275 0 10 Jan 2018
Learning $3$ D-FilterMap for Deep Convolutional Neural Networks Yingzhen Yang Jianchao Yang N. Xu Wei Han 3DV MQ 18 1 0 05 Jan 2018
Overcoming catastrophic forgetting with hard attention to the task Joan Serrà Dídac Surís M. Miron Alexandros Karatzoglou CLL 41 1,054 0 04 Jan 2018
Learning a Wavelet-like Auto-Encoder to Accelerate Deep Neural Networks Tianshui Chen Liang Lin W. Zuo Xiaonan Luo Lei Zhang 21 56 0 20 Dec 2017
DeepPicar: A Low-cost Deep Neural Network-based Autonomous Car Michael Bechtel Elise McEllhiney Minje Kim H. Yun 30 103 0 19 Dec 2017
Squeezed Convolutional Variational AutoEncoder for Unsupervised Anomaly Detection in Edge Device Industrial Internet of Things Dohyung Kim Hyochang Yang Minki Chung Sungzoon Cho DRL 11 32 0 18 Dec 2017
Automated flow for compressing convolution neural networks for efficient edge-computation with FPGA F. Shafiq Takato Yamada Antonio T. Vilchez Sakyasingha Dasgupta MQ 26 3 0 18 Dec 2017
clcNet: Improving the Efficiency of Convolutional Neural Network using Channel Local Convolutions Dong-Qing Zhang 11 10 0 17 Dec 2017
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference Benoit Jacob S. Kligys Bo Chen Menglong Zhu Matthew Tang Andrew G. Howard Hartwig Adam Dmitry Kalenichenko MQ 92 3,062 0 15 Dec 2017
BT-Nets: Simplifying Deep Neural Networks via Block Term Decomposition Guangxi Li Jinmian Ye Haiqin Yang Di Chen Shuicheng Yan Zenglin Xu 27 11 0 15 Dec 2017
FFT-Based Deep Learning Deployment in Embedded Systems Sheng Lin Ning Liu M. Nazemi Hongjia Li Caiwen Ding Yanzhi Wang Massoud Pedram 41 52 0 13 Dec 2017
NestedNet: Learning Nested Sparse Structures in Deep Neural Networks Eunwoo Kim Chanho Ahn Songhwai Oh 26 2 0 11 Dec 2017
AdaComp : Adaptive Residual Gradient Compression for Data-Parallel Distributed Training Chia-Yu Chen Jungwook Choi D. Brand A. Agrawal Wei Zhang K. Gopalakrishnan ODL 18 173 0 07 Dec 2017
Automated Pruning for Deep Neural Network Compression Franco Manessi A. Rozza Simone Bianco Paolo Napoletano Raimondo Schettini 44 56 0 05 Dec 2017
Learning Sparse Neural Networks through $L_0$ Regularization Christos Louizos Max Welling Diederik P. Kingma 53 1,133 0 04 Dec 2017
Adaptive Quantization for Deep Neural Network Yiren Zhou Seyed-Mohsen Moosavi-Dezfooli Ngai-man Cheung P. Frossard MQ 22 181 0 04 Dec 2017
Homomorphic Parameter Compression for Distributed Deep Learning Training Jaehee Jang Byunggook Na Sungroh Yoon FedML 35 1 0 28 Nov 2017
WSNet: Compact and Efficient Networks Through Weight Sampling Xiaojie Jin Yingzhen Yang N. Xu Jianchao Yang Nebojsa Jojic Jiashi Feng Shuicheng Yan 27 2 0 28 Nov 2017
Slim Embedding Layers for Recurrent Neural Language Models Zhongliang Li Raymond Kulhanek Shaojun Wang Yunxin Zhao Shuang Wu KELM 35 23 0 27 Nov 2017
SkipNet: Learning Dynamic Routing in Convolutional Networks Xin Wang Feng Yu Zi-Yi Dou Trevor Darrell Joseph E. Gonzalez 39 626 0 26 Nov 2017
CondenseNet: An Efficient DenseNet using Learned Group Convolutions Gao Huang Shichen Liu Laurens van der Maaten Kilian Q. Weinberger 50 796 0 25 Nov 2017
Deep Expander Networks: Efficient Deep Networks from Graph Theory Ameya Prabhu G. Varma A. Namboodiri GNN 30 71 0 23 Nov 2017
BlockDrop: Dynamic Inference Paths in Residual Networks Zuxuan Wu Tushar Nagarajan Abhishek Kumar Steven J. Rennie L. Davis Kristen Grauman Rogerio Feris 42 462 0 22 Nov 2017
Shift: A Zero FLOP, Zero Parameter Alternative to Spatial Convolutions Bichen Wu Alvin Wan Xiangyu Yue Peter H. Jin Sicheng Zhao Noah Golmant A. Gholaminejad Joseph E. Gonzalez Kurt Keutzer 3DPC 31 363 0 22 Nov 2017
Evaluating Robustness of Neural Networks with Mixed Integer Programming Vincent Tjeng Kai Y. Xiao Russ Tedrake AAML 52 117 0 20 Nov 2017
Interleaver Design for Deep Neural Networks Sourya Dey Peter A. Beerel K. Chugg 21 6 0 18 Nov 2017
Training Simplification and Model Simplification for Deep Learning: A Minimal Effort Back Propagation Method Xu Sun Xuancheng Ren Shuming Ma Bingzhen Wei Wei Li Jingjing Xu Houfeng Wang Yi Zhang 31 25 0 17 Nov 2017
Improved Bayesian Compression Marco Federici Karen Ullrich Max Welling UQCV BDL 19 19 0 17 Nov 2017
Mobile Video Object Detection with Temporally-Aware Feature Maps Mason Liu Menglong Zhu ObjD 18 196 0 17 Nov 2017
NISP: Pruning Networks using Neuron Importance Score Propagation Ruichi Yu Ang Li Chun-Fu Chen Jui-Hsin Lai Vlad I. Morariu Xintong Han M. Gao Ching-Yung Lin L. Davis 44 795 0 16 Nov 2017
Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy Asit K. Mishra Debbie Marr FedML 38 330 0 15 Nov 2017
Bridging the Gap Between Neural Networks and Neuromorphic Hardware with A Neural Network Compiler Yu Ji Youhui Zhang Wenguang Chen Yuan Xie 35 56 0 15 Nov 2017
PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning Arun Mallya Svetlana Lazebnik CLL 59 1,274 0 15 Nov 2017