v1v2v3v4v5 (latest)

Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding

1 October 2015

Song Han

Papers citing "Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding"

50 / 3,481 papers shown

Title
BLOOM-Net: Blockwise Optimization for Masking Networks Toward Scalable and Efficient Speech Enhancement Sunwoo Kim Minje Kim 124 5 0 17 Nov 2021
LVAC: Learned Volumetric Attribute Compression for Point Clouds using Coordinate Based Networks Berivan Isik P. Chou S. Hwang Nick Johnston G. Toderici 3DPC 102 29 0 17 Nov 2021
$Frequency learning for structured CNN filters with Gaussian fractional derivatives$ Frequency learning for structured CNN filters with Gaussian fractional derivatives Nikhil Saldanha S. Pintea Jan van Gemert Nergis Tomen 59 8 0 12 Nov 2021
Nonlinear Tensor Ring Network Xiao Peng Li Qi Liu Hayden Kwok-Hay So 48 0 0 12 Nov 2021
FedGreen: Federated Learning with Fine-Grained Gradient Compression for Green Mobile Edge Computing Peichun Li Xumin Huang Miao Pan Rong Yu 86 16 0 11 Nov 2021
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI Jiangchao Yao Shengyu Zhang Yang Yao Feng Wang Jianxin Ma ... Kun Kuang Chao-Xiang Wu Leilei Gan Jingren Zhou Hongxia Yang 169 103 0 11 Nov 2021
Self-Compression in Bayesian Neural Networks Giuseppina Carannante Dimah Dera Ghulam Rasool N. Bouaynaya UQCV BDL 76 5 0 10 Nov 2021
Efficient Neural Network Training via Forward and Backward Propagation Sparsification Xiao Zhou Weizhong Zhang Zonghao Chen Shizhe Diao Tong Zhang 99 46 0 10 Nov 2021
Phantom: A High-Performance Computational Core for Sparse Convolutional Neural Networks Mahmood Azhar Qureshi Arslan Munir 89 0 0 09 Nov 2021
ML-EXray: Visibility into ML Deployment on the Edge Hang Qiu Ioanna Vavelidou Jian Li Evgenya Pergament Pete Warden Sandeep P. Chinchali Zain Asgar Sachin Katti 49 8 0 08 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 203 84 0 08 Nov 2021
Oracle Teacher: Leveraging Target Information for Better Knowledge Distillation of CTC Models J. Yoon H. Kim Hyeon Seung Lee Sunghwan Ahn N. Kim 75 1 0 05 Nov 2021
Branch and Bound in Mixed Integer Linear Programming Problems: A Survey of Techniques and Trends Lingying Huang Xiaomeng Chen Wei Huo Jiazheng Wang Fan Zhang Bo Bai Ling Shi 60 24 0 05 Nov 2021
Qimera: Data-free Quantization with Synthetic Boundary Supporting Samples Kanghyun Choi Deokki Hong Noseong Park Youngsok Kim Jinho Lee MQ 71 67 0 04 Nov 2021
Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directions Huy P Phan Kaare B. Mikkelsen 81 96 0 03 Nov 2021
Communication-Efficient Separable Neural Network for Distributed Inference on Edge Devices Jun-Liang Lin Sheng-De Wang 42 0 0 03 Nov 2021
Weight, Block or Unit? Exploring Sparsity Tradeoffs for Speech Enhancement on Tiny Neural Accelerators Marko Stamenovic Nils L. Westhausen Li-Chia Yang Carl R. Jensen Alex Pawlicki 75 11 0 03 Nov 2021
Multi-Glimpse Network: A Robust and Efficient Classification Architecture based on Recurrent Downsampled Attention S. Tan Runpei Dong Kaisheng Ma 83 2 0 03 Nov 2021
SmartSplit: Latency-Energy-Memory Optimisation for CNN Splitting on Smartphone Environment I. Prakash Aniruddh Bansal Rohit Verma R. Shorey 88 8 0 01 Nov 2021
Learning Pruned Structure and Weights Simultaneously from Scratch: an Attention based Approach Qisheng He Weisong Shi Ming Dong 73 3 0 01 Nov 2021
DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models Xuxi Chen Tianlong Chen Weizhu Chen Ahmed Hassan Awadallah Zhangyang Wang Yu Cheng MoE ALM 63 10 0 30 Oct 2021
BitTrain: Sparse Bitmap Compression for Memory-Efficient Training on the Edge Abdelrahman I. Hosny Marina Neseem Sherief Reda MQ 112 4 0 29 Oct 2021
Gabor filter incorporated CNN for compression Akihiro Imamura N. Arizumi CVBM 52 2 0 29 Oct 2021
MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning Ji Lin Wei-Ming Chen Han Cai Chuang Gan Song Han 109 161 0 28 Oct 2021
Computational Intelligence and Deep Learning for Next-Generation Edge-Enabled Industrial IoT Shunpu Tang Lunyuan Chen Junjuan Xia Lisheng Fan A. Nallanathan 76 106 0 28 Oct 2021
MERCURY: Accelerating DNN Training By Exploiting Input Similarity Vahid Janfaza Kevin Weston Moein Razavi Shantanu Mandal Farabi Mahmud Alex Hilty A. Muzahid 76 5 0 28 Oct 2021
Pipeline Parallelism for Inference on Heterogeneous Edge Computing Yang Hu Connor Imes Xuanang Zhao Souvik Kundu Peter A. Beerel S. Crago J. Walters MoE 156 20 0 28 Oct 2021
Generalized Depthwise-Separable Convolutions for Adversarially Robust and Efficient Neural Networks Hassan Dbouk Naresh R Shanbhag AAML 65 7 0 28 Oct 2021
L2ight: Enabling On-Chip Learning for Optical Neural Networks via Efficient in-situ Subspace Optimization Jiaqi Gu Hanqing Zhu Chenghao Feng Zixuan Jiang Ray T. Chen David Z. Pan 67 30 0 27 Oct 2021
Masked LARk: Masked Learning, Aggregation and Reporting worKflow Joseph J. Pfeiffer Denis Xavier Charles Davis Gilton Young Hun Jung Mehul Parsana Erik Anderson 74 11 0 27 Oct 2021
Deep learning via message passing algorithms based on belief propagation Carlo Lucibello Fabrizio Pittorino Gabriele Perugini R. Zecchina 130 15 0 27 Oct 2021
Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness Are Found within Randomly Initialized Networks Yonggan Fu Qixuan Yu Yang Zhang Shan-Hung Wu Ouyang Xu David D. Cox Yingyan Lin AAML OOD 150 30 0 26 Oct 2021
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge Geng Yuan Xiaolong Ma Wei Niu Zhengang Li Zhenglun Kong ... Minghai Qin Bin Ren Yanzhi Wang Sijia Liu Xue Lin 119 98 0 26 Oct 2021
CHIP: CHannel Independence-based Pruning for Compact Neural Networks Yang Sui Miao Yin Yi Xie Huy Phan S. Zonouz Bo Yuan VLM 127 134 0 26 Oct 2021
NeRV: Neural Representations for Videos Hao Chen Bo He Hanyu Wang Yixuan Ren Ser-Nam Lim Abhinav Shrivastava 78 256 0 26 Oct 2021
Applications and Techniques for Fast Machine Learning in Science A. Deiana Nhan Tran Joshua C. Agar Michaela Blott G. D. Guglielmo ... Ashish Sharma S. Summers Pietro Vischia J. Vlimant Olivia Weng 98 72 0 25 Oct 2021
Reconstructing Pruned Filters using Cheap Spatial Transformations Roy Miles K. Mikolajczyk 83 0 0 25 Oct 2021
When to Prune? A Policy towards Early Structural Pruning Maying Shen Pavlo Molchanov Hongxu Yin J. Álvarez VLM 85 56 0 22 Oct 2021
Supporting Massive DLRM Inference Through Software Defined Memory E. K. Ardestani Changkyu Kim Seung Jae Lee Luoshang Pan Valmiki Rampersad ... Krishnakumar Nair Maxim Naumov Christopher Peterson M. Smelyanskiy Vijay Rao BDL 82 21 0 21 Oct 2021
QuantumNAT: Quantum Noise-Aware Training with Noise Injection, Quantization and Normalization Hanrui Wang Jiaqi Gu Yongshan Ding Zi-Chen Li Frederic T. Chong David Z. Pan Song Han 135 66 0 21 Oct 2021
Improving the Deployment of Recycling Classification through Efficient Hyper-Parameter Analysis Mazin Abdulmahmood R. Grammenos 24 2 0 21 Oct 2021
FedGEMS: Federated Learning of Larger Server Models via Selective Knowledge Fusion Sijie Cheng Jingwen Wu Yanghua Xiao Yang Liu Yang Liu FedML 60 68 0 21 Oct 2021
CATRO: Channel Pruning via Class-Aware Trace Ratio Optimization Wenzheng Hu Zhengping Che Ning Liu Mingyang Li Jian Tang Changshui Zhang Jianqiang Wang 65 23 0 21 Oct 2021
Evolving Transferable Neural Pruning Functions Yuchen Liu S. Kung D. Wentzlaff 67 1 0 21 Oct 2021
Class-Discriminative CNN Compression Yuchen Liu D. Wentzlaff S. Kung 61 1 0 21 Oct 2021
HALP: Hardware-Aware Latency Pruning Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez VLM 81 14 0 20 Oct 2021
A TinyML Platform for On-Device Continual Learning with Quantized Latent Replays Leonardo Ravaglia Manuele Rusci D. Nadalini Alessandro Capotondi Francesco Conti Luca Benini BDL 114 68 0 20 Oct 2021
EBJR: Energy-Based Joint Reasoning for Adaptive Inference Mohammad Akbari Amin Banitalebi-Dehkordi Yong Zhang BDL MQ 87 7 0 20 Oct 2021
When in Doubt, Summon the Titans: Efficient Inference with Large Models A. S. Rawat Manzil Zaheer A. Menon Amr Ahmed Sanjiv Kumar 61 7 0 19 Oct 2021
Adaptive Distillation: Aggregating Knowledge from Multiple Paths for Efficient Distillation Sumanth Chennupati Mohammad Mahdi Kamani Zhongwei Cheng Lin Chen 76 4 0 19 Oct 2021