v1v2v3v4v5 (latest)

Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding

1 October 2015

Song Han

Papers citing "Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding"

50 / 3,481 papers shown

Title
Small Character Models Match Large Word Models for Autocomplete Under Memory Constraints Ganesh Jawahar Subhabrata Mukherjee Debadeepta Dey Muhammad Abdul-Mageed L. Lakshmanan C. C. T. Mendes Gustavo de Rosa S. Shah 46 0 0 06 Oct 2022
Communication-Efficient and Drift-Robust Federated Learning via Elastic Net Seonhyeon Kim Jiheon Woo Daewon Seo Yongjune Kim FedML 100 1 0 06 Oct 2022
Revisiting Structured Dropout Yiren Zhao Oluwatomisin Dada Xitong Gao Robert D. Mullins BDL 75 2 0 05 Oct 2022
Streaming Video Analytics On The Edge With Asynchronous Cloud Support Anurag Ghosh Srinivasan Iyengar Stephen Lee Anuj Rathore Venkat N. Padmanabhan 74 2 0 04 Oct 2022
spred: Solving $L_1$ Penalty with SGD Liu Ziyin Zihao Wang 123 16 0 03 Oct 2022
Limitations of neural network training due to numerical instability of backpropagation Clemens Karner V. Kazeev P. Petersen 91 3 0 03 Oct 2022
EAPruning: Evolutionary Pruning for Vision Transformers and CNNs Qingyuan Li Bo Zhang Xiangxiang Chu ViT VLM 67 3 0 01 Oct 2022
Diving into Unified Data-Model Sparsity for Class-Imbalanced Graph Representation Learning Chunhui Zhang Chao Huang Yijun Tian Qianlong Wen Z. Ouyang Youhuan Li Yanfang Ye Chuxu Zhang 69 8 0 01 Oct 2022
Compressed Gastric Image Generation Based on Soft-Label Dataset Distillation for Medical Data Sharing Guang Li Ren Togo Takahiro Ogawa Miki Haseyama DD 98 43 0 29 Sep 2022
$Physics-aware Differentiable Discrete Codesign for Diffractive Optical Neural Networks$ Physics-aware Differentiable Discrete Codesign for Diffractive Optical Neural Networks Yingjie Li Ruiyang Chen Weilu Gao Cunxi Yu 82 12 0 28 Sep 2022
Adaptive Sparse ViT: Towards Learnable Adaptive Token Pruning by Fully Exploiting Self-Attention Xiangcheng Liu Tianyi Wu Guodong Guo ViT 139 31 0 28 Sep 2022
Sauron U-Net: Simple automated redundancy elimination in medical image segmentation via filter pruning Juan Miguel Valverde Artem Shatillo Jussi Tohka AAML 71 6 0 27 Sep 2022
Neural Network Panning: Screening the Optimal Sparse Network Before Training Xiatao Kang P. Li Jiayi Yao Chengxi Li VLM 55 1 0 27 Sep 2022
Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models Xiuying Wei Yunchen Zhang Xiangguo Zhang Ruihao Gong Shanghang Zhang Qi Zhang F. Yu Xianglong Liu MQ 164 153 0 27 Sep 2022
Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training Geng Yuan Yanyu Li Sheng Li Zhenglun Kong Sergey Tulyakov Xulong Tang Yanzhi Wang Jian Ren 86 16 0 22 Sep 2022
Deep Learning on Home Drone: Searching for the Optimal Architecture Alaa Maalouf Yotam Gurfinkel Barak Diker O. Gal Daniela Rus Dan Feldman 69 5 0 21 Sep 2022
State-driven Implicit Modeling for Sparsity and Robustness in Neural Networks Alicia Y. Tsai Juliette Decugis L. Ghaoui Alper Atamtürk 94 3 0 19 Sep 2022
Tree-based Text-Vision BERT for Video Search in Baidu Video Advertising Tan Yu Jie Liu Yi Yang Yi Li Hongliang Fei Ping Li 73 1 0 19 Sep 2022
Enabling Conversational Interaction with Mobile UI using Large Language Models Bryan Wang Gang Li Yang Li 219 146 0 18 Sep 2022
Improving the Performance of DNN-based Software Services using Automated Layer Caching M. Abedi Yanni Iouannou Pooyan Jamshidi Hadi Hemmati 70 0 0 18 Sep 2022
Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions M. Tukan Loay Mualem Alaa Maalouf 3DPC 80 23 0 18 Sep 2022
Learning to Weight Samples for Dynamic Early-exiting Networks Yizeng Han Yifan Pu Zihang Lai Chaofei Wang S. Song Junfen Cao Wenhui Huang Chao Deng Gao Huang 123 57 0 17 Sep 2022
PPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimation Haoyu Ma Zhe Wang Yifei Chen Deying Kong Liangjian Chen Xingwei Liu Xiangyi Yan Hao Tang Xiaohui Xie ViT 87 48 0 16 Sep 2022
Self-Attentive Pooling for Efficient Deep Learning Fang Chen Gourav Datta Souvik Kundu Peter A. Beerel 150 6 0 16 Sep 2022
Training Recipe for N:M Structured Sparsity with Decaying Pruning Mask Sheng-Chun Kao Amir Yazdanbakhsh Suvinay Subramanian Shivani Agrawal Utku Evci T. Krishna 132 12 0 15 Sep 2022
MSREP: A Fast yet Light Sparse Matrix Framework for Multi-GPU Systems Jieyang Chen Chenhao Xie J. Firoz Jiajia Li Shuaiwen Leon Song Kevin J. Barker Mark Raugas Ang Li 66 3 0 15 Sep 2022
Neural Networks Reduction via Lumping Dalila Ressi Riccardo Romanello S. Rossi Carla Piazza 84 4 0 15 Sep 2022
Efficient Quantized Sparse Matrix Operations on Tensor Cores Shigang Li Kazuki Osawa Torsten Hoefler 160 32 0 14 Sep 2022
Federated Pruning: Improving Neural Network Efficiency with Federated Learning Rongmei Lin Yonghui Xiao Tien-Ju Yang Ding Zhao Li Xiong Giovanni Motta Franccoise Beaufays FedML 69 12 0 14 Sep 2022
Sparsity-guided Network Design for Frame Interpolation Tian Ding Luming Liang Zhihui Zhu Tianyi Chen Ilya Zharkov 88 6 0 09 Sep 2022
ApproxTrain: Fast Simulation of Approximate Multipliers for DNN Training and Inference Jing Gong Hassaan Saadat Hasindu Gamaarachchi Haris Javaid X. Hu S. Parameswaran 80 15 0 09 Sep 2022
Seeking Interpretability and Explainability in Binary Activated Neural Networks Benjamin Leblanc Pascal Germain FAtt 119 1 0 07 Sep 2022
Improving the Cross-Lingual Generalisation in Visual Question Answering Farhad Nooralahzadeh Rico Sennrich 102 6 0 07 Sep 2022
Mimose: An Input-Aware Checkpointing Planner for Efficient Training on GPU Jian-He Liao Mingzhen Li Qingxiao Sun Jiwei Hao F. Yu ... Ye Tao Zicheng Zhang Hailong Yang Zhongzhi Luan D. Qian 83 4 0 06 Sep 2022
Low-Power Hardware-Based Deep-Learning Diagnostics Support Case Study Khushal Sethi V. Parmar Manan Suri 43 14 0 03 Sep 2022
Incremental Online Learning Algorithms Comparison for Gesture and Visual Smart Sensors Alessandro Avi Andrea Albanese Davide Brunelli 102 10 0 01 Sep 2022
On Quantizing Implicit Neural Representations Cameron Gordon Shin-Fang Chng L. MacDonald Simon Lucey MQ 90 21 0 01 Sep 2022
ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization Cong Guo Chen Zhang Jingwen Leng Zihan Liu Fan Yang Yun-Bo Liu Minyi Guo Yuhao Zhu MQ 90 60 0 30 Aug 2022
Symmetric Pruning in Quantum Neural Networks Xinbiao Wang Junyu Liu Tongliang Liu Yong Luo Yuxuan Du Dacheng Tao 78 25 0 30 Aug 2022
A Deep Neural Networks ensemble workflow from hyperparameter search to inference leveraging GPU clusters Pierrick Pochelu S. Petiton B. Conche AI4CE 69 3 0 30 Aug 2022
Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation Pedro J. Freire A. Napoli D. A. Ron B. Spinnler M. Anderson W. Schairer T. Bex N. Costa S. Turitsyn Jaroslaw E. Prilepsky 94 29 0 26 Aug 2022
Complexity-Driven CNN Compression for Resource-constrained Edge AI Muhammad Zawish Steven Davy L. Abraham 88 16 0 26 Aug 2022
Anytime-Lidar: Deadline-aware 3D Object Detection Ahmet Soyyigit Shuochao Yao H. Yun 3DPC 52 10 0 25 Aug 2022
Adaptation of MobileNetV2 for Face Detection on Ultra-Low Power Platform Simon Narduzzi Engin Turetken Jean-Philippe Thiran L. A. Dunbar 3DH CVBM 44 1 0 23 Aug 2022
Lottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost Lu Yin Shiwei Liu Fang Meng Tianjin Huang Vlado Menkovski Mykola Pechenizkiy 66 13 0 23 Aug 2022
RIBAC: Towards Robust and Imperceptible Backdoor Attack against Compact DNN Huy Phan Cong Shi Yi Xie Tian-Di Zhang Zhuohang Li Tianming Zhao Jian-Dong Liu Yan Wang Ying-Cong Chen Bo Yuan AAML 82 6 0 22 Aug 2022
Mixed-Precision Neural Networks: A Survey M. Rakka M. Fouda Pramod P. Khargonekar Fadi J. Kurdahi MQ 110 13 0 11 Aug 2022
An Accelerated Doubly Stochastic Gradient Method with Faster Explicit Model Identification Runxue Bao Bin Gu Heng-Chiao Huang 103 18 0 11 Aug 2022
Self-Knowledge Distillation via Dropout Hyoje Lee Yeachan Park Hyun Seo Myung-joo Kang FedML 58 16 0 11 Aug 2022
Safety and Performance, Why not Both? Bi-Objective Optimized Model Compression toward AI Software Deployment Jie Zhu Leye Wang Xiao Han 93 10 0 11 Aug 2022