Importance Estimation for Neural Network Pruning

25 June 2019

Papers citing "Importance Estimation for Neural Network Pruning"

50 / 439 papers shown

Title
SOSP: Efficiently Capturing Global Correlations by Second-Order Structured Pruning Manuel Nonnenmacher Thomas Pfeil Ingo Steinwart David Reeb 11 24 0 19 Oct 2021
A Dimensionality Reduction Approach for Convolutional Neural Networks L. Meneghetti N. Demo G. Rozza 93 14 0 18 Oct 2021
S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks Shiyu Liu Chong Min John Tan Mehul Motani CLL 29 4 0 17 Oct 2021
GradSign: Model Performance Inference with Theoretical Insights Zhihao Zhang Zhihao Jia 33 22 0 16 Oct 2021
Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction Sara Elkerdawy Mostafa Elhoushi Hong Zhang Nilanjan Ray CVBM 31 37 0 15 Oct 2021
Joint Channel and Weight Pruning for Model Acceleration on Moblie Devices Tianli Zhao Xi Sheryl Zhang Wentao Zhu Jiaxing Wang Sen Yang Ji Liu Jian Cheng 56 2 0 15 Oct 2021
Global Vision Transformer Pruning with Hessian-Aware Saliency Huanrui Yang Hongxu Yin Maying Shen Pavlo Molchanov Hai Helen Li Jan Kautz ViT 30 39 0 10 Oct 2021
Neural network relief: a pruning algorithm based on neural activity Aleksandr Dekhovich David Tax M. Sluiter Miguel A. Bessa 46 10 0 22 Sep 2021
Learning Versatile Convolution Filters for Efficient Visual Recognition Kai Han Yunhe Wang Chang Xu Chunjing Xu Enhua Wu Dacheng Tao 21 8 0 20 Sep 2021
TrAISformer -- A Transformer Network with Sparse Augmented Data Representation and Cross Entropy Loss for AIS-based Vessel Trajectory Prediction Duong Nguyen Ronan Fablet 21 24 0 08 Sep 2021
FIDNet: LiDAR Point Cloud Semantic Segmentation with Fully Interpolation Decoding Yiming Zhao Lin Bai Xinming Huang 3DV 3DPC 26 55 0 08 Sep 2021
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization Yi Guo Huan Yuan Jianchao Tan Zhangyang Wang Sen Yang Ji Liu 23 46 0 06 Sep 2021
Pruning with Compensation: Efficient Channel Pruning for Deep Convolutional Neural Networks Zhouyang Xie Yan Fu Sheng-Zhao Tian Junlin Zhou Duanbing Chen 3DV 15 0 0 31 Aug 2021
AIP: Adversarial Iterative Pruning Based on Knowledge Transfer for Convolutional Neural Networks Jingfei Chang Yang Lu Ping Xue Yiqun Xu Zhen Wei 22 0 0 31 Aug 2021
T3-Vis: a visual analytic framework for Training and fine-Tuning Transformers in NLP Raymond Li Wen Xiao Lanjun Wang Hyeju Jang Giuseppe Carenini ViT 31 23 0 31 Aug 2021
Full-Cycle Energy Consumption Benchmark for Low-Carbon Computer Vision Bo-wen Li Xinyang Jiang Donglin Bai Yuge Zhang Ningxin Zheng Xuanyi Dong Lu Liu Yuqing Yang Dongsheng Li 14 10 0 30 Aug 2021
Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions Yang Wu Dingheng Wang Xiaotong Lu Fan Yang Guoqi Li W. Dong Jianbo Shi 29 18 0 30 Aug 2021
Compact representations of convolutional neural networks via weight pruning and quantization Giosuè Cataldo Marinò A. Petrini D. Malchiodi Marco Frasca MQ 21 4 0 28 Aug 2021
Layer-wise Model Pruning based on Mutual Information Chun Fan Jiwei Li Xiang Ao Fei Wu Yuxian Meng Xiaofei Sun 46 19 0 28 Aug 2021
Image-free single-pixel segmentation Haiyang Liu Liheng Bian Jun Zhang 3DV SSeg 8 14 0 24 Aug 2021
An Information Theory-inspired Strategy for Automatic Network Pruning Xiawu Zheng Yuexiao Ma Teng Xi Gang Zhang Errui Ding Yuchao Li Jie Chen Yonghong Tian Rongrong Ji 31 13 0 19 Aug 2021
perf4sight: A toolflow to model CNN training performance on Edge GPUs A. Rajagopal C. Bouganis 23 7 0 12 Aug 2021
Basis Scaling and Double Pruning for Efficient Inference in Network-Based Transfer Learning Ken C. L. Wong Satyananda Kashyap Mehdi Moradi 22 2 0 06 Aug 2021
Generalizable Mixed-Precision Quantization via Attribution Rank Preservation Ziwei Wang Han Xiao Jiwen Lu Jie Zhou MQ 22 32 0 05 Aug 2021
Group Fisher Pruning for Practical Network Compression Liyang Liu Shilong Zhang Zhanghui Kuang Aojun Zhou Jingliang Xue Xinjiang Wang Yimin Chen Wenming Yang Q. Liao Wayne Zhang 25 146 0 02 Aug 2021
Compressing Neural Networks: Towards Determining the Optimal Layer-wise Decomposition Lucas Liebenwein Alaa Maalouf O. Gal Dan Feldman Daniela Rus 37 46 0 23 Jul 2021
LANA: Latency Aware Network Acceleration Pavlo Molchanov Jimmy Hall Hongxu Yin Jan Kautz Nicolò Fusi Arash Vahdat 25 11 0 12 Jul 2021
Blending Pruning Criteria for Convolutional Neural Networks Wei He Zhongzhan Huang Mingfu Liang Senwei Liang Haizhao Yang CVBM 17 13 0 11 Jul 2021
Image Complexity Guided Network Compression for Biomedical Image Segmentation Suraj Mishra Danny Chen X. Sharon 37 6 0 06 Jul 2021
Dep- $L_0$ : Improving $L_0$ -based Network Sparsification via Dependency Modeling Yang Li Shihao Ji 15 1 0 30 Jun 2021
Bayesian Deep Learning Hyperparameter Search for Robust Function Mapping to Polynomials with Noise Nidhin Harilal Udit Bhatia A. Ganguly OOD 14 0 0 23 Jun 2021
Sparse Training via Boosting Pruning Plasticity with Neuroregeneration Shiwei Liu Tianlong Chen Xiaohan Chen Zahra Atashgahi Lu Yin Huanyu Kou Li Shen Mykola Pechenizkiy Zhangyang Wang Decebal Constantin Mocanu 40 111 0 19 Jun 2021
PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition Cheng-I Jeff Lai Yang Zhang Alexander H. Liu Shiyu Chang Yi-Lun Liao Yung-Sung Chuang Kaizhi Qian Sameer Khurana David D. Cox James R. Glass VLM 66 70 0 10 Jun 2021
Chasing Sparsity in Vision Transformers: An End-to-End Exploration Tianlong Chen Yu Cheng Zhe Gan Lu Yuan Lei Zhang Zhangyang Wang ViT 18 216 0 08 Jun 2021
Dynamic Sparse Training for Deep Reinforcement Learning Ghada Sokar Elena Mocanu Decebal Constantin Mocanu Mykola Pechenizkiy Peter Stone 23 52 0 08 Jun 2021
Towards Compact CNNs via Collaborative Compression Yuchao Li Shaohui Lin Jianzhuang Liu QiXiang Ye Mengdi Wang Rongrong Ji Fan Yang Jincheng Ma Qi Tian Rongrong Ji 3DV 27 87 0 24 May 2021
AirNet: Neural Network Transmission over the Air Mikolaj Jankowski Deniz Gunduz K. Mikolajczyk 68 1 0 24 May 2021
Compressing Deep CNNs using Basis Representation and Spectral Fine-tuning M. Tayyab Fahad A Khan Abhijit Mahalanobis 3DPC 11 1 0 21 May 2021
Troubleshooting Blind Image Quality Models in the Wild Zhihua Wang Haotao Wang Tianlong Chen Zhangyang Wang Kede Ma 15 19 0 14 May 2021
Network Pruning That Matters: A Case Study on Retraining Variants Duong H. Le Binh-Son Hua 24 41 0 07 May 2021
Width Transfer: On the (In)variance of Width Optimization Ting-Wu Chin Diana Marculescu Ari S. Morcos 13 3 0 24 Apr 2021
Compact CNN Structure Learning by Knowledge Distillation Waqar Ahmed Andrea Zunino Pietro Morerio Vittorio Murino 30 5 0 19 Apr 2021
Accelerating Sparse Deep Neural Networks Asit K. Mishra J. Latorre Jeff Pool Darko Stosic Dusan Stosic Ganesh Venkatesh Chong Yu Paulius Micikevicius 16 221 0 16 Apr 2021
Fruit Quality and Defect Image Classification with Conditional GAN Data Augmentation Jordan J. Bird Chloe M. Barnes Luis J. Manso Anikó Ekárt Diego Resende Faria 14 95 0 12 Apr 2021
Extremely Low Footprint End-to-End ASR System for Smart Device Zhifu Gao Yiwu Yao Shiliang Zhang Jun Yang Ming Lei Ian Mcloughlin 16 12 0 06 Apr 2021
Bit-Mixer: Mixed-precision networks with runtime bit-width selection Adrian Bulat Georgios Tzimiropoulos MQ 26 27 0 31 Mar 2021
Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation Zixiang Zhou Yang Zhang H. Foroosh 3DPC 32 124 0 27 Mar 2021
n-hot: Efficient bit-level sparsity for powers-of-two neural network quantization Yuiko Sakuma Hiroshi Sumihiro Jun Nishikawa Toshiki Nakamura Ryoji Ikegaya MQ 40 1 0 22 Mar 2021
Toward Compact Deep Neural Networks via Energy-Aware Pruning Seul-Ki Yeom Kyung-Hwan Shim Jee-Hyun Hwang CVBM 28 12 0 19 Mar 2021
Data-free mixed-precision quantization using novel sensitivity metric Donghyun Lee M. Cho Seungwon Lee Joonho Song Changkyu Choi MQ 19 2 0 18 Mar 2021