Importance Estimation for Neural Network Pruning

25 June 2019

Papers citing "Importance Estimation for Neural Network Pruning"

50 / 439 papers shown

Title
Map-and-Conquer: Energy-Efficient Mapping of Dynamic Neural Nets onto Heterogeneous MPSoCs Halima Bouzidi Mohanad Odema Hamza Ouarnoughi Smail Niar Mohammad Abdullah Al Faruque 29 8 0 24 Feb 2023
HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers Chen Liang Haoming Jiang Zheng Li Xianfeng Tang Bin Yin Tuo Zhao VLM 27 24 0 19 Feb 2023
WHC: Weighted Hybrid Criterion for Filter Pruning on Convolutional Neural Networks Shaowu Chen Weize Sun Lei Huang 6 10 0 16 Feb 2023
Towards Optimal Compression: Joint Pruning and Quantization Ben Zandonati Glenn Bucagu Adrian Alan Pol M. Pierini Olya Sirkin Tal Kopetz MQ 22 2 0 15 Feb 2023
EVC: Towards Real-Time Neural Image Compression with Mask Decay G. Wang Jiahao Li Bin Li Yan Lu 22 63 0 10 Feb 2023
Language-Aware Multilingual Machine Translation with Self-Supervised Learning Haoran Xu Jean Maillard Vedanuj Goswami LRM 37 3 0 10 Feb 2023
Utility-based Perturbed Gradient Descent: An Optimizer for Continual Learning Mohamed Elsayed A. R. Mahmood CLL 21 6 0 07 Feb 2023
DepGraph: Towards Any Structural Pruning Gongfan Fang Xinyin Ma Mingli Song Michael Bi Mi Xinchao Wang GNN 91 258 0 30 Jan 2023
Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers Sungmin Cha Sungjun Cho Dasol Hwang Honglak Lee Taesup Moon Moontae Lee MU 38 35 0 27 Jan 2023
Voting from Nearest Tasks: Meta-Vote Pruning of Pre-trained Models for Downstream Tasks Haiyan Zhao Tianyi Zhou Guodong Long Jing Jiang Chengqi Zhang 32 0 0 27 Jan 2023
Low-Rank Winograd Transformation for 3D Convolutional Neural Networks Ziran Qin Mingbao Lin Weiyao Lin 3DPC 28 2 0 26 Jan 2023
Rewarded meta-pruning: Meta Learning with Rewards for Channel Pruning Athul Shibu Abhishek Kumar Heechul Jung Dong-Gyu Lee 17 1 0 26 Jan 2023
PowerQuant: Automorphism Search for Non-Uniform Quantization Edouard Yvinec Arnaud Dapogny Matthieu Cord Kévin Bailly MQ 22 15 0 24 Jan 2023
Tensor Networks Meet Neural Networks: A Survey and Future Perspectives Maolin Wang Y. Pan Zenglin Xu Xiangli Yang Guangxi Li A. Cichocki Andrzej Cichocki 55 19 0 22 Jan 2023
HCE: Improving Performance and Efficiency with Heterogeneously Compressed Neural Network Ensemble Jingchi Zhang Huanrui Yang Hai Helen Li 6 1 0 18 Jan 2023
Learnable Heterogeneous Convolution: Learning both topology and strength Rongzhen Zhao Zhenzhi Wu Qikun Zhang 32 6 0 13 Jan 2023
Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning Huan Wang Can Qin Yue Bai Yun Fu 37 20 0 12 Jan 2023
Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks Shiyu Liu Rohan Ghosh John Tan Chong Min Mehul Motani 37 0 0 09 Dec 2022
Efficient Stein Variational Inference for Reliable Distribution-lossless Network Pruning Yingchun Wang Song Guo Jingcai Guo Weizhan Zhang Yi Tian Xu Jiewei Zhang Yi Liu 21 17 0 07 Dec 2022
Distributed Pruning Towards Tiny Neural Networks in Federated Learning Hong Huang Lan Zhang Chaoyue Sun R. Fang Xiaoyong Yuan Dapeng Wu FedML 16 15 0 05 Dec 2022
On-device Training: A First Overview on Existing Systems Shuai Zhu Thiemo Voigt Jeonggil Ko Fatemeh Rahimian 34 14 0 01 Dec 2022
NeuMap: Neural Coordinate Mapping by Auto-Transdecoder for Camera Localization Shitao Tang Sicong Tang Andrea Tagliasacchi Ping Tan Yasutaka Furukawa 3DPC 25 17 0 21 Nov 2022
A Fair Loss Function for Network Pruning Robbie Meyer Alexander Wong CVBM 24 3 0 18 Nov 2022
Soft Masking for Cost-Constrained Channel Pruning Ryan Humble Maying Shen J. Latorre Eric Darve1 J. Álvarez 22 14 0 04 Nov 2022
Numerical Optimizations for Weighted Low-rank Estimation on Language Model Ting Hua Yen-Chang Hsu Felicity Wang Qiang Lou Yilin Shen Hongxia Jin 27 13 0 02 Nov 2022
Toward domain generalized pruning by scoring out-of-distribution importance Rizhao Cai Haoliang Li Alex C. Kot 19 0 0 25 Oct 2022
OLLA: Optimizing the Lifetime and Location of Arrays to Reduce the Memory Usage of Neural Networks Benoit Steiner Mostafa Elhoushi Jacob Kahn James Hegarty 29 8 0 24 Oct 2022
PATS: Sensitivity-aware Noisy Learning for Pretrained Language Models Yupeng Zhang Hongzhi Zhang Sirui Wang Wei Wu Zhoujun Li AAML 33 1 0 22 Oct 2022
Are You Stealing My Model? Sample Correlation for Fingerprinting Deep Neural Networks Jiyang Guan Jian Liang Ran He AAML MLAU 50 29 0 21 Oct 2022
HesScale: Scalable Computation of Hessian Diagonals Mohamed Elsayed A. R. Mahmood 22 7 0 20 Oct 2022
Structural Pruning via Latency-Saliency Knapsack Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez 37 47 0 13 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 49 68 0 08 Oct 2022
EAPruning: Evolutionary Pruning for Vision Transformers and CNNs Qingyuan Li Bo-Wen Zhang Xiangxiang Chu ViT VLM 27 3 0 01 Oct 2022
Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions M. Tukan Loay Mualem Alaa Maalouf 3DPC 46 22 0 18 Sep 2022
Memory Consistent Unsupervised Off-the-Shelf Model Adaptation for Source-Relaxed Medical Image Segmentation Xiaofeng Liu Fangxu Xing G. El Fakhri Jonghye Woo OOD 37 30 0 16 Sep 2022
Training Recipe for N:M Structured Sparsity with Decaying Pruning Mask Sheng-Chun Kao Amir Yazdanbakhsh Suvinay Subramanian Shivani Agrawal Utku Evci T. Krishna 50 12 0 15 Sep 2022
Neural Networks Reduction via Lumping Dalila Ressi Riccardo Romanello S. Rossi Carla Piazza 35 4 0 15 Sep 2022
Interpretations Steered Network Pruning via Amortized Inferred Saliency Maps Alireza Ganjdanesh Shangqian Gao Heng-Chiao Huang FAtt AAML 27 19 0 07 Sep 2022
Mixed-Precision Neural Networks: A Survey M. Rakka M. Fouda Pramod P. Khargonekar Fadi J. Kurdahi MQ 25 11 0 11 Aug 2022
ZeroFL: Efficient On-Device Training for Federated Learning with Local Sparsity Xinchi Qiu Javier Fernandez-Marques Pedro Gusmão Yan Gao Titouan Parcollet Nicholas D. Lane FedML 55 67 0 04 Aug 2022
A One-Shot Reparameterization Method for Reducing the Loss of Tile Pruning on DNNs Yancheng Li Qingzhong Ai Fumihiko Ino 30 0 0 29 Jul 2022
Trainability Preserving Neural Pruning Huan Wang Yun Fu AAML 22 17 0 25 Jul 2022
FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classification Xiao-Ze Lin Seungbae Kim Jungseock Joo CVBM 37 38 0 22 Jul 2022
Noisy Heuristics NAS: A Network Morphism based Neural Architecture Search using Heuristics Suman Sapkota Binod Bhattarai 24 3 0 10 Jul 2022
SInGE: Sparsity via Integrated Gradients Estimation of Neuron Relevance Edouard Yvinec Arnaud Dapogny Matthieu Cord Kévin Bailly 42 9 0 08 Jul 2022
Pavlov Learning Machines E. Agliari Miriam Aquaro Adriano Barra A. Fachechi Chiara Marullo 11 0 0 02 Jul 2022
Language model compression with weighted low-rank factorization Yen-Chang Hsu Ting Hua Sung-En Chang Qiang Lou Yilin Shen Hongxia Jin 14 93 0 30 Jun 2022
Training Your Sparse Neural Network Better with Any Mask Ajay Jaiswal Haoyu Ma Tianlong Chen Ying Ding Zhangyang Wang CVBM 31 35 0 26 Jun 2022
PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance Qingru Zhang Simiao Zuo Chen Liang Alexander Bukharin Pengcheng He Weizhu Chen T. Zhao 25 78 0 25 Jun 2022
"Understanding Robustness Lottery": A Geometric Visual Comparative Analysis of Neural Network Pruning Approaches Zhimin Li Shusen Liu Xin Yu Kailkhura Bhavya Jie Cao Diffenderfer James Daniel P. Bremer Valerio Pascucci AAML 29 1 0 16 Jun 2022