SNIP: Single-shot Network Pruning based on Connection Sensitivity

4 October 2018

Namhoon Lee

Thalaiyasingam Ajanthan

Philip Torr

VLM

ArXiv PDF HTML

Papers citing "SNIP: Single-shot Network Pruning based on Connection Sensitivity"

50 / 709 papers shown

Title
Pruning's Effect on Generalization Through the Lens of Training and Regularization Tian Jin Michael Carbin Daniel M. Roy Jonathan Frankle Gintare Karolina Dziugaite 31 29 0 25 Oct 2022
Pushing the Efficiency Limit Using Structured Sparse Convolutions Vinay Kumar Verma Nikhil Mehta Shijing Si Ricardo Henao Lawrence Carin 25 3 0 23 Oct 2022
Compressing Explicit Voxel Grid Representations: fast NeRFs become also small C. Deng Enzo Tartaglione GNN 36 52 0 23 Oct 2022
PATS: Sensitivity-aware Noisy Learning for Pretrained Language Models Yupeng Zhang Hongzhi Zhang Sirui Wang Wei Wu Zhoujun Li AAML 37 1 0 22 Oct 2022
Extensible Proxy for Efficient NAS Yuhong Li Jiajie Li Cong Han P. Li Jinjun Xiong De-huai Chen 20 1 0 17 Oct 2022
Parameter-Efficient Masking Networks Yue Bai Huan Wang Xu Ma Yitian Zhang Zhiqiang Tao Yun Fu 31 10 0 13 Oct 2022
Structural Pruning via Latency-Saliency Knapsack Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez 39 48 0 13 Oct 2022
Towards Theoretically Inspired Neural Initialization Optimization Yibo Yang Hong Wang Haobo Yuan Zhouchen Lin 32 9 0 12 Oct 2022
Shapley Head Pruning: Identifying and Removing Interference in Multilingual Transformers William B. Held Diyi Yang VLM 45 5 0 11 Oct 2022
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters Shwai He Liang Ding Daize Dong Miao Zhang Dacheng Tao MoE 37 87 0 09 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 58 68 0 08 Oct 2022
NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxies Arjun Krishnakumar Colin White Arber Zela Renbo Tu Mahmoud Safari Frank Hutter 55 40 0 06 Oct 2022
Unmasking the Lottery Ticket Hypothesis: What's Encoded in a Winning Ticket's Mask? Mansheej Paul F. Chen Brett W. Larsen Jonathan Frankle Surya Ganguli Gintare Karolina Dziugaite UQCV 47 38 0 06 Oct 2022
Why Random Pruning Is All We Need to Start Sparse Advait Gadhikar Sohom Mukherjee R. Burkholz 43 19 0 05 Oct 2022
Siamese-NAS: Using Trained Samples Efficiently to Find Lightweight Neural Architecture by Prior Knowledge Yumeng Zhang J. Hsieh Chun-Chieh Lee Kuo-Chin Fan 36 0 0 02 Oct 2022
Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel Sungyub Kim Si-hun Park Kyungsu Kim Eunho Yang BDL 32 4 0 30 Sep 2022
Is Complexity Required for Neural Network Pruning? A Case Study on Global Magnitude Pruning Manas Gupta Efe Camci Vishandi Rudy Keneta Abhishek Vaidyanathan Ritwik Kanodia Chuan-Sheng Foo Wu Min Lin Jie 25 14 0 29 Sep 2022
Neural Network Panning: Screening the Optimal Sparse Network Before Training Xiatao Kang P. Li Jiayi Yao Chengxi Li VLM 23 1 0 27 Sep 2022
Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training Geng Yuan Yanyu Li Sheng Li Zhenglun Kong Sergey Tulyakov Xulong Tang Yanzhi Wang Jian Ren 35 15 0 22 Sep 2022
EPIC TTS Models: Empirical Pruning Investigations Characterizing Text-To-Speech Models Perry Lam Huayun Zhang Nancy F. Chen Berrak Sisman 21 2 0 22 Sep 2022
SparCL: Sparse Continual Learning on the Edge Zifeng Wang Zheng Zhan Yifan Gong Geng Yuan Wei Niu T. Jian Bin Ren Stratis Ioannidis Yanzhi Wang Jennifer Dy CLL 63 60 0 20 Sep 2022
Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions M. Tukan Loay Mualem Alaa Maalouf 3DPC 55 22 0 18 Sep 2022
Training Recipe for N:M Structured Sparsity with Decaying Pruning Mask Sheng-Chun Kao Amir Yazdanbakhsh Suvinay Subramanian Shivani Agrawal Utku Evci T. Krishna 55 12 0 15 Sep 2022
Optimizing Connectivity through Network Gradients for Restricted Boltzmann Machines A. C. N. D. Oliveira Daniel R. Figueiredo 32 0 0 14 Sep 2022
One-shot Network Pruning at Initialization with Discriminative Image Patches Yinan Yang Yu Wang Yi Ji Heng Qi Jien Kato VLM 34 4 0 13 Sep 2022
Towards Sparsification of Graph Neural Networks Hongwu Peng Deniz Gurevin Shaoyi Huang Tong Geng Weiwen Jiang O. Khan Caiwen Ding GNN 30 24 0 11 Sep 2022
Symmetric Pruning in Quantum Neural Networks Xinbiao Wang Junyu Liu Tongliang Liu Yong Luo Yuxuan Du Dacheng Tao 39 24 0 30 Aug 2022
Complexity-Driven CNN Compression for Resource-constrained Edge AI Muhammad Zawish Steven Davy L. Abraham 41 16 0 26 Aug 2022
SVD-NAS: Coupling Low-Rank Approximation and Neural Architecture Search Zhewen Yu C. Bouganis 37 5 0 22 Aug 2022
Memristive Computing for Efficient Inference on Resource Constrained Devices Venkatesh Rammamoorthy Geng Zhao B. Reddy Ming-Yang Lin 14 0 0 21 Aug 2022
Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise Yihao Xue Kyle Whitecross Baharan Mirzasoleiman NoLa 33 1 0 17 Aug 2022
Remote Photoplethysmography from Low Resolution videos: An end-to-end solution using Efficient ConvNets Bharath Ramakrishnan Ruijian Deng CVBM 3DH 13 0 0 14 Aug 2022
WeightMom: Learning Sparse Networks using Iterative Momentum-based pruning Elvis Johnson Xiao-Ming Tang Sriramacharyulu Samudrala 22 1 0 11 Aug 2022
Visual Heart Rate Estimation from RGB Facial Video using Spectral Reflectance Bharath Ramakrishnan Ruijia Deng Hassan Ali CVBM 12 0 0 09 Aug 2022
N2NSkip: Learning Highly Sparse Networks using Neuron-to-Neuron Skip Connections Arvind Subramaniam Avinash Sharma 9 17 0 07 Aug 2022
Trainability Preserving Neural Pruning Huan Wang Yun Fu AAML 22 17 0 25 Jul 2022
FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classification Xiao-Ze Lin Seungbae Kim Jungseock Joo CVBM 44 38 0 22 Jul 2022
Doge Tickets: Uncovering Domain-general Language Models by Playing Lottery Tickets Yi Yang Chen Zhang Benyou Wang Dawei Song LRM 31 6 0 20 Jul 2022
To update or not to update? Neurons at equilibrium in deep models Andrea Bragagnolo Enzo Tartaglione Marco Grangetto 38 10 0 19 Jul 2022
On the Robustness and Anomaly Detection of Sparse Neural Networks Morgane Ayle Bertrand Charpentier John Rachwan Daniel Zügner Simon Geisler Stephan Günnemann AAML 63 3 0 09 Jul 2022
Exploring Lottery Ticket Hypothesis in Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Ruokai Yin Priyadarshini Panda 37 46 0 04 Jul 2022
PrUE: Distilling Knowledge from Sparse Teacher Networks Shaopu Wang Xiaojun Chen Mengzhen Kou Jinqiao Shi 30 2 0 03 Jul 2022
Training Your Sparse Neural Network Better with Any Mask Ajay Jaiswal Haoyu Ma Tianlong Chen Ying Ding Zhangyang Wang CVBM 34 35 0 26 Jun 2022
PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance Qingru Zhang Simiao Zuo Chen Liang Alexander Bukharin Pengcheng He Weizhu Chen T. Zhao 27 78 0 25 Jun 2022
Winning the Lottery Ahead of Time: Efficient Early Network Pruning John Rachwan Daniel Zügner Bertrand Charpentier Simon Geisler Morgane Ayle Stephan Günnemann 32 24 0 21 Jun 2022
The State of Sparse Training in Deep Reinforcement Learning L. Graesser Utku Evci Erich Elsen Pablo Samuel Castro OffRL 17 34 0 17 Jun 2022
FreeREA: Training-Free Evolution-based Architecture Search Niccolò Cavagnero Luc Robbiano Barbara Caputo Giuseppe Averta 25 19 0 17 Jun 2022
Sparse Double Descent: Where Network Pruning Aggravates Overfitting Zhengqi He Zeke Xie Quanzhi Zhu Zengchang Qin 86 27 0 17 Jun 2022
"Understanding Robustness Lottery": A Geometric Visual Comparative Analysis of Neural Network Pruning Approaches Zhimin Li Shusen Liu Xin Yu Kailkhura Bhavya Jie Cao Diffenderfer James Daniel P. Bremer Valerio Pascucci AAML 34 1 0 16 Jun 2022
Can pruning improve certified robustness of neural networks? Zhangheng Li Tianlong Chen Linyi Li Bo Li Zhangyang Wang AAML 24 12 0 15 Jun 2022