SNIP: Single-shot Network Pruning based on Connection Sensitivity

4 October 2018

Namhoon Lee

Thalaiyasingam Ajanthan

Philip Torr

VLM

ArXiv PDF HTML

Papers citing "SNIP: Single-shot Network Pruning based on Connection Sensitivity"

50 / 708 papers shown

Title
LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training Xiaoye Qu Daize Dong Xuyang Hu Tong Zhu Weigao Sun Yu-Xi Cheng MoE 95 10 0 24 Nov 2024
Pushing the Limits of Sparsity: A Bag of Tricks for Extreme Pruning Andy Li A. Durrant Milan Markovic Lu Yin Georgios Leontidis Tianlong Chen Lu Yin Georgios Leontidis 75 0 0 20 Nov 2024
FGP: Feature-Gradient-Prune for Efficient Convolutional Layer Pruning Qingsong Lv Jiasheng Sun Sheng Zhou Jiahui Geng Liangcheng Li Yun Gao Sun Qiao Jie Song Jiajun Bu AAML 69 0 0 19 Nov 2024
Electrostatic Force Regularization for Neural Structured Pruning Abdesselam Ferdi A. Taleb-Ahmed A. Nakib Youcef Ferdi 76 1 0 17 Nov 2024
Ghost-Connect Net: A Generalization-Enhanced Guidance For Sparse Deep Networks Under Distribution Shifts Mary Isabelle Wisell Salimeh Yasaei Sekeh 28 0 0 14 Nov 2024
Zeroth-Order Adaptive Neuron Alignment Based Pruning without Re-Training Elia Cunegatti Leonardo Lucio Custode Giovanni Iacca 52 0 0 11 Nov 2024
Finding Strong Lottery Ticket Networks with Genetic Algorithms Philipp Altmann Julian Schonberger Maximilian Zorn Thomas Gabor 32 1 0 07 Nov 2024
Magnitude Pruning of Large Pretrained Transformer Models with a Mixture Gaussian Prior Mingxuan Zhang Y. Sun F. Liang 34 0 0 01 Nov 2024
On the Impact of White-box Deployment Strategies for Edge AI on Latency and Model Performance Jaskirat Singh Bram Adams Ahmed E. Hassan VLM 45 0 0 01 Nov 2024
Chasing Better Deep Image Priors between Over- and Under-parameterization Qiming Wu Xiaohan Chen Yi Ding Zhangyang Wang 67 1 0 31 Oct 2024
Mutual Information Preserving Neural Network Pruning Charles Westphal Stephen Hailes Mirco Musolesi 57 1 0 31 Oct 2024
CoreInfer: Accelerating Large Language Model Inference with Semantics-Inspired Adaptive Sparse Activation Qinsi Wang Saeed Vahidian Hancheng Ye Jianyang Gu Jianyi Zhang Yiran Chen 16 3 0 23 Oct 2024
Beware of Calibration Data for Pruning Large Language Models Yixin Ji Yang Xiang Juntao Li Qingrong Xia Ping Li Xinyu Duan Zhefeng Wang Min Zhang 42 2 0 23 Oct 2024
WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models Jinghan Jia Jiancheng Liu Yihua Zhang Parikshit Ram Nathalie Baracaldo Sijia Liu MU 40 2 0 23 Oct 2024
Towards Understanding the Fragility of Multilingual LLMs against Fine-Tuning Attacks Samuele Poppi Zheng-Xin Yong Yifei He Bobbie Chern Han Zhao Aobo Yang Jianfeng Chi AAML 53 17 0 23 Oct 2024
Small Contributions, Small Networks: Efficient Neural Network Pruning Based on Relative Importance Mostafa Hussien Mahmoud Afifi K. Nguyen M. Cheriet 26 0 0 21 Oct 2024
Towards Optimal Adapter Placement for Efficient Transfer Learning Aleksandra I. Nowak Otniel-Bogdan Mercea Anurag Arnab Jonas Pfeiffer Yann N. Dauphin Utku Evci 40 0 0 21 Oct 2024
Continual Learning in the Frequency Domain Ruiqi Liu Boyu Diao Libo Huang Zijia An Zhulin An Yongjun Xu VLM CLL 36 7 0 09 Oct 2024
Superficial Safety Alignment Hypothesis Jianwei Li Jung-Eun Kim 29 1 0 07 Oct 2024
LPZero: Language Model Zero-cost Proxy Search from Zero Peijie Dong Lujun Li Xiang Liu Zhenheng Tang Xuebo Liu Qiang Wang Xiaowen Chu 183 2 0 07 Oct 2024
Learning Emergence of Interaction Patterns across Independent RL Agents in Multi-Agent Environments Vasanth Reddy Baddam Suat Gumussoy Almuatazbellah Boker Hoda Eldardiry OffRL AI4CE 26 0 0 03 Oct 2024
Value-Based Deep Multi-Agent Reinforcement Learning with Dynamic Sparse Training Pihe Hu Shaolong Li Zhuoran Li L. Pan Longbo Huang 21 0 0 28 Sep 2024
AlterMOMA: Fusion Redundancy Pruning for Camera-LiDAR Fusion Models with Alternative Modality Masking Shiqi Sun Yantao Lu Ning Liu Bo Jiang JinChao Chen Ying Zhang VLM 31 0 0 26 Sep 2024
An Adversarial Perspective on Machine Unlearning for AI Safety Jakub Łucki Boyi Wei Yangsibo Huang Peter Henderson F. Tramèr Javier Rando MU AAML 77 33 0 26 Sep 2024
OStr-DARTS: Differentiable Neural Architecture Search based on Operation Strength Le Yang Ziwei Zheng Yizeng Han Shiji Song Gao Huang Fan Li 26 1 0 22 Sep 2024
OATS: Outlier-Aware Pruning Through Sparse and Low Rank Decomposition Stephen Zhang Vardan Papyan VLM 51 1 0 20 Sep 2024
Green Federated Learning: A new era of Green Aware AI Dipanwita Thakur Antonella Guzzo Giancarlo Fortino Francesco Piccialli AI4CE 48 4 0 19 Sep 2024
Are Sparse Neural Networks Better Hard Sample Learners? Q. Xiao Boqian Wu Lu Yin Christopher Neil Gadzinski Tianjin Huang Mykola Pechenizkiy Decebal Constantin Mocanu 40 1 0 13 Sep 2024
S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training Yuezhou Hu Jun-Jie Zhu Jianfei Chen 45 0 0 13 Sep 2024
NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid Models Yang Xu Huihong Shi Zhongfeng Wang 45 0 0 07 Sep 2024
Learning effective pruning at initialization from iterative pruning Shengkai Liu Yaofeng Cheng Fusheng Zha Wei Guo Lining Sun Zhenshan Bing Chenguang Yang 43 0 0 27 Aug 2024
MONAS: Efficient Zero-Shot Neural Architecture Search for MCUs Ye Qiao Haocheng Xu Yifan Zhang Sitao Huang 53 0 0 26 Aug 2024
A Tighter Complexity Analysis of SparseGPT Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao Song 80 22 0 22 Aug 2024
Mask in the Mirror: Implicit Sparsification Tom Jacobs R. Burkholz 47 3 0 19 Aug 2024
Confident magnitude-based neural network pruning Joaquin Alvarez 45 0 0 08 Aug 2024
AdapMTL: Adaptive Pruning Framework for Multitask Learning Model Mingcan Xiang Steven Jiaxun Tang Qizheng Yang Hui Guan Tongping Liu VLM 39 0 0 07 Aug 2024
Compress and Compare: Interactively Evaluating Efficiency and Behavior Across ML Model Compression Experiments Angie Boggust Venkatesh Sivaraman Yannick Assogba Donghao Ren Dominik Moritz Fred Hohman VLM 58 3 0 06 Aug 2024
Network Fission Ensembles for Low-Cost Self-Ensembles Hojung Lee Jong-Seok Lee UQCV 64 0 0 05 Aug 2024
Efficient Multi-Objective Neural Architecture Search via Pareto Dominance-based Novelty Search An Vo Ngoc Hoang Luong 33 0 0 30 Jul 2024
Pruning Large Language Models with Semi-Structural Adaptive Sparse Training Weiyu Huang Yuezhou Hu Guohao Jian Jun Zhu Jianfei Chen 35 5 0 30 Jul 2024
Toward Efficient Permutation for Hierarchical N:M Sparsity on GPUs Seungmin Yu Xiaodie Yi Hayun Lee Dongkun Shin 32 1 0 30 Jul 2024
Greedy Output Approximation: Towards Efficient Structured Pruning for LLMs Without Retraining Jianwei Li Yijun Dong Qi Lei 32 5 0 26 Jul 2024
Nerva: a Truly Sparse Implementation of Neural Networks Wieger Wesselink Bram Grooten Qiao Xiao Cássio Machado de Campos Mykola Pechenizkiy 40 0 0 24 Jul 2024
HyTAS: A Hyperspectral Image Transformer Architecture Search Benchmark and Analysis Fangqin Zhou Mert Kilickaya Joaquin Vanschoren Ran Piao 27 1 0 23 Jul 2024
Exploring The Neural Burden In Pruned Models: An Insight Inspired By Neuroscience Zeyu Wang Weichen Dai Xiangyu Zhou Ji Qi Yi Zhou 54 0 0 23 Jul 2024
Rapid Switching and Multi-Adapter Fusion via Sparse High Rank Adapters Kartikeya Bhardwaj N. Pandey Sweta Priyadarshi Viswanath Ganapathy Rafael Esteves ... Paul N. Whatmough Risheek Garrepalli M. V. Baalen Harris Teague Markus Nagel MoMe 35 0 0 22 Jul 2024
Reconstruct the Pruned Model without Any Retraining Pingjie Wang Ziqing Fan Shengchao Hu Zhe Chen Yanfeng Wang Yu Wang 50 1 0 18 Jul 2024
MINI-LLM: Memory-Efficient Structured Pruning for Large Language Models Hongrong Cheng Miao Zhang J. Q. Shi 57 2 0 16 Jul 2024
From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients Ajay Jaiswal Lu Yin Zhenyu Zhang Shiwei Liu Jiawei Zhao Yuandong Tian Zhangyang Wang 38 14 0 15 Jul 2024
AdaPI: Facilitating DNN Model Adaptivity for Efficient Private Inference in Edge Computing Tong Zhou Jiahui Zhao Yukui Luo Xi Xie Wujie Wen Caiwen Ding Xiaolin Xu 47 15 0 08 Jul 2024