SNIP: Single-shot Network Pruning based on Connection Sensitivity

4 October 2018

Namhoon Lee

Thalaiyasingam Ajanthan

Philip Torr

VLM

ArXiv PDF HTML

Papers citing "SNIP: Single-shot Network Pruning based on Connection Sensitivity"

50 / 708 papers shown

Title
Sparsest Models Elude Pruning: An Exposé of Pruning's Current Capabilities Stephen Zhang Vardan Papyan 39 0 0 04 Jul 2024
DM3D: Distortion-Minimized Weight Pruning for Lossless 3D Object Detection Kaixin Xu Qingtian Feng Hao Chen Zhe Wang Xue Geng Xulei Yang Min-man Wu Xiaoli Li Weisi Lin 41 0 0 02 Jul 2024
LPViT: Low-Power Semi-structured Pruning for Vision Transformers Kaixin Xu Zhe Wang Chunyun Chen Xue Geng Jie Lin Xulei Yang Min-man Wu Min Wu Xiaoli Li Weisi Lin ViT VLM 51 7 0 02 Jul 2024
Enhancing Accuracy and Parameter-Efficiency of Neural Representations for Network Parameterization Hongjun Choi Jayaraman J. Thiagarajan Ruben Glatt Shusen Liu 48 0 0 29 Jun 2024
FedMap: Iterative Magnitude-Based Pruning for Communication-Efficient Federated Learning Alexander Herzog Robbie Southam Ioannis Mavromatis Aftab Khan 39 0 0 27 Jun 2024
Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMs Ashwinee Panda Berivan Isik Xiangyu Qi Sanmi Koyejo Tsachy Weissman Prateek Mittal MoMe 45 14 0 24 Jun 2024
ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models Yash Akhauri Ahmed F. AbouElhamayed Jordan Dotzel Zhiru Zhang Alexander M Rush Safeen Huda Mohamed S. Abdelfattah 23 2 0 24 Jun 2024
Unlocking the Global Synergies in Low-Rank Adapters Zixi Zhang Cheng Zhang Xitong Gao Robert D. Mullins George A. Constantinides Yiren Zhao 30 0 0 21 Jun 2024
The Heterophilic Snowflake Hypothesis: Training and Empowering GNNs for Heterophilic Graphs Kun Wang Guibin Zhang Xinnan Zhang Junfeng Fang Xun Wu Guohao Li Shirui Pan Wei-Ming Huang Yuxuan Liang 40 4 0 18 Jun 2024
Endor: Hardware-Friendly Sparse Format for Offloaded LLM Inference Donghyeon Joo Ramyad Hadidi S. Feizi Bahar Asgari MQ 33 0 0 17 Jun 2024
DIET: Customized Slimming for Incompatible Networks in Sequential Recommendation Kairui Fu Shengyu Zhang Zheqi Lv Jingyuan Chen Jiwei Li 28 2 0 13 Jun 2024
ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models Xiang Meng Kayhan Behdin Haoyue Wang Rahul Mazumder 42 3 0 12 Jun 2024
Understanding Inhibition Through Maximally Tense Images Chris Hamblin Srijani Saha Talia Konkle George Alvarez FAtt 40 0 0 08 Jun 2024
Optimal Eye Surgeon: Finding Image Priors through Sparse Generators at Initialization Avrajit Ghosh Xitong Zhang Kenneth K. Sun Qing Qu S. Ravishankar Rongrong Wang MedIm 43 5 0 07 Jun 2024
Federated LoRA with Sparse Communication Kevin Kuo Arian Raje Kousik Rajesh Virginia Smith 46 8 0 07 Jun 2024
Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models Peijie Dong Lujun Li Zhenheng Tang Xiang Liu Xinglin Pan Qiang-qiang Wang Xiaowen Chu 65 23 0 05 Jun 2024
Cyclic Sparse Training: Is it Enough? Advait Gadhikar Sree Harsha Nelaturu R. Burkholz CLL 52 0 0 04 Jun 2024
Dishonesty in Helpful and Harmless Alignment Youcheng Huang Jingkun Tang Duanyu Feng Zheng-Wei Zhang Wenqiang Lei Jiancheng Lv Anthony G. Cohn LLMSV 46 3 0 04 Jun 2024
Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning Leonardo Iurada Marco Ciccone Tatiana Tommasi 36 3 0 03 Jun 2024
Sparser, Better, Deeper, Stronger: Improving Sparse Training with Exact Orthogonal Initialization A. Nowak Lukasz Gniecki Filip Szatkowski Jacek Tabor 37 0 0 03 Jun 2024
From Feature Visualization to Visual Circuits: Effect of Adversarial Model Manipulation Géraldin Nanfack Michael Eickenberg Eugene Belilovsky FAtt AAML GNN 43 0 0 03 Jun 2024
Effective Subset Selection Through The Lens of Neural Network Pruning Noga Bar Raja Giryes CVBM 49 0 0 03 Jun 2024
Achieving Sparse Activation in Small Language Models Jifeng Song Kai Huang Xiangyu Yin Boyuan Yang Wei Gao 29 4 0 03 Jun 2024
Memorized Images in Diffusion Models share a Subspace that can be Located and Deleted Ruchika Chavhan Ondrej Bohdal Yongshuo Zong Da Li Timothy M. Hospedales 51 4 0 01 Jun 2024
Investigating Calibration and Corruption Robustness of Post-hoc Pruned Perception CNNs: An Image Classification Benchmark Study Pallavi Mitra Gesina Schwalbe Nadja Klein AAML 36 1 0 31 May 2024
$Dual sparse training framework: inducing activation map sparsity via Transformed $\ell1$ regularization$ Dual sparse training framework: inducing activation map sparsity via Transformed $\ell1$ regularization Xiaolong Yu Cong Tian 52 0 0 30 May 2024
ConceptPrune: Concept Editing in Diffusion Models via Skilled Neuron Pruning Ruchika Chavhan Da Li Timothy M. Hospedales 44 15 0 29 May 2024
Survival of the Fittest Representation: A Case Study with Modular Addition Xiaoman Delores Ding Zifan Carl Guo Eric J. Michaud Ziming Liu Max Tegmark 48 3 0 27 May 2024
A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts Mohammed Nowaz Rabbani Chowdhury Meng Wang Kaoutar El Maghraoui Naigang Wang Pin-Yu Chen Christopher Carothers MoE 39 4 0 26 May 2024
Predicting the Impact of Model Expansion through the Minima Manifold: A Loss Landscape Perspective Pranshu Malviya Jerry Huang Quentin Fournier Sarath Chandar 62 0 0 24 May 2024
Sparse maximal update parameterization: A holistic approach to sparse training dynamics Nolan Dey Shane Bergsma Joel Hestness 38 5 0 24 May 2024
FreezeAsGuard: Mitigating Illegal Adaptation of Diffusion Models via Selective Tensor Freezing Kai Huang Wei Gao 42 2 0 24 May 2024
Graph Sparsification via Mixture of Graphs Guibin Zhang Xiangguo Sun Xinfeng Li Kun Wang Tianlong Chen Shirui Pan 30 8 0 23 May 2024
Unmasking Efficiency: Learning Salient Sparse Models in Non-IID Federated Learning Riyasat Ohib Bishal Thapaliya Gintare Karolina Dziugaite Jingyu Liu Vince D. Calhoun Sergey Plis FedML 32 1 0 15 May 2024
Neural Network Compression for Reinforcement Learning Tasks Dmitry A. Ivanov D. Larionov Oleg V. Maslennikov V. Voevodin OffRL AI4CE 55 0 0 13 May 2024
Train Faster, Perform Better: Modular Adaptive Training in Over-Parameterized Models Yubin Shi Yixuan Chen Mingzhi Dong Xiaochen Yang Dongsheng Li ... Yingying Zhao Fan Yang Tun Lu Ning Gu L. Shang MoMe 46 4 0 13 May 2024
Differentiable Model Scaling using Differentiable Topk Kai Liu Ruohui Wang Jianfei Gao Kai Chen MedIm VLM 36 1 0 12 May 2024
From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks Xue Geng Zhe Wang Chunyun Chen Qing Xu Kaixin Xu ... Zhenghua Chen M. Aly Jie Lin Min-man Wu Xiaoli Li 33 1 0 09 May 2024
TED: Accelerate Model Training by Internal Generalization Jinying Xiao Ping Li Jie Nie VLM 31 0 0 06 May 2024
Torch2Chip: An End-to-end Customizable Deep Neural Network Compression and Deployment Toolkit for Prototype Hardware Accelerator Design Jian Meng Yuan Liao Anupreetham Anupreetham Ahmed Hassan Shixing Yu Han-Sok Suh Xiaofeng Hu Jae-sun Seo MQ 49 2 0 02 May 2024
COPAL: Continual Pruning in Large Language Generative Models Srikanth Malla Joon Hee Choi Chiho Choi VLM CLL 40 1 0 02 May 2024
Graph is all you need? Lightweight data-agnostic neural architecture search without training Zhenhan Huang Tejaswini Pedapati Pin-Yu Chen Chunheng Jiang Jianxi Gao GNN 44 1 0 02 May 2024
PAODING: A High-fidelity Data-free Pruning Toolkit for Debloating Pre-trained Neural Networks Mark Huasong Meng Hao Guan Liuhuo Wan Sin Gee Teo Guangdong Bai Jin Song Dong MU 28 0 0 30 Apr 2024
The Simpler The Better: An Entropy-Based Importance Metric To Reduce Neural Networks' Depth Victor Quétu Zhu Liao Enzo Tartaglione 49 4 0 27 Apr 2024
Surprisingly Strong Performance Prediction with Neural Graph Features Gabriela Kadlecová Jovita Lukasik Martin Pilát Petra Vidnerová Mahmoud Safari Roman Neruda Frank Hutter GNN OOD 48 2 0 25 Apr 2024
NEPENTHE: Entropy-Based Pruning as a Neural Network Depth's Reducer Zhu Liao Victor Quétu Van-Tam Nguyen Enzo Tartaglione 49 2 0 24 Apr 2024
ONNXPruner: ONNX-Based General Model Pruning Adapter Dongdong Ren Wenbin Li Tianyu Ding Lei Wang Qi Fan Jing Huo Hongbing Pan Yang Gao 41 3 0 10 Apr 2024
Aggressive or Imperceptible, or Both: Network Pruning Assisted Hybrid Byzantines in Federated Learning Emre Ozfatura Kerem Ozfatura Alptekin Kupcu Deniz Gunduz AAML 38 0 0 09 Apr 2024
MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning Matteo Farina Massimiliano Mancini Elia Cunegatti Gaowen Liu Giovanni Iacca Elisa Ricci VLM 42 2 0 08 Apr 2024
Lightweight Deep Learning for Resource-Constrained Environments: A Survey Hou-I Liu Marco Galindo Hongxia Xie Lai-Kuan Wong Hong-Han Shuai Yung-Hui Li Wen-Huang Cheng 58 49 0 08 Apr 2024