SNIP: Single-shot Network Pruning based on Connection Sensitivity

4 October 2018

Namhoon Lee

Thalaiyasingam Ajanthan

Philip Torr

VLM

ArXiv PDF HTML

Papers citing "SNIP: Single-shot Network Pruning based on Connection Sensitivity"

50 / 709 papers shown

Title
Learn, Unlearn and Relearn: An Online Learning Paradigm for Deep Neural Networks V. Ramkumar Elahe Arani Bahram Zonooz MU OnRL CLL 39 5 0 18 Mar 2023
Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks Zahra Atashgahi Xuhao Zhang Neil Kichler Shiwei Liu Lu Yin Mykola Pechenizkiy Raymond N. J. Veldhuis Decebal Constantin Mocanu 25 10 0 10 Mar 2023
Towards provably efficient quantum algorithms for large-scale machine-learning models Junyu Liu Minzhao Liu Jin-Peng Liu Ziyu Ye Yunfei Wang Yuri Alexeev Jens Eisert Liang Jiang 66 52 0 06 Mar 2023
R-TOSS: A Framework for Real-Time Object Detection using Semi-Structured Pruning Abhishek Balasubramaniam Febin P. Sunny S. Pasricha VLM 38 12 0 03 Mar 2023
Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together! Shiwei Liu Tianlong Chen Zhenyu Zhang Xuxi Chen Tianjin Huang Ajay Jaiswal Zhangyang Wang 39 29 0 03 Mar 2023
DSD $^2$ : Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free? Victor Quétu Enzo Tartaglione 37 7 0 02 Mar 2023
Structured Pruning for Deep Convolutional Neural Networks: A survey Yang He Lingao Xiao 3DPC 35 122 0 01 Mar 2023
Balanced Training for Sparse GANs Yite Wang Jing Wu N. Hovakimyan Ruoyu Sun 50 9 0 28 Feb 2023
A Unified Framework for Soft Threshold Pruning Yanqing Chen Zhengyu Ma Wei Fang Xiawu Zheng Zhaofei Yu Yonghong Tian 88 19 0 25 Feb 2023
A General-Purpose Transferable Predictor for Neural Architecture Search Fred X. Han Keith G. Mills Fabián A. Chudak Parsa Riahi Mohammad Salameh Jialin Zhang Wei Lu Shangling Jui Di Niu AI4CE OOD 20 2 0 21 Feb 2023
Structured Bayesian Compression for Deep Neural Networks Based on The Turbo-VBI Approach Cheng-Gang Xia Danny H. K. Tsang Vincent K. N. Lau BDL 16 6 0 21 Feb 2023
HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers Chen Liang Haoming Jiang Zheng Li Xianfeng Tang Bin Yin Tuo Zhao VLM 32 24 0 19 Feb 2023
Learning a Consensus Sub-Network with Polarization Regularization and One Pass Training Xiaoying Zhi Varun Babbar P. Sun Fran Silavong Ruibo Shi Sean J. Moran Sean Moran 60 1 0 17 Feb 2023
Towards Optimal Compression: Joint Pruning and Quantization Ben Zandonati Glenn Bucagu Adrian Alan Pol M. Pierini Olya Sirkin Tal Kopetz MQ 27 2 0 15 Feb 2023
Stitchable Neural Networks Zizheng Pan Jianfei Cai Bohan Zhuang 56 22 0 13 Feb 2023
Pruning Deep Neural Networks from a Sparsity Perspective Enmao Diao G. Wang Jiawei Zhan Yuhong Yang Jie Ding Vahid Tarokh 29 30 0 11 Feb 2023
Ten Lessons We Have Learned in the New "Sparseland": A Short Handbook for Sparse Neural Network Researchers Shiwei Liu Zhangyang Wang 39 30 0 06 Feb 2023
STEP: Learning N:M Structured Sparsity Masks from Scratch with Precondition Yucheng Lu Shivani Agrawal Suvinay Subramanian Oleg Rybakov Chris De Sa Amir Yazdanbakhsh 23 16 0 02 Feb 2023
A Survey on Efficient Training of Transformers Bohan Zhuang Jing Liu Zizheng Pan Haoyu He Yuetian Weng Chunhua Shen 36 47 0 02 Feb 2023
Dynamic Ensemble of Low-fidelity Experts: Mitigating NAS "Cold-Start" Junbo Zhao Xuefei Ning En-hao Liu Binxin Ru Zixuan Zhou Tianchen Zhao Chen Chen Jiajin Zhang Q. Liao Yu Wang AI4CE 37 2 0 02 Feb 2023
Quantum Ridgelet Transform: Winning Lottery Ticket of Neural Networks with Quantum Computation H. Yamasaki Sathyawageeswar Subramanian Satoshi Hayakawa Sho Sonoda MLT 33 4 0 27 Jan 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 38 61 0 26 Jan 2023
Low-Rank Winograd Transformation for 3D Convolutional Neural Networks Ziran Qin Mingbao Lin Weiyao Lin 3DPC 36 2 0 26 Jan 2023
When Layers Play the Lottery, all Tickets Win at Initialization Artur Jordão George Correa de Araujo H. Maia Hélio Pedrini 13 3 0 25 Jan 2023
Learning to Linearize Deep Neural Networks for Secure and Efficient Private Inference Souvik Kundu Shun Lu Yuke Zhang Jacqueline Liu Peter A. Beerel 8 29 0 23 Jan 2023
Neural Architecture Search: Insights from 1000 Papers Colin White Mahmoud Safari R. Sukthanker Binxin Ru T. Elsken Arber Zela Debadeepta Dey Frank Hutter 3DV AI4CE 36 130 0 20 Jan 2023
Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions Junyang Cai Khai-Nguyen Nguyen Nishant Shrestha Aidan Good Ruisen Tu Xin Yu Shandian Zhe Thiago Serra MLT 40 7 0 19 Jan 2023
Efficient Evaluation Methods for Neural Architecture Search: A Survey Xiangning Xie Xiaotian Song Zeqiong Lv Gary G. Yen Weiping Ding Yizhou Sun 41 12 0 14 Jan 2023
Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning Huan Wang Can Qin Yue Bai Yun Fu 37 20 0 12 Jan 2023
Pruning Before Training May Improve Generalization, Provably Hongru Yang Yingbin Liang Xiaojie Guo Lingfei Wu Zhangyang Wang MLT 29 1 0 01 Jan 2023
DeepCuts: Single-Shot Interpretability based Pruning for BERT Jasdeep Singh Grover Bhavesh Gawri R. Manku 33 1 0 27 Dec 2022
COLT: Cyclic Overlapping Lottery Tickets for Faster Pruning of Convolutional Neural Networks Md. Ismail Hossain Mohammed Rakib M. M. L. Elahi Nabeel Mohammed Shafin Rahman 21 1 0 24 Dec 2022
Pruning On-the-Fly: A Recoverable Pruning Method without Fine-tuning Danyang Liu Xue Liu 28 0 0 24 Dec 2022
DAS: Neural Architecture Search via Distinguishing Activation Score Yuqiao Liu Haipeng Li Yanan Sun Shuaicheng Liu 41 1 0 23 Dec 2022
Dynamic Sparse Network for Time Series Classification: Learning What to "see'' Qiao Xiao Boqian Wu Yu Zhang Shiwei Liu Mykola Pechenizkiy Elena Mocanu Decebal Constantin Mocanu AI4TS 43 28 0 19 Dec 2022
Can We Find Strong Lottery Tickets in Generative Models? Sangyeop Yeo Yoojin Jang Jy-yong Sohn Dongyoon Han Jaejun Yoo 20 6 0 16 Dec 2022
Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks Shiyu Liu Rohan Ghosh John Tan Chong Min Mehul Motani 47 0 0 09 Dec 2022
Attend Who is Weak: Pruning-assisted Medical Image Localization under Sophisticated and Implicit Imbalances Ajay Jaiswal Tianlong Chen Justin F. Rousseau Yifan Peng Ying Ding Zhangyang Wang 21 6 0 06 Dec 2022
Distributed Pruning Towards Tiny Neural Networks in Federated Learning Hong Huang Lan Zhang Chaoyue Sun R. Fang Xiaoyong Yuan Dapeng Wu FedML 16 16 0 05 Dec 2022
Are Straight-Through gradients and Soft-Thresholding all you need for Sparse Training? A. Vanderschueren Christophe De Vleeschouwer MQ 30 9 0 02 Dec 2022
The Effect of Data Dimensionality on Neural Network Prunability Zachary Ankner Alex Renda Gintare Karolina Dziugaite Jonathan Frankle Tian Jin 36 5 0 01 Dec 2022
Dynamic Sparse Training via Balancing the Exploration-Exploitation Trade-off Shaoyi Huang Bowen Lei Dongkuan Xu Hongwu Peng Yue Sun Mimi Xie Caiwen Ding 31 19 0 30 Nov 2022
Towards Practical Control of Singular Values of Convolutional Layers Alexandra Senderovich Ekaterina Bulatova Anton Obukhov M. Rakhuba AAML 19 9 0 24 Nov 2022
Revisiting Training-free NAS Metrics: An Efficient Training-based Method Taojiannan Yang Linjie Yang Xiaojie Jin Chong Chen 27 7 0 16 Nov 2022
SNIPER Training: Single-Shot Sparse Training for Text-to-Speech Perry Lam Huayun Zhang Nancy F. Chen Berrak Sisman Dorien Herremans VLM 40 0 0 14 Nov 2022
Partial Binarization of Neural Networks for Budget-Aware Efficient Learning Udbhav Bamba Neeraj Anand Saksham Aggarwal Dilip K Prasad D. K. Gupta MQ 26 0 0 12 Nov 2022
Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars Simon Schrodi Daniel Stoll Binxin Ru R. Sukthanker Thomas Brox Frank Hutter 48 5 0 03 Nov 2022
Automated Dominative Subspace Mining for Efficient Neural Architecture Search Yaofo Chen Yong Guo Daihai Liao Fanbing Lv Hengjie Song James Tin-Yau Kwok Mingkui Tan 43 4 0 31 Oct 2022
$Strong Lottery Ticket Hypothesis with $\varepsilon$--perturbation$ Strong Lottery Ticket Hypothesis with $\varepsilon$ --perturbation Zheyang Xiong Fangshuo Liao Anastasios Kyrillidis 37 2 0 29 Oct 2022
LOFT: Finding Lottery Tickets through Filter-wise Training Qihan Wang Chen Dun Fangshuo Liao C. Jermaine Anastasios Kyrillidis 35 3 0 28 Oct 2022