SNIP: Single-shot Network Pruning based on Connection Sensitivity

4 October 2018

Namhoon Lee

Thalaiyasingam Ajanthan

Philip Torr

VLM

ArXiv PDF HTML

Papers citing "SNIP: Single-shot Network Pruning based on Connection Sensitivity"

50 / 709 papers shown

Title
Observation Space Matters: Benchmark and Optimization Algorithm J. Kim Sehoon Ha OOD OffRL 24 11 0 02 Nov 2020
Methods for Pruning Deep Neural Networks S. Vadera Salem Ameen 3DPC 24 123 0 31 Oct 2020
Are wider nets better given the same number of parameters? A. Golubeva Behnam Neyshabur Guy Gur-Ari 27 44 0 27 Oct 2020
Neuron Merging: Compensating for Pruned Neurons Woojeong Kim Suhyun Kim Mincheol Park Geonseok Jeon 25 32 0 25 Oct 2020
Brain-Inspired Learning on Neuromorphic Substrates Friedemann Zenke Emre Neftci 38 89 0 22 Oct 2020
PHEW: Constructing Sparse Networks that Learn Fast and Generalize Well without Training Data S. M. Patil C. Dovrolis 14 17 0 22 Oct 2020
Adaptive Pixel-wise Structured Sparse Network for Efficient CNNs Chen Tang Wenyu Sun Zhuqing Yuan Yongpan Liu 23 0 0 21 Oct 2020
Layer-adaptive sparsity for the Magnitude-based Pruning Jaeho Lee Sejun Park Sangwoo Mo Sungsoo Ahn Jinwoo Shin 16 189 0 15 Oct 2020
Coarse and fine-grained automatic cropping deep convolutional neural network Jingfei Chang 14 0 0 13 Oct 2020
Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework Wenxiao Wang Minghao Chen Shuai Zhao Long Chen Jinming Hu Haifeng Liu Deng Cai Xiaofei He Wei Liu 30 58 0 10 Oct 2020
Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win Utku Evci Yani Andrew Ioannou Cem Keskin Yann N. Dauphin 35 87 0 07 Oct 2020
Winning Lottery Tickets in Deep Generative Models Neha Kalibhat Yogesh Balaji S. Feizi WIGM 15 42 0 05 Oct 2020
A Gradient Flow Framework For Analyzing Network Pruning Ekdeep Singh Lubana Robert P. Dick 34 52 0 24 Sep 2020
Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot Jingtong Su Yihang Chen Tianle Cai Tianhao Wu Ruiqi Gao Liwei Wang J. Lee 14 85 0 22 Sep 2020
Pruning Neural Networks at Initialization: Why are We Missing the Mark? Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy Michael Carbin 14 238 0 18 Sep 2020
OrthoReg: Robust Network Pruning Using Orthonormality Regularization Ekdeep Singh Lubana Puja Trivedi C. Hougen Robert P. Dick Alfred Hero 37 1 0 10 Sep 2020
FlipOut: Uncovering Redundant Weights via Sign Flipping A. Apostol M. Stol Patrick Forré UQCV 7 1 0 05 Sep 2020
HALO: Learning to Prune Neural Networks with Shrinkage Skyler Seto M. Wells Wenyu Zhang 24 0 0 24 Aug 2020
Cascaded channel pruning using hierarchical self-distillation Roy Miles K. Mikolajczyk 24 7 0 16 Aug 2020
HAPI: Hardware-Aware Progressive Inference Stefanos Laskaridis Stylianos I. Venieris Hyeji Kim Nicholas D. Lane 25 45 0 10 Aug 2020
Evaluating Efficient Performance Estimators of Neural Architectures Xuefei Ning Changcheng Tang Wenshuo Li Zixuan Zhou Shuang Liang Huazhong Yang Yu Wang 33 74 0 07 Aug 2020
Diet deep generative audio models with structured lottery P. Esling Ninon Devis Adrien Bitton Antoine Caillon Axel Chemla-Romeu-Santos Constance Douwes 14 6 0 31 Jul 2020
Towards Learning Convolutions from Scratch Behnam Neyshabur SSL 220 71 0 27 Jul 2020
Sparse Linear Networks with a Fixed Butterfly Structure: Theory and Practice Nir Ailon Omer Leibovitch Vineet Nair 15 14 0 17 Jul 2020
Dynamic Group Convolution for Accelerating Convolutional Neural Networks Z. Su Linpu Fang Wenxiong Kang D. Hu M. Pietikäinen Li Liu 15 44 0 08 Jul 2020
Single Shot Structured Pruning Before Training Joost R. van Amersfoort Milad Alizadeh Sebastian Farquhar Nicholas D. Lane Y. Gal 21 22 0 01 Jul 2020
Training highly effective connectivities within neural networks with randomly initialized, fixed weights Cristian Ivan Razvan V. Florian 27 4 0 30 Jun 2020
Statistical Mechanical Analysis of Neural Network Pruning Rupam Acharyya Ankani Chattoraj Boyu Zhang Shouman Das Daniel Stefankovic 32 0 0 30 Jun 2020
The Heterogeneity Hypothesis: Finding Layer-Wise Differentiated Network Architectures Yawei Li Wen Li Martin Danelljan Peng Sun Shuhang Gu Luc Van Gool Radu Timofte 32 18 0 29 Jun 2020
ESPN: Extremely Sparse Pruned Networks Minsu Cho Ameya Joshi C. Hegde 17 7 0 28 Jun 2020
Data-dependent Pruning to find the Winning Lottery Ticket Dániel Lévai Zsolt Zombori UQCV 13 0 0 25 Jun 2020
Topological Insights into Sparse Neural Networks Shiwei Liu T. Lee Anil Yaman Zahra Atashgahi David L. Ferraro Ghada Sokar Mykola Pechenizkiy Decebal Constantin Mocanu 6 29 0 24 Jun 2020
Ramanujan Bipartite Graph Products for Efficient Block Sparse Neural Networks Dharma Teja Vooturi G. Varma Kishore Kothapalli 16 6 0 24 Jun 2020
NeuralScale: Efficient Scaling of Neurons for Resource-Constrained Deep Neural Networks Eugene Lee Chen-Yi Lee 14 14 0 23 Jun 2020
Revisiting Loss Modelling for Unstructured Pruning César Laurent Camille Ballas Thomas George Nicolas Ballas Pascal Vincent 30 14 0 22 Jun 2020
Rapid Structural Pruning of Neural Networks with Set-based Task-Adaptive Meta-Pruning M. Song Jaehong Yoon Eunho Yang Sung Ju Hwang 6 1 0 22 Jun 2020
Exploring Weight Importance and Hessian Bias in Model Pruning Mingchen Li Yahya Sattar Christos Thrampoulidis Samet Oymak 28 3 0 19 Jun 2020
Progressive Skeletonization: Trimming more fat from a network at initialization Pau de Jorge Amartya Sanyal Harkirat Singh Behl Philip Torr Grégory Rogez P. Dokania 31 95 0 16 Jun 2020
Real-time Universal Style Transfer on High-resolution Images via Zero-channel Pruning Jie An Tao Li Haozhi Huang Li Shen Xuan Wang Yongyi Tang Jinwen Ma Wei Liu Jiebo Luo 3DH 3DPC 26 18 0 16 Jun 2020
Finding trainable sparse networks through Neural Tangent Transfer Tianlin Liu Friedemann Zenke 13 33 0 15 Jun 2020
Dynamic Model Pruning with Feedback Tao R. Lin Sebastian U. Stich Luis Barba Daniil Dmitriev Martin Jaggi 32 199 0 12 Jun 2020
Pruning neural networks without any data by iteratively conserving synaptic flow Hidenori Tanaka D. Kunin Daniel L. K. Yamins Surya Ganguli 39 629 0 09 Jun 2020
Yield Loss Reduction and Test of AI and Deep Learning Accelerators Mehdi Sadi Ujjwal Guin 8 0 0 08 Jun 2020
An Overview of Neural Network Compression James OÑeill AI4CE 45 98 0 05 Jun 2020
Shapley Value as Principled Metric for Structured Network Pruning Marco Ancona Cengiz Öztireli Markus Gross 21 8 0 02 Jun 2020
Pruning via Iterative Ranking of Sensitivity Statistics Stijn Verdenius M. Stol Patrick Forré AAML 21 37 0 01 Jun 2020
Gradient Monitored Reinforcement Learning Mohammed Sharafath Abdul Hameed Gavneet Singh Chadha Andreas Schwung S. Ding 33 10 0 25 May 2020
Position-based Scaled Gradient for Model Quantization and Pruning Jangho Kim Kiyoon Yoo Nojun Kwak MQ 16 7 0 22 May 2020
CPOT: Channel Pruning via Optimal Transport Yucong Shen Li Shen Haozhi Huang Xuan Wang Wei Liu OT 12 6 0 21 May 2020
Dynamic Sparsity Neural Networks for Automatic Speech Recognition Zhaofeng Wu Ding Zhao Qiao Liang Jiahui Yu Anmol Gulati Ruoming Pang 30 39 0 16 May 2020