Trainability Preserving Neural Pruning

25 July 2022

Huan Wang

Papers citing "Trainability Preserving Neural Pruning"

22 / 22 papers shown

Title
Singular Value Scaling: Efficient Generative Model Compression via Pruned Weights Refinement H. Kim Jaejun Yoo 81 0 0 23 Dec 2024
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 230 489 0 01 Oct 2021
Connectivity Matters: Neural Network Pruning Through the Lens of Effective Sparsity Artem Vysogorets Julia Kempe 62 19 0 05 Jul 2021
Towards Compact CNNs via Collaborative Compression Yuchao Li Shaohui Lin Jianzhuang Liu QiXiang Ye Mengdi Wang Chia-Wen Lin Fan Yang Jincheng Ma Qi Tian Rongrong Ji 3DV 46 88 0 24 May 2021
Dynamical Isometry: The Missing Ingredient for Neural Network Pruning Huan Wang Can Qin Yue Bai Y. Fu 23 5 0 12 May 2021
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks Torsten Hoefler Dan Alistarh Tal Ben-Nun Nikoli Dryden Alexandra Peste MQ 243 703 0 31 Jan 2021
Neural Pruning via Growing Regularization Huan Wang Can Qin Yulun Zhang Y. Fu 55 144 0 16 Dec 2020
HRank: Filter Pruning using High-Rank Feature Map Mingbao Lin Rongrong Ji Yan Wang Yichen Zhang Baochang Zhang Yonghong Tian Ling Shao 52 719 0 24 Feb 2020
Provable Filter Pruning for Efficient Neural Networks Lucas Liebenwein Cenk Baykal Harry Lang Dan Feldman Daniela Rus VLM 3DPC 56 140 0 18 Nov 2019
DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity Measures Huanrui Yang W. Wen H. Li 37 97 0 27 Aug 2019
Importance Estimation for Neural Network Pruning Pavlo Molchanov Arun Mallya Stephen Tyree I. Frosio Jan Kautz 3DPC 62 866 0 25 Jun 2019
MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning Zechun Liu Haoyuan Mu Xiangyu Zhang Zichao Guo Xin Yang K. Cheng Jian Sun 57 557 0 25 Mar 2019
SNIP: Single-shot Network Pruning based on Connection Sensitivity Namhoon Lee Thalaiyasingam Ajanthan Philip Torr VLM 197 1,190 0 04 Oct 2018
Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networks Lei Huang Xianglong Liu B. Lang Adams Wei Yu Yongliang Wang Bo Li ODL 52 225 0 16 Sep 2017
Learning Efficient Convolutional Networks through Network Slimming Zhuang Liu Jianguo Li Zhiqiang Shen Gao Huang Shoumeng Yan Changshui Zhang 94 2,407 0 22 Aug 2017
Channel Pruning for Accelerating Very Deep Neural Networks Yihui He Xiangyu Zhang Jian Sun 189 2,513 0 19 Jul 2017
Efficient Processing of Deep Neural Networks: A Tutorial and Survey Vivienne Sze Yu-hsin Chen Tien-Ju Yang J. Emer AAML 3DV 94 3,002 0 27 Mar 2017
Pruning Filters for Efficient ConvNets Hao Li Asim Kadav Igor Durdanovic H. Samet H. Graf 3DPC 155 3,676 0 31 Aug 2016
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding Song Han Huizi Mao W. Dally 3DGS 189 8,793 0 01 Oct 2015
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 220 6,628 0 08 Jun 2015
Fast ConvNets Using Group-wise Brain Damage V. Lebedev Victor Lempitsky AAML 109 448 0 08 Jun 2015
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 107 1,830 0 20 Dec 2013