v1v2 (latest)

Rethinking the Value of Network Pruning

11 October 2018

Gao Huang

Papers citing "Rethinking the Value of Network Pruning"

50 / 757 papers shown

Title
Accelerating Training using Tensor Decomposition Mostafa Elhoushi Ye Tian Zihao Chen F. Shafiq Joey Yiwei Li 39 3 0 10 Sep 2019
PCONV: The Missing but Desirable Sparsity in DNN Weight Pruning for Real-time Execution on Mobile Devices Xiaolong Ma Fu-Ming Guo Wei Niu Xue Lin Jian Tang Kaisheng Ma Bin Ren Yanzhi Wang CVBM 95 180 0 06 Sep 2019
On the Acceleration of Deep Learning Model Parallelism with Staleness An Xu Zhouyuan Huo Heng-Chiao Huang 65 38 0 05 Sep 2019
Auxiliary Learning for Deep Multi-task Learning Yifan Liu Bohan Zhuang Chunhua Shen Hao Chen Wei Yin MoE 54 10 0 05 Sep 2019
PSDNet and DPDNet: Efficient channel expansion, Depthwise-Pointwise-Depthwise Inverted Bottleneck Block Guoqing Li Meng Zhang Qianru Zhang Ziyang Chen Wenzhao Liu Jiaojie Li Xuzhao Shen Jian Li Zhenyu Zhu Chau Yuen 73 5 0 03 Sep 2019
Defeating Misclassification Attacks Against Transfer Learning Bang Wu Shuo Wang Lizhen Qu Cong Wang Carsten Rudolph Xiangwen Yang AAML 75 6 0 29 Aug 2019
Exploiting Channel Similarity for Accelerating Deep Convolutional Neural Networks Yunxiang Zhang Chenglong Zhao Bingbing Ni Jian Zhang Haoran Deng 50 2 0 06 Aug 2019
Full-Stack Filters to Build Minimum Viable CNNs Kai Han Yunhe Wang Yixing Xu Chunjing Xu Dacheng Tao Chang Xu MQ 39 3 0 06 Aug 2019
How Does Learning Rate Decay Help Modern Neural Networks? Kaichao You Mingsheng Long Jianmin Wang Michael I. Jordan 68 4 0 05 Aug 2019
Compact Global Descriptor for Neural Networks Xiangyu He Ke Cheng Qiang Chen Qinghao Hu Peisong Wang Jian Cheng 80 8 0 23 Jul 2019
Bringing Giant Neural Networks Down to Earth with Unlabeled Data Yehui Tang Shan You Chang Xu Boxin Shi Chao Xu 85 11 0 13 Jul 2019
AutoCompress: An Automatic DNN Structured Pruning Framework for Ultra-High Compression Rates Ning Liu Xiaolong Ma Zhiyuan Xu Yanzhi Wang Jian Tang Jieping Ye 98 188 0 06 Jul 2019
Non-Structured DNN Weight Pruning -- Is It Beneficial in Any Platform? Xiaolong Ma Sheng Lin Shaokai Ye Zhezhi He Linfeng Zhang ... Deliang Fan Xuehai Qian Xinyu Lin Kaisheng Ma Yanzhi Wang MQ 132 93 0 03 Jul 2019
Dissecting Pruned Neural Networks Jonathan Frankle David Bau 44 8 0 29 Jun 2019
Importance Estimation for Neural Network Pruning Pavlo Molchanov Arun Mallya Stephen Tyree I. Frosio Jan Kautz 3DPC 95 888 0 25 Jun 2019
The Difficulty of Training Sparse Neural Networks Utku Evci Fabian Pedregosa Aidan Gomez Erich Elsen 81 101 0 25 Jun 2019
Towards Compact and Robust Deep Neural Networks Vikash Sehwag Shiqi Wang Prateek Mittal Suman Jana AAML 82 40 0 14 Jun 2019
Simultaneously Learning Architectures and Features of Deep Neural Networks T. Wang Lixin Fan Huiling Wang 37 6 0 11 Jun 2019
Weight Agnostic Neural Networks Adam Gaier David R Ha OOD 67 242 0 11 Jun 2019
BlockSwap: Fisher-guided Block Substitution for Network Compression on a Budget Jack Turner Elliot J. Crowley Michael F. P. O'Boyle Amos Storkey Gavia Gray 84 38 0 10 Jun 2019
The Generalization-Stability Tradeoff In Neural Network Pruning Brian Bartoldson Ari S. Morcos Adrian Barbu G. Erlebacher 94 76 0 09 Jun 2019
One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers Ari S. Morcos Haonan Yu Michela Paganini Yuandong Tian 83 229 0 06 Jun 2019
Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP Haonan Yu Sergey Edunov Yuandong Tian Ari S. Morcos 64 150 0 06 Jun 2019
Learning Sparse Networks Using Targeted Dropout Aidan Gomez Ivan Zhang Siddhartha Rao Kamalakara Divyam Madaan Kevin Swersky Y. Gal Geoffrey E. Hinton 112 98 0 31 May 2019
SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers Igor Fedorov Ryan P. Adams Matthew Mattina P. Whatmough 96 168 0 28 May 2019
Single-Net Continual Learning with Progressive Segmented Training (PST) Xiaocong Du Gouranga Charan Frank Liu Yu Cao CLL 64 13 0 28 May 2019
CGaP: Continuous Growth and Pruning for Efficient Deep Learning Xiaocong Du Zheng Li Yu Cao VLM 72 10 0 27 May 2019
Efficient Network Construction through Structural Plasticity Xiaocong Du Zheng Li Yufei Ma Yu Cao 19 12 0 27 May 2019
Light-Weight RetinaNet for Object Detection Yixing Li Fengbo Ren ObjD 47 33 0 24 May 2019
Network Pruning via Transformable Architecture Search Xuanyi Dong Yi Yang 3DPC 81 243 0 23 May 2019
Exploring Structural Sparsity of Deep Networks via Inverse Scale Spaces Yanwei Fu Chen Liu Donghao Li Zuyuan Zhong Xinwei Sun Jinshan Zeng Yuan Yao 54 10 0 23 May 2019
Sparse Transfer Learning via Winning Lottery Tickets Rahul Mehta UQCV 77 45 0 19 May 2019
EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis Chaoqi Wang Roger C. Grosse Sanja Fidler Guodong Zhang 80 124 0 15 May 2019
Network Pruning for Low-Rank Binary Indexing Dongsoo Lee S. Kwon Byeongwook Kim Parichay Kapoor Gu-Yeon Wei 54 6 0 14 May 2019
Filter Pruning by Switching to Neighboring CNNs with Good Attributes Yang He Ping Liu Linchao Zhu Yi Yang VLM 73 46 0 08 Apr 2019
Centripetal SGD for Pruning Very Deep Convolutional Networks with Complicated Structure Xiaohan Ding Guiguang Ding Yuchen Guo Jiawei Han 3DPC 69 185 0 08 Apr 2019
C2S2: Cost-aware Channel Sparse Selection for Progressive Network Pruning Chih-Yao Chiu Hwann-Tzong Chen Tyng-Luh Liu 20 0 0 06 Apr 2019
Adversarial Robustness vs Model Compression, or Both? Shaokai Ye Kaidi Xu Sijia Liu Jan-Henrik Lambrechts Huan Zhang Aojun Zhou Kaisheng Ma Yanzhi Wang Xue Lin AAML 111 165 0 29 Mar 2019
AutoSlim: Towards One-Shot Architecture Search for Channel Numbers Jiahui Yu Thomas Huang 79 56 0 27 Mar 2019
MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning Zechun Liu Haoyuan Mu Xiangyu Zhang Zichao Guo Xin Yang K. Cheng Jian Sun 104 564 0 25 Mar 2019
Stabilizing the Lottery Ticket Hypothesis Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy Michael Carbin 88 103 0 05 Mar 2019
Dynamic Multi-path Neural Network Yingcheng Su Shunfeng Zhou Yichao Wu Tian Su Ding Liang Xuebo Liu Dixin Zheng Yingxu Wang Junjie Yan Xiaolin Hu 18 3 0 28 Feb 2019
The State of Sparsity in Deep Neural Networks Trevor Gale Erich Elsen Sara Hooker 193 765 0 25 Feb 2019
Parameter Efficient Training of Deep Convolutional Neural Networks by Dynamic Sparse Reparameterization Hesham Mostafa Xin Wang 116 315 0 15 Feb 2019
Superposition of many models into one Brian Cheung A. Terekhov Yubei Chen Pulkit Agrawal Bruno A. Olshausen MoMe 87 116 0 14 Feb 2019
Fast-SCNN: Fast Semantic Segmentation Network Rudra P. K. Poudel Stephan Liwicki R. Cipolla SSeg 57 516 0 12 Feb 2019
Really should we pruning after model be totally trained? Pruning based on a small amount of training Li Yue Zhao Weibin Shang-Te Lin VLM 29 5 0 24 Jan 2019
Channel selection using Gumbel Softmax Charles Herrmann Richard Strong Bowen Ramin Zabih 56 3 0 11 Dec 2018
On Implicit Filter Level Sparsity in Convolutional Neural Networks Dushyant Mehta K. Kim Christian Theobalt 84 28 0 29 Nov 2018
Efficient Structured Pruning and Architecture Searching for Group Convolution Ruizhe Zhao Wayne Luk 101 16 0 23 Nov 2018