v1v2v3 (latest)

Global Sparse Momentum SGD for Pruning Very Deep Neural Networks

27 September 2019

Jungong Han

Papers citing "Global Sparse Momentum SGD for Pruning Very Deep Neural Networks"

36 / 86 papers shown

Title
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization Yi Guo Huan Yuan Jianchao Tan Zhangyang Wang Sen Yang Ji Liu 92 46 0 06 Sep 2021
Architecture Aware Latency Constrained Sparse Neural Networks Tianli Zhao Qinghao Hu Xiangyu He Weixiang Xu Jiaxing Wang Cong Leng Jian Cheng 67 0 0 01 Sep 2021
A Generalized Lottery Ticket Hypothesis Ibrahim Alabdulmohsin L. Markeeva Daniel Keysers Ilya O. Tolstikhin 69 6 0 03 Jul 2021
Dep- $L_0$ : Improving $L_0$ -based Network Sparsification via Dependency Modeling Yang Li Shihao Ji 28 1 0 30 Jun 2021
Carrying out CNN Channel Pruning in a White Box Yuxin Zhang Mingbao Lin Chia-Wen Lin Jie Chen Feiyue Huang Yongjian Wu Yonghong Tian Rongrong Ji VLM 113 61 0 24 Apr 2021
NullaNet Tiny: Ultra-low-latency DNN Inference Through Fixed-function Combinational Logic M. Nazemi A. Fayyazi Amirhossein Esmaili Atharva Khare Soheil Nazar Shahsavani Massoud Pedram 36 13 0 07 Apr 2021
ReCU: Reviving the Dead Weights in Binary Neural Networks Zihan Xu Mingbao Lin Jianzhuang Liu Jie Chen Ling Shao Yue Gao Yonghong Tian Rongrong Ji MQ 84 84 0 23 Mar 2021
CNN with large memory layers R. Karimov Yury Malkov Karim Iskakov Victor Lempitsky 46 0 0 27 Jan 2021
Network Pruning using Adaptive Exemplar Filters Mingbao Lin Rongrong Ji Shaojie Li Yan Wang Yongjian Wu Feiyue Huang QiXiang Ye VLM 70 55 0 20 Jan 2021
Neural Pruning via Growing Regularization Huan Wang Can Qin Yulun Zhang Y. Fu 106 148 0 16 Dec 2020
The Role of Regularization in Shaping Weight and Node Pruning Dependency and Dynamics Yael Ben-Guigui Jacob Goldberger Tammy Riklin-Raviv 45 0 0 07 Dec 2020
FreezeNet: Full Performance by Reduced Storage Costs Paul Wimmer Jens Mehnert Alexandru Paul Condurache 79 13 0 28 Nov 2020
Learning Efficient GANs for Image Translation via Differentiable Masks and co-Attention Distillation Shaojie Li Mingbao Lin Yan Wang Yong Li Ling Shao Rongrong Ji 86 33 0 17 Nov 2020
A Tunable Robust Pruning Framework Through Dynamic Network Rewiring of DNNs Souvik Kundu M. Nazemi Peter A. Beerel Massoud Pedram AAML 74 67 0 03 Nov 2020
Methods for Pruning Deep Neural Networks S. Vadera Salem Ameen 3DPC 76 131 0 31 Oct 2020
AutoPruning for Deep Neural Network with Dynamic Channel Masking Baopu Li Yanwen Fan Zhihong Pan Gang Zhang 88 1 0 22 Oct 2020
Adaptive Dense-to-Sparse Paradigm for Pruning Online Recommendation System with Non-Stationary Data Mao Ye Dhruv Choudhary Jiecao Yu Ellie Wen Zeliang Chen Jiyan Yang Jongsoo Park Qiang Liu A. Kejariwal 76 9 0 16 Oct 2020
Rotated Binary Neural Network Mingbao Lin Rongrong Ji Zi-Han Xu Baochang Zhang Yan Wang Yongjian Wu Feiyue Huang Chia-Wen Lin MQ 110 133 0 28 Sep 2020
A Gradient Flow Framework For Analyzing Network Pruning Ekdeep Singh Lubana Robert P. Dick 127 52 0 24 Sep 2020
Training Sparse Neural Networks using Compressed Sensing Jonathan W. Siegel Jianhong Chen Pengchuan Zhang Jinchao Xu 82 5 0 21 Aug 2020
T-Basis: a Compact Representation for Neural Networks Anton Obukhov M. Rakhuba Stamatios Georgoulis Menelaos Kanakis Dengxin Dai Luc Van Gool 114 27 0 13 Jul 2020
ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting Xiaohan Ding Tianxiang Hao Jianchao Tan Ji Liu Jungong Han Yuchen Guo Guiguang Ding 91 166 0 07 Jul 2020
Learning to Prune in Training via Dynamic Channel Propagation S. Shen Rongpeng Li Zhifeng Zhao Honggang Zhang Yugeng Zhou 28 4 0 03 Jul 2020
NeuralScale: Efficient Scaling of Neurons for Resource-Constrained Deep Neural Networks Eugene Lee Chen-Yi Lee 47 14 0 23 Jun 2020
Revisiting Loss Modelling for Unstructured Pruning César Laurent Camille Ballas Thomas George Nicolas Ballas Pascal Vincent 68 14 0 22 Jun 2020
Real-time Universal Style Transfer on High-resolution Images via Zero-channel Pruning Jie An Tao Li Haozhi Huang Li Shen Xuan Wang Yongyi Tang Jinwen Ma Wei Liu Jiebo Luo 3DH 3DPC 93 18 0 16 Jun 2020
Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors C. Coelho Aki Kuusela Shane Li Zhuang Hao T. Aarrestad Vladimir Loncar J. Ngadiuba M. Pierini Adrian Alan Pol S. Summers MQ 104 179 0 15 Jun 2020
Weight Pruning via Adaptive Sparsity Loss George Retsinas Athena Elafrou G. Goumas Petros Maragos 64 10 0 04 Jun 2020
HourNAS: Extremely Fast Neural Architecture Search Through an Hourglass Lens Zhaohui Yang Yunhe Wang Xinghao Chen Jianyuan Guo Wei Zhang Chao Xu Chunjing Xu Dacheng Tao Chang Xu 93 17 0 29 May 2020
CPOT: Channel Pruning via Optimal Transport Yucong Shen Li Shen Haozhi Huang Xuan Wang Wei Liu OT 54 6 0 21 May 2020
Movement Pruning: Adaptive Sparsity by Fine-Tuning Victor Sanh Thomas Wolf Alexander M. Rush 107 489 0 15 May 2020
Convolution-Weight-Distribution Assumption: Rethinking the Criteria of Channel Pruning Zhongzhan Huang Wenqi Shao Xinjiang Wang Liang Lin Ping Luo 75 56 0 24 Apr 2020
SASL: Saliency-Adaptive Sparsity Learning for Neural Network Acceleration Jun Shi Jianfeng Xu K. Tasaka Zhibo Chen 78 25 0 12 Mar 2020
ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functions Zechun Liu Zhiqiang Shen Marios Savvides Kwang-Ting Cheng MQ 214 354 0 07 Mar 2020
Knapsack Pruning with Inner Distillation Y. Aflalo Asaf Noy Ming Lin Itamar Friedman Lihi Zelnik-Manor 3DPC 64 34 0 19 Feb 2020
Taxonomy of Saliency Metrics for Channel Pruning Kaveena Persand Andrew Anderson David Gregg 54 7 0 11 Jun 2019