ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1909.12778
  4. Cited By
Global Sparse Momentum SGD for Pruning Very Deep Neural Networks
v1v2v3 (latest)

Global Sparse Momentum SGD for Pruning Very Deep Neural Networks

27 September 2019
Xiaohan Ding
Guiguang Ding
Xiangxin Zhou
Yuchen Guo
Jungong Han
Ji Liu
ArXiv (abs)PDFHTML

Papers citing "Global Sparse Momentum SGD for Pruning Very Deep Neural Networks"

36 / 86 papers shown
Title
GDP: Stabilized Neural Network Pruning via Gates with Differentiable
  Polarization
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization
Yi Guo
Huan Yuan
Jianchao Tan
Zhangyang Wang
Sen Yang
Ji Liu
92
46
0
06 Sep 2021
Architecture Aware Latency Constrained Sparse Neural Networks
Architecture Aware Latency Constrained Sparse Neural Networks
Tianli Zhao
Qinghao Hu
Xiangyu He
Weixiang Xu
Jiaxing Wang
Cong Leng
Jian Cheng
67
0
0
01 Sep 2021
A Generalized Lottery Ticket Hypothesis
A Generalized Lottery Ticket Hypothesis
Ibrahim Alabdulmohsin
L. Markeeva
Daniel Keysers
Ilya O. Tolstikhin
69
6
0
03 Jul 2021
Dep-$L_0$: Improving $L_0$-based Network Sparsification via Dependency
  Modeling
Dep-L0L_0L0​: Improving L0L_0L0​-based Network Sparsification via Dependency Modeling
Yang Li
Shihao Ji
28
1
0
30 Jun 2021
Carrying out CNN Channel Pruning in a White Box
Carrying out CNN Channel Pruning in a White Box
Yuxin Zhang
Mingbao Lin
Chia-Wen Lin
Jie Chen
Feiyue Huang
Yongjian Wu
Yonghong Tian
Rongrong Ji
VLM
113
61
0
24 Apr 2021
NullaNet Tiny: Ultra-low-latency DNN Inference Through Fixed-function
  Combinational Logic
NullaNet Tiny: Ultra-low-latency DNN Inference Through Fixed-function Combinational Logic
M. Nazemi
A. Fayyazi
Amirhossein Esmaili
Atharva Khare
Soheil Nazar Shahsavani
Massoud Pedram
36
13
0
07 Apr 2021
ReCU: Reviving the Dead Weights in Binary Neural Networks
ReCU: Reviving the Dead Weights in Binary Neural Networks
Zihan Xu
Mingbao Lin
Jianzhuang Liu
Jie Chen
Ling Shao
Yue Gao
Yonghong Tian
Rongrong Ji
MQ
84
84
0
23 Mar 2021
CNN with large memory layers
CNN with large memory layers
R. Karimov
Yury Malkov
Karim Iskakov
Victor Lempitsky
46
0
0
27 Jan 2021
Network Pruning using Adaptive Exemplar Filters
Network Pruning using Adaptive Exemplar Filters
Mingbao Lin
Rongrong Ji
Shaojie Li
Yan Wang
Yongjian Wu
Feiyue Huang
QiXiang Ye
VLM
70
55
0
20 Jan 2021
Neural Pruning via Growing Regularization
Neural Pruning via Growing Regularization
Huan Wang
Can Qin
Yulun Zhang
Y. Fu
106
148
0
16 Dec 2020
The Role of Regularization in Shaping Weight and Node Pruning Dependency
  and Dynamics
The Role of Regularization in Shaping Weight and Node Pruning Dependency and Dynamics
Yael Ben-Guigui
Jacob Goldberger
Tammy Riklin-Raviv
45
0
0
07 Dec 2020
FreezeNet: Full Performance by Reduced Storage Costs
FreezeNet: Full Performance by Reduced Storage Costs
Paul Wimmer
Jens Mehnert
Alexandru Paul Condurache
79
13
0
28 Nov 2020
Learning Efficient GANs for Image Translation via Differentiable Masks
  and co-Attention Distillation
Learning Efficient GANs for Image Translation via Differentiable Masks and co-Attention Distillation
Shaojie Li
Mingbao Lin
Yan Wang
Yong Li
Ling Shao
Rongrong Ji
86
33
0
17 Nov 2020
A Tunable Robust Pruning Framework Through Dynamic Network Rewiring of
  DNNs
A Tunable Robust Pruning Framework Through Dynamic Network Rewiring of DNNs
Souvik Kundu
M. Nazemi
Peter A. Beerel
Massoud Pedram
AAML
74
67
0
03 Nov 2020
Methods for Pruning Deep Neural Networks
Methods for Pruning Deep Neural Networks
S. Vadera
Salem Ameen
3DPC
76
131
0
31 Oct 2020
AutoPruning for Deep Neural Network with Dynamic Channel Masking
AutoPruning for Deep Neural Network with Dynamic Channel Masking
Baopu Li
Yanwen Fan
Zhihong Pan
Gang Zhang
88
1
0
22 Oct 2020
Adaptive Dense-to-Sparse Paradigm for Pruning Online Recommendation
  System with Non-Stationary Data
Adaptive Dense-to-Sparse Paradigm for Pruning Online Recommendation System with Non-Stationary Data
Mao Ye
Dhruv Choudhary
Jiecao Yu
Ellie Wen
Zeliang Chen
Jiyan Yang
Jongsoo Park
Qiang Liu
A. Kejariwal
76
9
0
16 Oct 2020
Rotated Binary Neural Network
Rotated Binary Neural Network
Mingbao Lin
Rongrong Ji
Zi-Han Xu
Baochang Zhang
Yan Wang
Yongjian Wu
Feiyue Huang
Chia-Wen Lin
MQ
110
133
0
28 Sep 2020
A Gradient Flow Framework For Analyzing Network Pruning
A Gradient Flow Framework For Analyzing Network Pruning
Ekdeep Singh Lubana
Robert P. Dick
127
52
0
24 Sep 2020
Training Sparse Neural Networks using Compressed Sensing
Training Sparse Neural Networks using Compressed Sensing
Jonathan W. Siegel
Jianhong Chen
Pengchuan Zhang
Jinchao Xu
82
5
0
21 Aug 2020
T-Basis: a Compact Representation for Neural Networks
T-Basis: a Compact Representation for Neural Networks
Anton Obukhov
M. Rakhuba
Stamatios Georgoulis
Menelaos Kanakis
Dengxin Dai
Luc Van Gool
114
27
0
13 Jul 2020
ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting
ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting
Xiaohan Ding
Tianxiang Hao
Jianchao Tan
Ji Liu
Jungong Han
Yuchen Guo
Guiguang Ding
91
166
0
07 Jul 2020
Learning to Prune in Training via Dynamic Channel Propagation
Learning to Prune in Training via Dynamic Channel Propagation
S. Shen
Rongpeng Li
Zhifeng Zhao
Honggang Zhang
Yugeng Zhou
28
4
0
03 Jul 2020
NeuralScale: Efficient Scaling of Neurons for Resource-Constrained Deep
  Neural Networks
NeuralScale: Efficient Scaling of Neurons for Resource-Constrained Deep Neural Networks
Eugene Lee
Chen-Yi Lee
47
14
0
23 Jun 2020
Revisiting Loss Modelling for Unstructured Pruning
Revisiting Loss Modelling for Unstructured Pruning
César Laurent
Camille Ballas
Thomas George
Nicolas Ballas
Pascal Vincent
68
14
0
22 Jun 2020
Real-time Universal Style Transfer on High-resolution Images via
  Zero-channel Pruning
Real-time Universal Style Transfer on High-resolution Images via Zero-channel Pruning
Jie An
Tao Li
Haozhi Huang
Li Shen
Xuan Wang
Yongyi Tang
Jinwen Ma
Wei Liu
Jiebo Luo
3DH3DPC
93
18
0
16 Jun 2020
Automatic heterogeneous quantization of deep neural networks for
  low-latency inference on the edge for particle detectors
Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors
C. Coelho
Aki Kuusela
Shane Li
Zhuang Hao
T. Aarrestad
Vladimir Loncar
J. Ngadiuba
M. Pierini
Adrian Alan Pol
S. Summers
MQ
104
179
0
15 Jun 2020
Weight Pruning via Adaptive Sparsity Loss
Weight Pruning via Adaptive Sparsity Loss
George Retsinas
Athena Elafrou
G. Goumas
Petros Maragos
64
10
0
04 Jun 2020
HourNAS: Extremely Fast Neural Architecture Search Through an Hourglass
  Lens
HourNAS: Extremely Fast Neural Architecture Search Through an Hourglass Lens
Zhaohui Yang
Yunhe Wang
Xinghao Chen
Jianyuan Guo
Wei Zhang
Chao Xu
Chunjing Xu
Dacheng Tao
Chang Xu
93
17
0
29 May 2020
CPOT: Channel Pruning via Optimal Transport
CPOT: Channel Pruning via Optimal Transport
Yucong Shen
Li Shen
Haozhi Huang
Xuan Wang
Wei Liu
OT
54
6
0
21 May 2020
Movement Pruning: Adaptive Sparsity by Fine-Tuning
Movement Pruning: Adaptive Sparsity by Fine-Tuning
Victor Sanh
Thomas Wolf
Alexander M. Rush
107
489
0
15 May 2020
Convolution-Weight-Distribution Assumption: Rethinking the Criteria of
  Channel Pruning
Convolution-Weight-Distribution Assumption: Rethinking the Criteria of Channel Pruning
Zhongzhan Huang
Wenqi Shao
Xinjiang Wang
Liang Lin
Ping Luo
75
56
0
24 Apr 2020
SASL: Saliency-Adaptive Sparsity Learning for Neural Network
  Acceleration
SASL: Saliency-Adaptive Sparsity Learning for Neural Network Acceleration
Jun Shi
Jianfeng Xu
K. Tasaka
Zhibo Chen
78
25
0
12 Mar 2020
ReActNet: Towards Precise Binary Neural Network with Generalized
  Activation Functions
ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functions
Zechun Liu
Zhiqiang Shen
Marios Savvides
Kwang-Ting Cheng
MQ
214
354
0
07 Mar 2020
Knapsack Pruning with Inner Distillation
Knapsack Pruning with Inner Distillation
Y. Aflalo
Asaf Noy
Ming Lin
Itamar Friedman
Lihi Zelnik-Manor
3DPC
64
34
0
19 Feb 2020
Taxonomy of Saliency Metrics for Channel Pruning
Taxonomy of Saliency Metrics for Channel Pruning
Kaveena Persand
Andrew Anderson
David Gregg
54
7
0
11 Jun 2019
Previous
12