v1v2 (latest)

Rethinking the Value of Network Pruning

11 October 2018

Gao Huang

Papers citing "Rethinking the Value of Network Pruning"

50 / 757 papers shown

Title
Glance and Focus Networks for Dynamic Visual Recognition Gao Huang Yulin Wang Kangchen Lv Haojun Jiang Wenhui Huang Pengfei Qi S. Song 3DH 150 50 0 09 Jan 2022
Two Sparsities Are Better Than One: Unlocking the Performance Benefits of Sparse-Sparse Networks Kevin Lee Hunter Lawrence Spracklen Subutai Ahmad 84 20 0 27 Dec 2021
Multi-Modality Distillation via Learning the teacher's modality-level Gram Matrix Peng Liu 46 0 0 21 Dec 2021
RepMLPNet: Hierarchical Vision MLP with Re-parameterized Locality Xiaohan Ding Honghao Chen Xinming Zhang Jungong Han Guiguang Ding 84 74 0 21 Dec 2021
Visualizing the Loss Landscape of Winning Lottery Tickets Robert Bain UQCV 70 3 0 16 Dec 2021
An Experimental Study of the Impact of Pre-training on the Pruning of a Convolutional Neural Network Nathan Hubens M. Mancas B. Gosselin Marius Preda T. Zaharia VLM CVBM 56 8 0 15 Dec 2021
Towards a Unified Foundation Model: Jointly Pre-Training Transformers on Unpaired Images and Text Qing Li Boqing Gong Huayu Chen Dan Kondratyuk Xianzhi Du Ming-Hsuan Yang Matthew A. Brown ViT 49 17 0 14 Dec 2021
Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Models Jialuo Chen Jingyi Wang Tinglan Peng Youcheng Sun Peng Cheng S. Ji Xingjun Ma Yue Liu Basel Alomair AAML 92 64 0 10 Dec 2021
i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery Cameron R. Wolfe Anastasios Kyrillidis 57 1 0 07 Dec 2021
Data-Free Neural Architecture Search via Recursive Label Calibration Zechun Liu Zhiqiang Shen Yun Long Eric P. Xing Kwang-Ting Cheng Chas Leichner 43 7 0 03 Dec 2021
Equal Bits: Enforcing Equally Distributed Binary Network Weights Yun-qiang Li S. Pintea Jan van Gemert MQ 92 15 0 02 Dec 2021
Batch Normalization Tells You Which Filter is Important Junghun Oh Heewon Kim Sungyong Baik Chee Hong Kyoung Mu Lee CVBM 81 8 0 02 Dec 2021
Neuron with Steady Response Leads to Better Generalization Qiang Fu Lun Du Haitao Mao Xu Chen Wei Fang Shi Han Dongmei Zhang 40 5 0 30 Nov 2021
A Highly Effective Low-Rank Compression of Deep Neural Networks with Modified Beam-Search and Modified Stable Rank Moonjung Eo Suhyun Kang Wonjong Rhee 69 1 0 30 Nov 2021
Automatic Mapping of the Best-Suited DNN Pruning Schemes for Real-Time Mobile Acceleration Yifan Gong Geng Yuan Zheng Zhan Wei Niu Zhengang Li ... Sijia Liu Bin Ren Xue Lin Xulong Tang Yanzhi Wang 66 10 0 22 Nov 2021
Can depth-adaptive BERT perform better on binary classification tasks Jing Fan Xin Zhang Sheng Zhang Yan Pan Lixiang Guo MQ 52 0 0 22 Nov 2021
Toward Compact Parameter Representations for Architecture-Agnostic Neural Network Compression Yuezhou Sun Wenlong Zhao Lijun Zhang Xiao Liu Hui Guan Matei A. Zaharia 84 0 0 19 Nov 2021
Efficient Neural Network Training via Forward and Backward Propagation Sparsification Xiao Zhou Weizhong Zhang Zonghao Chen Shizhe Diao Tong Zhang 99 46 0 10 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 203 84 0 08 Nov 2021
Learning Pruned Structure and Weights Simultaneously from Scratch: an Attention based Approach Qisheng He Weisong Shi Ming Dong 69 3 0 01 Nov 2021
ADDS: Adaptive Differentiable Sampling for Robust Multi-Party Learning Maoguo Gong Yuan Gao Yue Wu •. A. K. Qin FedML OOD 21 1 0 29 Oct 2021
Meta-Learning Sparse Implicit Neural Representations Jaehoon Lee Jihoon Tack Namhoon Lee Jinwoo Shin 105 48 0 27 Oct 2021
Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression Scheme Shaojie Li Jie Wu Xuefeng Xiao Yong Li Xudong Mao Rongrong Ji 104 37 0 27 Oct 2021
Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness Are Found within Randomly Initialized Networks Yonggan Fu Qixuan Yu Yang Zhang Shan-Hung Wu Ouyang Xu David D. Cox Yingyan Lin AAML OOD 129 30 0 26 Oct 2021
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge Geng Yuan Xiaolong Ma Wei Niu Zhengang Li Zhenglun Kong ... Minghai Qin Bin Ren Yanzhi Wang Sijia Liu Xue Lin 102 98 0 26 Oct 2021
Exploring Gradient Flow Based Saliency for DNN Model Compression Xinyu Liu Baopu Li Zhen Chen Yixuan Yuan FAtt 42 9 0 24 Oct 2021
When to Prune? A Policy towards Early Structural Pruning Maying Shen Pavlo Molchanov Hongxu Yin J. Álvarez VLM 77 56 0 22 Oct 2021
SMOF: Squeezing More Out of Filters Yields Hardware-Friendly CNN Pruning Yanli Liu Bochen Guan Qinwen Xu Weiyi Li Shuxue Quan 77 2 0 21 Oct 2021
HALP: Hardware-Aware Latency Pruning Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez VLM 81 14 0 20 Oct 2021
Deep Learning for HDR Imaging: State-of-the-Art and Future Trends Lin Wang Kuk-Jin Yoon 77 89 0 20 Oct 2021
SOSP: Efficiently Capturing Global Correlations by Second-Order Structured Pruning Manuel Nonnenmacher Thomas Pfeil Ingo Steinwart David Reeb 64 27 0 19 Oct 2021
A Dimensionality Reduction Approach for Convolutional Neural Networks L. Meneghetti N. Demo G. Rozza 168 14 0 18 Oct 2021
Network Augmentation for Tiny Deep Learning Han Cai Chuang Gan Ji Lin Song Han 133 30 0 17 Oct 2021
S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks Shiyu Liu Chong Min John Tan Mehul Motani CLL 66 4 0 17 Oct 2021
A Unified Speaker Adaptation Approach for ASR Yingzhu Zhao Chongjia Ni C. Leung Shafiq Joty Chng Eng Siong B. Ma CLL 112 9 0 16 Oct 2021
Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction Sara Elkerdawy Mostafa Elhoushi Kuanqi Cai Nilanjan Ray CVBM 88 41 0 15 Oct 2021
Training Deep Neural Networks with Joint Quantization and Pruning of Weights and Activations Xinyu Zhang Ian Colbert Ken Kreutz-Delgado Srinjoy Das MQ 100 12 0 15 Oct 2021
Towards Mixed-Precision Quantization of Neural Networks via Constrained Optimization Weihan Chen Peisong Wang Jian Cheng MQ 93 69 0 13 Oct 2021
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks Shuai Zhang Meng Wang Sijia Liu Pin-Yu Chen Jinjun Xiong UQCV MLT 85 13 0 12 Oct 2021
Global Vision Transformer Pruning with Hessian-Aware Saliency Huanrui Yang Hongxu Yin Maying Shen Pavlo Molchanov Hai Helen Li Jan Kautz ViT 86 45 0 10 Oct 2021
Weight Evolution: Improving Deep Neural Networks Training through Evolving Inferior Weight Values Zhenquan Lin K. Guo Xiaofen Xing Xiangmin Xu ODL 56 1 0 09 Oct 2021
Performance optimizations on deep noise suppression models Jerry Chee Sebastian Braun Vishak Gopal Ross Cutler 45 0 0 08 Oct 2021
End-to-End Supermask Pruning: Learning to Prune Image Captioning Models J. Tan C. Chan Joon Huang Chuah VLM 132 16 0 07 Oct 2021
Conceptual Expansion Neural Architecture Search (CENAS) M. Singamsetti Anmol Mahajan Matthew J. Guzdial 3DPC 74 1 0 07 Oct 2021
Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM) Jie Bu Arka Daw M. Maruf Anuj Karpatne 107 5 0 01 Oct 2021
Prune Your Model Before Distill It Jinhyuk Park Albert No VLM 132 28 0 30 Sep 2021
RED++ : Data-Free Pruning of Deep Neural Networks via Input Splitting and Output Merging Edouard Yvinec Arnaud Dapogny Matthieu Cord Kévin Bailly 115 18 0 30 Sep 2021
Backdoor Attacks on Federated Learning with Lottery Ticket Hypothesis Zeyuan Yin Ye Yuan Panfeng Guo Pan Zhou FedML 67 7 0 22 Sep 2021
DS-Net++: Dynamic Weight Slicing for Efficient Inference in CNNs and Transformers Changlin Li Guangrun Wang Bing Wang Xiaodan Liang Zhihui Li Xiaojun Chang 96 9 0 21 Sep 2021
Reproducibility Study: Comparing Rewinding and Fine-tuning in Neural Network Pruning Szymon Mikler AAML 32 2 0 20 Sep 2021