v1v2 (latest)

Rethinking the Value of Network Pruning

11 October 2018

Gao Huang

Papers citing "Rethinking the Value of Network Pruning"

50 / 757 papers shown

Title
Binarizing by Classification: Is soft function really necessary? Yefei He Luoming Zhang Weijia Wu Hong Zhou MQ 116 3 0 16 May 2022
Analyzing Lottery Ticket Hypothesis from PAC-Bayesian Theory Perspective Keitaro Sakamoto Issei Sato 83 9 0 15 May 2022
Revisiting Random Channel Pruning for Neural Network Compression Yawei Li Kamil Adamczewski Wen Li Shuhang Gu Radu Timofte Luc Van Gool 112 86 0 11 May 2022
Attention-based Knowledge Distillation in Multi-attention Tasks: The Impact of a DCT-driven Loss Alejandro López-Cifuentes Marcos Escudero-Viñolo Jesús Bescós Juan C. Sanmiguel 61 1 0 04 May 2022
Real Time On Sensor Gait Phase Detection with 0.5KB Deep Learning Model Yian Chen Jien-De Sui Tian-Sheuan Chang CVBM 31 0 0 02 May 2022
Towards Feature Distribution Alignment and Diversity Enhancement for Data-Free Quantization Yangcheng Gao Zhao Zhang Richang Hong Haijun Zhang Jicong Fan Shuicheng Yan MQ 60 10 0 30 Apr 2022
Federated Progressive Sparsification (Purge, Merge, Tune)+ Dimitris Stripelis Umang Gupta Greg Ver Steeg J. Ambite FedML 64 11 0 26 Apr 2022
On-demand compute reduction with stochastic wav2vec 2.0 Apoorv Vyas Wei-Ning Hsu Michael Auli Alexei Baevski 66 13 0 25 Apr 2022
Receding Neuron Importances for Structured Pruning Mihai Suteu Yike Guo 47 1 0 13 Apr 2022
Compact Model Training by Low-Rank Projection with Energy Transfer K. Guo Zhenquan Lin Xiaofen Xing Fang Liu Xiangmin Xu 77 2 0 12 Apr 2022
Channel Pruning In Quantization-aware Training: An Adaptive Projection-gradient Descent-shrinkage-splitting Method Zhijian Li Jack Xin MQ 20 0 0 09 Apr 2022
Supervised Robustness-preserving Data-free Neural Network Pruning Mark Huasong Meng Guangdong Bai Sin Gee Teo Jin Song Dong AAML 96 4 0 02 Apr 2022
Structured Pruning Learns Compact and Accurate Models Mengzhou Xia Zexuan Zhong Danqi Chen VLM 124 189 0 01 Apr 2022
CHEX: CHannel EXploration for CNN Model Compression Zejiang Hou Minghai Qin Fei Sun Xiaolong Ma Kun Yuan Yi Xu Yen-kuang Chen Rong Jin Yuan Xie S. Kung 86 74 0 29 Mar 2022
A Fast and Efficient Conditional Learning for Tunable Trade-Off between Accuracy and Robustness Souvik Kundu Sairam Sundaresan Massoud Pedram Peter A. Beerel AAML 43 1 0 28 Mar 2022
Playing Lottery Tickets in Style Transfer Models Meihao Kong Jing Huo Wenbin Li Jing Wu Yu-kun Lai Yang Gao 68 1 0 25 Mar 2022
Searching for Network Width with Bilaterally Coupled Network Xiu Su Shan You Jiyang Xie Fei Wang Chao Qian Changshui Zhang Chang Xu 75 7 0 25 Mar 2022
Minimum Variance Unbiased N:M Sparsity for the Neural Gradients Brian Chmiel Itay Hubara Ron Banner Daniel Soudry 95 9 0 21 Mar 2022
Learning Compressed Embeddings for On-Device Inference Niketan Pansare J. Katukuri Aditya Arora F. Cipollone R. Shaik Noyan Tokgozoglu Chandru Venkataraman 101 15 0 18 Mar 2022
X-Learner: Learning Cross Sources and Tasks for Universal Visual Representation Yinan He Gengshi Huang Siyu Chen Jianing Teng Wang Kun Zhen-fei Yin Lu Sheng Ziwei Liu Yu Qiao Jing Shao VLM SSL ViT 107 7 0 16 Mar 2022
Exploiting Low-Rank Tensor-Train Deep Neural Networks Based on Riemannian Gradient Descent With Illustrations of Speech Processing Jun Qi Chao-Han Huck Yang Pin-Yu Chen Javier Tejedor 73 18 0 11 Mar 2022
Improve Convolutional Neural Network Pruning by Maximizing Filter Variety Nathan Hubens M. Mancas B. Gosselin Marius Preda T. Zaharia 88 2 0 11 Mar 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 105 49 0 09 Mar 2022
Multi-trial Neural Architecture Search with Lottery Tickets Zimian Wei H. Pan Lujun Li Menglong Lu Xin-Yi Niu Peijie Dong Dongsheng Li ViT 79 0 0 08 Mar 2022
Structured Pruning is All You Need for Pruning CNNs at Initialization Yaohui Cai Weizhe Hua Hongzheng Chen G. E. Suh Christopher De Sa Zhiru Zhang CVBM 96 15 0 04 Mar 2022
Extracting Effective Subnetworks with Gumbel-Softmax Robin Dupont M. Alaoui H. Sahbi A. Lebois 41 6 0 25 Feb 2022
Standard Deviation-Based Quantization for Deep Neural Networks Amir Ardakani A. Ardakani B. Meyer J. Clark W. Gross MQ 88 1 0 24 Feb 2022
Optimal channel selection with discrete QCQP Yeonwoo Jeong Deokjae Lee Gaon An Changyong Son Hyun Oh Song 50 1 0 24 Feb 2022
Reconstruction Task Finds Universal Winning Tickets Ruichen Li Binghui Li Qi Qian Liwei Wang 117 0 0 23 Feb 2022
A Novel Architecture Slimming Method for Network Pruning and Knowledge Distillation Dongqi Wang Shengyu Zhang Zhipeng Di Xin Lin Weihua Zhou Leilei Gan 63 0 0 21 Feb 2022
Amenable Sparse Network Investigator S. Damadi Erfan Nouri Hamed Pirsiavash 35 4 0 18 Feb 2022
Trusted AI in Multi-agent Systems: An Overview of Privacy and Security for Distributed Learning Chuan Ma Jun Li Kang Wei Bo Liu Ming Ding Long Yuan Zhu Han H. Vincent Poor 106 48 0 18 Feb 2022
No One Left Behind: Inclusive Federated Learning over Heterogeneous Devices Ruixuan Liu Fangzhao Wu Chuhan Wu Yanlin Wang Lingjuan Lyu Hong Chen Xing Xie FedML 89 72 0 16 Feb 2022
Practical Network Acceleration with Tiny Sets G. Wang Jianxin Wu 99 11 0 16 Feb 2022
Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters Mingbao Lin Liujuan Cao Yuxin Zhang Ling Shao Chia-Wen Lin Rongrong Ji 80 53 0 15 Feb 2022
Finding Dynamics Preserving Adversarial Winning Tickets Xupeng Shi Pengfei Zheng Adam Ding Yuan Gao Weizhong Zhang AAML 73 1 0 14 Feb 2022
F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization Qing Jin Jian Ren Richard Zhuang Sumant Hanumante Zhengang Li Zhiyu Chen Yanzhi Wang Kai-Min Yang Sergey Tulyakov MQ 97 50 0 10 Feb 2022
EvoPruneDeepTL: An Evolutionary Pruning Model for Transfer Learning based Deep Neural Networks Javier Poyatos Daniel Molina Aritz D. Martinez Javier Del Ser Francisco Herrera 87 36 0 08 Feb 2022
Rethinking Graph Convolutional Networks in Knowledge Graph Completion Zhanqiu Zhang Jie Wang Jieping Ye Feng Wu GNN 77 67 0 08 Feb 2022
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models Chen Liang Haoming Jiang Simiao Zuo Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen T. Zhao 72 14 0 06 Feb 2022
Accelerating DNN Training with Structured Data Gradient Pruning Bradley McDanel Helia Dinh J. Magallanes 79 8 0 01 Feb 2022
Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank? Sheikh Shams Azam Seyyedali Hosseinalipour Qiang Qiu Christopher G. Brinton FedML 101 21 0 01 Feb 2022
OptG: Optimizing Gradient-driven Criteria in Network Sparsity Yuxin Zhang Mingbao Lin Mengzhao Chen Yong Li Rongrong Ji 109 5 0 30 Jan 2022
On the Convergence of Heterogeneous Federated Learning with Arbitrary Adaptive Online Model Pruning Hanhan Zhou Tian-Shing Lan Guru Venkataramani Wenbo Ding FedML 86 7 0 27 Jan 2022
Weighting and Pruning based Ensemble Deep Random Vector Functional Link Network for Tabular Data Classification Qi-Shi Shi Ponnuthurai Nagaratnam Suganthan Rakesh Katuwal 33 25 0 15 Jan 2022
Ensemble Transformer for Efficient and Accurate Ranking Tasks: an Application to Question Answering Systems Yoshitomo Matsubara Luca Soldaini Eric Lind Alessandro Moschitti 89 7 0 15 Jan 2022
GradMax: Growing Neural Networks using Gradient Information Utku Evci B. V. Merrienboer Thomas Unterthiner Max Vladymyrov Fabian Pedregosa 85 57 0 13 Jan 2022
Automatic Sparse Connectivity Learning for Neural Networks Zhimin Tang Linkai Luo Bike Xie Yiyu Zhu Rujie Zhao Lvqing Bi Chao Lu 90 42 0 13 Jan 2022
Exploiting Hybrid Models of Tensor-Train Networks for Spoken Command Recognition Jun Qi Javier Tejedor 62 4 0 11 Jan 2022
GhostNets on Heterogeneous Devices via Cheap Operations Kai Han Yunhe Wang Chang Xu Jianyuan Guo Chunjing Xu Enhua Wu Qi Tian 78 108 0 10 Jan 2022