v1v2 (latest)

Rethinking the Value of Network Pruning

11 October 2018

Gao Huang

Papers citing "Rethinking the Value of Network Pruning"

50 / 757 papers shown

Title
NTK-SAP: Improving neural network pruning by aligning training dynamics Yite Wang Dawei Li Ruoyu Sun 91 21 0 06 Apr 2023
Efficient CNNs via Passive Filter Pruning Arshdeep Singh Mark D. Plumbley 48 1 0 05 Apr 2023
Robotic Perception of Transparent Objects: A Review Jiaqi Jiang G. Cao Jiankang Deng Thanh-Toan Do Shan Luo 95 32 0 31 Mar 2023
Real-time Controllable Denoising for Image and Video Zhaoyang Zhang Yi Jiang Wenqi Shao Xiaogang Wang Ping Luo Kaimo Lin Liang Feng VGen 58 19 0 29 Mar 2023
Common Subexpression-based Compression and Multiplication of Sparse Constant Matrices Emre Bilgili A. Yurdakul 29 0 0 26 Mar 2023
Performance-aware Approximation of Global Channel Pruning for Multitask CNNs Hancheng Ye Bo Zhang Tao Chen Jiayuan Fan Bin Wang 72 19 0 21 Mar 2023
Protective Self-Adaptive Pruning to Better Compress DNNs Liang Li Pengfei Zhao AAML 55 0 0 21 Mar 2023
Greedy Pruning with Group Lasso Provably Generalizes for Matrix Sensing Nived Rajaraman Devvrit Aryan Mokhtari Kannan Ramchandran 65 0 0 20 Mar 2023
Complement Sparsification: Low-Overhead Model Pruning for Federated Learning Xiaopeng Jiang Cristian Borcea FedML 83 17 0 10 Mar 2023
Efficient Transformer-based 3D Object Detection with Dynamic Token Halting Mao Ye Gregory P. Meyer Yuning Chai Qiang Liu 71 9 0 09 Mar 2023
Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together! Shiwei Liu Tianlong Chen Zhenyu Zhang Xuxi Chen Tianjin Huang Ajay Jaiswal Zhangyang Wang 84 28 0 03 Mar 2023
Structured Pruning for Deep Convolutional Neural Networks: A survey Yang He Lingao Xiao 3DPC 120 145 0 01 Mar 2023
Balanced Training for Sparse GANs Yite Wang Jing Wu N. Hovakimyan Ruoyu Sun 96 9 0 28 Feb 2023
MUX-PLMs: Data Multiplexing for High-throughput Language Models Vishvak Murahari Ameet Deshpande Carlos E. Jimenez Izhak Shafran Mingqiu Wang Yuan Cao Karthik Narasimhan MoE 61 5 0 24 Feb 2023
Considering Layerwise Importance in the Lottery Ticket Hypothesis Benjamin Vandersmissen José Oramas 79 1 0 22 Feb 2023
Moby: Empowering 2D Models for Efficient Point Cloud Analytics on the Edge Jingzong Li Yik Hong Cai Libin Liu Yushun Mao Chun Jason Xue Hongchang Xu 56 4 0 18 Feb 2023
Less is More: The Influence of Pruning on the Explainability of CNNs David Weber F. Merkle Pascal Schöttle Stephan Schlögl Martin Nocker FAtt 200 1 0 17 Feb 2023
High-frequency Matters: An Overwriting Attack and defense for Image-processing Neural Network Watermarking Huajie Chen Tianqing Zhu Chi Liu Shui Yu Wanlei Zhou AAML 58 3 0 17 Feb 2023
SEAM: Searching Transferable Mixed-Precision Quantization Policy through Large Margin Regularization Chen Tang Kai Ouyang Zenghao Chai Yunpeng Bai Yuan Meng Zhi Wang Wenwu Zhu MQ 79 9 0 14 Feb 2023
Bi-directional Masks for Efficient N:M Sparse Training Yuxin Zhang Yiting Luo Mingbao Lin Mingliang Xu Jingjing Xie Yong Li Rongrong Ji 100 16 0 13 Feb 2023
EVC: Towards Real-Time Neural Image Compression with Mask Decay G. Wang Jiahao Li Bin Li Yan Lu 80 74 0 10 Feb 2023
Exploiting Sparsity in Pruned Neural Networks to Optimize Large Model Training Siddharth Singh A. Bhatele 69 9 0 10 Feb 2023
What Matters In The Structured Pruning of Generative Language Models? Michael Santacroce Zixin Wen Yelong Shen Yuan-Fang Li 88 34 0 07 Feb 2023
Efficient Latency-Aware CNN Depth Compression via Two-Stage Dynamic Programming Jinuk Kim Yeonwoo Jeong Deokjae Lee Hyun Oh Song 119 1 0 28 Jan 2023
Rewarded meta-pruning: Meta Learning with Rewards for Channel Pruning Athul Shibu Abhishek Kumar Heechul Jung Dong-Gyu Lee 78 1 0 26 Jan 2023
When Layers Play the Lottery, all Tickets Win at Initialization Artur Jordão George Correa de Araujo H. Maia Hélio Pedrini 57 4 0 25 Jan 2023
Learning to Linearize Deep Neural Networks for Secure and Efficient Private Inference Souvik Kundu Shun Lu Yuke Zhang Jacqueline Liu Peter A. Beerel 40 29 0 23 Jan 2023
HCE: Improving Performance and Efficiency with Heterogeneously Compressed Neural Network Ensemble Jingchi Zhang Huanrui Yang Hai Helen Li 42 1 0 18 Jan 2023
Dataset Distillation: A Comprehensive Review Ruonan Yu Songhua Liu Xinchao Wang DD 163 132 0 17 Jan 2023
GOHSP: A Unified Framework of Graph and Optimization-based Heterogeneous Structured Pruning for Vision Transformer Miao Yin Burak Uzkent Yilin Shen Hongxia Jin Bo Yuan ViT 80 16 0 13 Jan 2023
Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning Huan Wang Can Qin Yue Bai Yun Fu 103 21 0 12 Jan 2023
A Survey of Face Recognition Xinyi Wang Jianteng Peng Sufang Zhang Bihui Chen Yi Wang Yan-Hua Guo CVBM 111 0 0 26 Dec 2022
Hyperspherical Quantization: Toward Smaller and More Accurate Models Dan Liu X. Chen Chen Ma Xue Liu MQ 67 3 0 24 Dec 2022
Pruning On-the-Fly: A Recoverable Pruning Method without Fine-tuning Danyang Liu Xue Liu 70 0 0 24 Dec 2022
Hyperspherical Loss-Aware Ternary Quantization Dan Liu Xue Liu MQ 65 0 0 24 Dec 2022
Mod-Squad: Designing Mixture of Experts As Modular Multi-Task Learners Zitian Chen Songlin Yang Mingyu Ding Zhenfang Chen Hengshuang Zhao E. Learned-Miller Chuang Gan MoE 43 15 0 15 Dec 2022
PD-Quant: Post-Training Quantization based on Prediction Difference Metric Jiawei Liu Lin Niu Zhihang Yuan Dawei Yang Xinggang Wang Wenyu Liu MQ 187 71 0 14 Dec 2022
AP: Selective Activation for De-sparsifying Pruned Neural Networks Shiyu Liu Rohan Ghosh Dylan Tan Mehul Motani AAML 59 0 0 09 Dec 2022
Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks Shiyu Liu Rohan Ghosh John Tan Chong Min Mehul Motani 79 0 0 09 Dec 2022
Efficient Stein Variational Inference for Reliable Distribution-lossless Network Pruning Yingchun Wang Song Guo Jingcai Guo Weizhan Zhang Yi Tian Xu Jiewei Zhang Yi Liu 87 17 0 07 Dec 2022
Slimmable Pruned Neural Networks Hideaki Kuratsu Atsuyoshi Nakamura 104 2 0 07 Dec 2022
Are Straight-Through gradients and Soft-Thresholding all you need for Sparse Training? A. Vanderschueren Christophe De Vleeschouwer MQ 56 9 0 02 Dec 2022
NeuMap: Neural Coordinate Mapping by Auto-Transdecoder for Camera Localization Shitao Tang Sicong Tang Andrea Tagliasacchi Ping Tan Yasutaka Furukawa 3DPC 64 17 0 21 Nov 2022
RUBICON: A Framework for Designing Efficient Deep Learning-Based Genomic Basecallers Gagandeep Singh M. Alser K. Denolf Can Firtina Alireza Khodamoradi Meryem Banu Cavlak Henk Corporaal O. Mutlu 65 13 0 06 Nov 2022
Soft Masking for Cost-Constrained Channel Pruning Ryan Humble Maying Shen J. Latorre Eric Darve1 J. Álvarez 54 14 0 04 Nov 2022
Losses Can Be Blessings: Routing Self-Supervised Speech Representations Towards Efficient Multilingual and Multitask Speech Processing Yonggan Fu Yang Zhang Kaizhi Qian Zhifan Ye Zhongzhi Yu Cheng-I Jeff Lai Yingyan Lin 168 9 0 02 Nov 2022
LightVessel: Exploring Lightweight Coronary Artery Vessel Segmentation via Similarity Knowledge Distillation Hao Dang Yuekai Zhang Xingqun Qi Wanting Zhou Muyi Sun 66 2 0 02 Nov 2022
LOFT: Finding Lottery Tickets through Filter-wise Training Qihan Wang Chen Dun Fangshuo Liao C. Jermaine Anastasios Kyrillidis 69 3 0 28 Oct 2022
LAB: Learnable Activation Binarizer for Binary Neural Networks Sieger Falkena Hadi Jamali Rad Jan van Gemert MQ 95 3 0 25 Oct 2022
Pruning's Effect on Generalization Through the Lens of Training and Regularization Tian Jin Michael Carbin Daniel M. Roy Jonathan Frankle Gintare Karolina Dziugaite 84 30 0 25 Oct 2022