v1v2 (latest)

Rethinking the Value of Network Pruning

11 October 2018

Gao Huang

Papers citing "Rethinking the Value of Network Pruning"

50 / 757 papers shown

Title
Random Search as a Baseline for Sparse Neural Network Architecture Search Rezsa Farahani 61 0 0 13 Mar 2024
Ensemble Quadratic Assignment Network for Graph Matching Haoru Tan Chuang Wang Sitong Wu Xu-Yao Zhang Fei Yin Cheng-Lin Liu 87 3 0 11 Mar 2024
A Survey of Lottery Ticket Hypothesis Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui UQCV 91 15 0 07 Mar 2024
Not All Layers of LLMs Are Necessary During Inference Siqi Fan Xin Jiang Xiang Li Xuying Meng Peng Han Shuo Shang Aixin Sun Yequan Wang Zhongyuan Wang 126 44 0 04 Mar 2024
EffLoc: Lightweight Vision Transformer for Efficient 6-DOF Camera Relocalization Zhendong Xiao Changhao Chen Shan Yang Wu Wei 53 1 0 21 Feb 2024
Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding Zhuoming Chen Avner May Ruslan Svirschevski Yuhsun Huang Max Ryabinin Zhihao Jia Beidi Chen 104 52 0 19 Feb 2024
Memory-Efficient Vision Transformers: An Activation-Aware Mixed-Rank Compression Strategy Seyedarmin Azizi M. Nazemi Massoud Pedram ViT MQ 89 2 0 08 Feb 2024
Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers Abhimanyu Bambhaniya Amir Yazdanbakhsh Suvinay Subramanian Sheng-Chun Kao Shivani Agrawal Utku Evci Tushar Krishna 116 19 0 07 Feb 2024
ServeFlow: A Fast-Slow Model Architecture for Network Traffic Analysis Shinan Liu Ted Shaowang Gerry Wan Jeewon Chae Jonatas Marques Sanjay Krishnan Nick Feamster 76 2 0 06 Feb 2024
Single-GPU GNN Systems: Traps and Pitfalls Yidong Gong A. Tarafder Saima Afrin Pradeep Kumar GNN 100 3 0 05 Feb 2024
No Free Prune: Information-Theoretic Barriers to Pruning at Initialization Tanishq Kumar Kevin Luo Mark Sellke 78 3 0 02 Feb 2024
Dynamic Layer Tying for Parameter-Efficient Transformers Tamir David Hay Lior Wolf 75 3 0 23 Jan 2024
BiTA: Bi-Directional Tuning for Lossless Acceleration in Large Language Models Feng-Huei Lin Hanling Yi Hongbin Li Yifan Yang Xiaotian Yu Guangming Lu Rong Xiao 86 4 0 23 Jan 2024
PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation Nadav Benedek Lior Wolf 85 5 0 20 Jan 2024
Stochastic Subnetwork Annealing: A Regularization Technique for Fine Tuning Pruned Subnetworks Tim Whitaker Darrell Whitley 90 0 0 16 Jan 2024
Always-Sparse Training by Growing Connections with Guided Stochastic Exploration Mike Heddes Narayan Srinivasa T. Givargis Alexandru Nicolau 273 0 0 12 Jan 2024
Retraining-free Model Quantization via One-Shot Weight-Coupling Learning Chen Tang Yuan Meng Jiacheng Jiang Shuzhao Xie Rongwei Lu Xinzhu Ma Zhi Wang Wenwu Zhu MQ 73 11 0 03 Jan 2024
Fast and Optimal Weight Update for Pruned Large Language Models Vladimír Boza 75 5 0 01 Jan 2024
Robust Neural Pruning with Gradient Sampling Optimization for Residual Neural Networks Juyoung Yun 59 1 0 26 Dec 2023
Attention, Distillation, and Tabularization: Towards Practical Neural Network-Based Prefetching Pengmiao Zhang Neelesh Gupta Rajgopal Kannan Viktor K. Prasanna 69 3 0 23 Dec 2023
Optimizing Convolutional Neural Network Architecture Luis Balderas Miguel Lastra José M. Benítez CVBM 101 7 0 17 Dec 2023
A 1.6-mW Sparse Deep Learning Accelerator for Speech Separation Chih-Chyau Yang Tian-Sheuan Chang 47 0 0 15 Dec 2023
Achelous++: Power-Oriented Water-Surface Panoptic Perception Framework on Edge Devices based on Vision-Radar Fusion and Pruning of Heterogeneous Modalities Runwei Guan Haocheng Zhao Shanliang Yao Ka Lok Man Xiaohui Zhu ... Yong Yue Jeremy S. Smith Eng Gee Lim Weiping Ding Yutao Yue 77 5 0 14 Dec 2023
Learning a Low-Rank Feature Representation: Achieving Better Trade-Off between Stability and Plasticity in Continual Learning Zhenrong Liu Yang Li Yi Gong Yik-Chung Wu CLL 47 1 0 14 Dec 2023
Vision-based Learning for Drones: A Survey Jiaping Xiao Rangya Zhang Yuhang Zhang Mir Feroskhan 68 5 0 08 Dec 2023
Accelerating Convolutional Neural Network Pruning via Spatial Aura Entropy Bogdan Musat Razvan Andonie 60 0 0 08 Dec 2023
Pruning Convolutional Filters via Reinforcement Learning with Entropy Minimization Bogdan Musat Razvan Andonie 85 0 0 08 Dec 2023
Who Leaked the Model? Tracking IP Infringers in Accountable Federated Learning Shuyang Yu Junyuan Hong Yi Zeng Fei Wang Ruoxi Jia Jiayu Zhou FedML 81 11 0 06 Dec 2023
Initializing Models with Larger Ones Zhiqiu Xu Yanjie Chen Kirill Vishniakov Yida Yin Zhiqiang Shen Trevor Darrell Lingjie Liu Zhuang Liu 93 21 0 30 Nov 2023
Towards Higher Ranks via Adversarial Weight Pruning Yuchuan Tian Hanting Chen Tianyu Guo Chao Xu Yunhe Wang 63 2 0 29 Nov 2023
Compressing the Backward Pass of Large-Scale Neural Architectures by Structured Activation Pruning Daniel Barley Holger Fröning AI4CE 63 1 0 28 Nov 2023
Relationship between Model Compression and Adversarial Robustness: A Review of Current Evidence Svetlana Pavlitska Hannes Grolig J. Marius Zöllner AAML 138 3 0 27 Nov 2023
ComPEFT: Compression for Communicating Parameter Efficient Updates via Sparsification and Quantization Prateek Yadav Leshem Choshen Colin Raffel Mohit Bansal 89 14 0 22 Nov 2023
Efficient Neural Networks for Tiny Machine Learning: A Comprehensive Review M. Lê Pierre Wolinski Julyan Arbel 89 10 0 20 Nov 2023
LightBTSeg: A lightweight breast tumor segmentation model using ultrasound images via dual-path joint knowledge distillation Hongjiang Guo Shengwen Wang Hao Dang Kangle Xiao Yaru Yang Wenpei Liu Tongtong Liu Yiying Wan 72 2 0 18 Nov 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets A. D. Cunha Francesco d’Amore Emanuele Natale MLT 66 1 0 16 Nov 2023
Transfer Learning for Structured Pruning under Limited Task Data Lucio Dery David Grangier Awni Y. Hannun 72 0 0 10 Nov 2023
RobustMat: Neural Diffusion for Street Landmark Patch Matching under Challenging Environments Rui She Qiyu Kang Sijie Wang Yuan-Rui Yang Kai Zhao Yang Song Wee Peng Tay 82 10 0 07 Nov 2023
Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch Le Yu Yu Bowen Haiyang Yu Fei Huang Yongbin Li MoMe 124 337 0 06 Nov 2023
On consequences of finetuning on data with highly discriminative features Wojciech Masarczyk Tomasz Trzciñski M. Ostaszewski 59 0 0 30 Oct 2023
X-SNS: Cross-Lingual Transfer Prediction through Sub-Network Similarity Taejun Yun Jinhyeon Kim Deokyeong Kang Seong Hoon Lim Jihoon Kim Taeuk Kim 86 0 0 26 Oct 2023
Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time Zichang Liu Jue Wang Tri Dao Dinesh Manocha Binhang Yuan ... Anshumali Shrivastava Ce Zhang Yuandong Tian Christopher Ré Beidi Chen BDL 123 221 0 26 Oct 2023
E-Sparse: Boosting the Large Language Model Inference through Entropy-based N:M Sparsity Yun Li Lin Niu Xipeng Zhang Kai Liu Jianchen Zhu Zhanhui Kang MoE 90 14 0 24 Oct 2023
How a student becomes a teacher: learning and forgetting through Spectral methods Lorenzo Giambagli L. Buffoni Lorenzo Chicchi Duccio Fanelli 25 7 0 19 Oct 2023
The Road to On-board Change Detection: A Lightweight Patch-Level Change Detection Network via Exploring the Potential of Pruning and Pooling Lihui Xue Zhihao Wang Xueqian Wang Gang Li 93 1 0 16 Oct 2023
Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reduction Hanhan Zhou Tian-Shing Lan Guru Venkataramani Wenbo Ding 90 31 0 12 Oct 2023
BYOM: Building Your Own Multi-Task Model For Free Weisen Jiang Baijiong Lin Han Shi Yu Zhang Zhenguo Li James T. Kwok MoMe 89 6 0 03 Oct 2023
ThinResNet: A New Baseline for Structured Convolutional Networks Pruning Hugo Tessier Ghouti Boukli Hacene Vincent Gripon 61 1 0 22 Sep 2023
TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance Kan Wu Houwen Peng Zhenghong Zhou Bin Xiao Mengchen Liu ... Xi Xi Chen Xinggang Wang Hongyang Chao Han Hu VLM OODD 86 64 0 21 Sep 2023
A Machine Learning-oriented Survey on Tiny Machine Learning Luigi Capogrosso Federico Cunico D. Cheng Franco Fummi Marco Cristani SyDa MU 106 45 0 21 Sep 2023