v1v2 (latest)

Rethinking the Value of Network Pruning

11 October 2018

Gao Huang

Papers citing "Rethinking the Value of Network Pruning"

50 / 757 papers shown

Title
A Differentiable Framework for End-to-End Learning of Hybrid Structured Compression Moonjung Eo Suhyun Kang Wonjong Rhee 54 1 0 21 Sep 2023
Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity Haojun Xia Zhen Zheng Yuchao Li Donglin Zhuang Zhongzhu Zhou Xiafei Qiu Yong Li Wei Lin Shuaiwen Leon Song 97 15 0 19 Sep 2023
SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels Henry Hengyuan Zhao Pichao Wang Yuyang Zhao Hao Luo F. Wang Mike Zheng Shou ViT 115 14 0 15 Sep 2023
Double Domain Guided Real-Time Low-Light Image Enhancement for Ultra-High-Definition Transportation Surveillance Jingxiang Qu R. W. Liu Yuan Gao Yu Guo Fenghua Zhu Fei Wang 90 22 0 15 Sep 2023
Unveiling Invariances via Neural Network Pruning Derek Xu Yizhou Sun Wei Wang 75 0 0 15 Sep 2023
Fidelity-Induced Interpretable Policy Extraction for Reinforcement Learning Xiao Liu Wubing Chen Mao Tan 73 2 0 12 Sep 2023
Sculpting Efficiency: Pruning Medical Imaging Models for On-Device Inference Sudarshan Sreeram Bernhard Kainz 54 0 0 10 Sep 2023
Knowledge Distillation Layer that Lets the Student Decide Ada Gorgun Y. Z. Gürbüz A. Aydin Alatan 60 0 0 06 Sep 2023
Safe and Robust Watermark Injection with a Single OoD Image Shuyang Yu Junyuan Hong Haobo Zhang Haotao Wang Zhangyang Wang Jiayu Zhou WIGM 73 3 0 04 Sep 2023
ADC/DAC-Free Analog Acceleration of Deep Neural Networks with Frequency Transformation Nastaran Darabi Maeesha Binte Hashem Hongyi Pan Ahmet Cetin Wilfred Gomes A. R. Trivedi 64 6 0 04 Sep 2023
$Pyramid diffractive optical networks for unidirectional magnification and demagnification$ Pyramid diffractive optical networks for unidirectional magnification and demagnification Bijie Bai Xilin Yang Tianyi Gan Jingxi Li Deniz Mengu Mona Jarrahi Aydogan Ozcan 64 15 0 29 Aug 2023
Maestro: Uncovering Low-Rank Structures via Trainable Decomposition Samuel Horváth Stefanos Laskaridis Shashank Rajput Hongyi Wang BDL 81 4 0 28 Aug 2023
RemovalNet: DNN Fingerprint Removal Attacks Hongwei Yao Zhengguang Li Kunzhe Huang Jian Lou Zhan Qin Kui Ren MLAU AAML 76 3 0 23 Aug 2023
To prune or not to prune : A chaos-causality approach to principled pruning of dense neural networks Rajan Sahu Shivam Chadha N. Nagaraj A. Mathur Snehanshu Saha 92 0 0 19 Aug 2023
ResBuilder: Automated Learning of Depth with Residual Structures Julian Burghoff Matthias Rottmann Jill von Conta S. Schoenen A. Witte Hanno Gottschalk 49 0 0 16 Aug 2023
Benchmarking Adversarial Robustness of Compressed Deep Learning Models Brijesh Vora Kartik Patwari Syed Mahbub Hafiz Zubair Shafiq Chen-Nee Chuah AAML 77 2 0 16 Aug 2023
Unified Data-Free Compression: Pruning and Quantization without Fine-Tuning Shipeng Bai Jun Chen Xintian Shen Yixuan Qian Yong Liu MQ 97 15 0 14 Aug 2023
Resource Constrained Model Compression via Minimax Optimization for Spiking Neural Networks Jue Chen Huan Yuan Jianchao Tan Bin Chen Chengru Song Di Zhang 69 4 0 09 Aug 2023
Pruning a neural network using Bayesian inference Sunil Mathew D. Rowe 34 0 0 04 Aug 2023
Regularized Mask Tuning: Uncovering Hidden Knowledge in Pre-trained Vision-Language Models Kecheng Zheng Wei Wu Ruili Feng Kai Zhu Jiawei Liu Deli Zhao Zhengjun Zha Wei Chen Yujun Shen VLM 73 9 0 27 Jul 2023
UPSCALE: Unconstrained Channel Pruning Alvin Wan Hanxiang Hao K. Patnaik Yueyang Xu Omer Hadad David Guera Zhile Ren Qi Shan 73 4 0 17 Jul 2023
Differentiable Transportation Pruning Yun-qiang Li Jan van Gemert Torsten Hoefler Bert Moons E. Eleftheriou Bram-Ernst Verhoef OT 89 8 0 17 Jul 2023
YOLIC: An Efficient Method for Object Localization and Classification on Edge Devices Kai Su Yoichi Tomioka Qiang Zhao Yong Liu 56 4 0 13 Jul 2023
Filter Pruning for Efficient CNNs via Knowledge-driven Differential Filter Sampler Shaohui Lin Wenxuan Huang Jiao Xie Baochang Zhang Yunhang Shen Zhou Yu Jungong Han David Doermann 60 2 0 01 Jul 2023
NaturalInversion: Data-Free Image Synthesis Improving Real-World Consistency Yujin Kim Do-Young Park Dohee Kim Suhyun Kim DiffM 98 9 0 29 Jun 2023
H $_2$ O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models Zhenyu Zhang Ying Sheng Dinesh Manocha Tianlong Chen Lianmin Zheng ... Yuandong Tian Christopher Ré Clark W. Barrett Zhangyang Wang Beidi Chen VLM 189 314 0 24 Jun 2023
Subgraph Stationary Hardware-Software Inference Co-Design Payman Behnam Jianming Tong Alind Khare Yang Chen Yue Pan Pranav Gadikar Abhimanyu Bambhaniya T. Krishna Alexey Tumanov 56 4 0 21 Jun 2023
A Simple and Effective Pruning Approach for Large Language Models Mingjie Sun Zhuang Liu Anna Bair J. Zico Kolter 179 443 0 20 Jun 2023
Magnificent Minified Models Richard E. Harang Hillary Sanders 21 0 0 16 Jun 2023
ModuleFormer: Modularity Emerges from Mixture-of-Experts Songlin Yang Zheyu Zhang Tianyou Cao Shawn Tan Zhenfang Chen Chuang Gan KELM MoE 56 10 0 07 Jun 2023
CFDP: Common Frequency Domain Pruning Samir Khaki Weihan Luo 3DV 77 5 0 07 Jun 2023
Group channel pruning and spatial attention distilling for object detection Yun Chu Pu Li Yong Bai Zhuhua Hu Yongqing Chen Jiafeng Lu VLM 56 13 0 02 Jun 2023
Task-Agnostic Structured Pruning of Speech Representation Models Haoyu Wang Siyuan Wang Weiqiang Zhang Hongbin Suo Yulong Wan VLM 69 19 0 02 Jun 2023
The Tunnel Effect: Building Data Representations in Deep Neural Networks Wojciech Masarczyk M. Ostaszewski Ehsan Imani Razvan Pascanu Piotr Milo's Tomasz Trzciñski 90 25 0 31 May 2023
A Three-regime Model of Network Pruning Yefan Zhou Yaoqing Yang Arin Chang Michael W. Mahoney 96 11 0 28 May 2023
DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models Yifan Peng Yui Sudo Muhammad Shakeel Shinji Watanabe 73 43 0 28 May 2023
Revisiting Data Augmentation in Model Compression: An Empirical and Comprehensive Study Muzhou Yu Linfeng Zhang Kaisheng Ma 68 2 0 22 May 2023
Learning Activation Functions for Sparse Neural Networks Mohammad Loni Aditya Mohan Mehdi Asadi Marius Lindauer 92 4 0 18 May 2023
Whisper-KDQ: A Lightweight Whisper via Guided Knowledge Distillation and Quantization for Efficient ASR Hang Shao Wei Wang Bei Liu Xun Gong Haoyu Wang Y. Qian 134 10 0 18 May 2023
EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention Xinyu Liu Houwen Peng Ningxin Zheng Yuqing Yang Han Hu Yixuan Yuan ViT 95 316 0 11 May 2023
CrAFT: Compression-Aware Fine-Tuning for Efficient Visual Task Adaptation J. Heo S. Azizi A. Fayyazi Massoud Pedram 50 0 0 08 May 2023
Cuttlefish: Low-Rank Model Training without All the Tuning Hongyi Wang Saurabh Agarwal Pongsakorn U-chupala Yoshiki Tanaka Eric P. Xing Dimitris Papailiopoulos OffRL 154 23 0 04 May 2023
Rethinking Graph Lottery Tickets: Graph Sparsity Matters Bo Hui Jocelyn M Mora Adrian Dalca I. Aganj 110 24 0 03 May 2023
Network Pruning Spaces Xuanyu He Yu-I Yang Ran Song Jiachen Pu Conggang Hu Feijun Jiang Wei Zhang Huanghao Ding 3DPC 115 0 0 19 Apr 2023
Structured Pruning for Multi-Task Deep Neural Networks Siddhant Garg Lijun Zhang Hui Guan 49 1 0 13 Apr 2023
Learning Accurate Performance Predictors for Ultrafast Automated Model Compression Ziwei Wang Jiwen Lu Han Xiao Shengyu Liu Jie Zhou OffRL 61 1 0 13 Apr 2023
Unified Multi-Modal Image Synthesis for Missing Modality Imputation Yue Zhang Chengtao Peng Qiuli Wang Dan Song Kaiyan Li S. Kevin Zhou MedIm 129 29 0 11 Apr 2023
Model Sparsity Can Simplify Machine Unlearning Jinghan Jia Jiancheng Liu Parikshit Ram Yuguang Yao Gaowen Liu Yang Liu Pranay Sharma Sijia Liu MU 193 130 0 11 Apr 2023
Surrogate Lagrangian Relaxation: A Path To Retrain-free Deep Neural Network Pruning Shangli Zhou Mikhail A. Bragin Lynn Pepin Deniz Gurevin Fei Miao Caiwen Ding 66 3 0 08 Apr 2023
Learning to Learn with Indispensable Connections Sambhavi Tiwari Manas Gogoi Shekhar Verma Krishna Pratap Singh CLL 78 1 0 06 Apr 2023