Importance Estimation for Neural Network Pruning

25 June 2019

Papers citing "Importance Estimation for Neural Network Pruning"

50 / 439 papers shown

Title
PQV-Mobile: A Combined Pruning and Quantization Toolkit to Optimize Vision Transformers for Mobile Applications Kshitij Bhardwaj ViT MQ 42 1 0 15 Aug 2024
AdapMTL: Adaptive Pruning Framework for Multitask Learning Model Mingcan Xiang Steven Jiaxun Tang Qizheng Yang Hui Guan Tongping Liu VLM 39 0 0 07 Aug 2024
Compress and Compare: Interactively Evaluating Efficiency and Behavior Across ML Model Compression Experiments Angie Boggust Venkatesh Sivaraman Yannick Assogba Donghao Ren Dominik Moritz Fred Hohman VLM 58 3 0 06 Aug 2024
Comb, Prune, Distill: Towards Unified Pruning for Vision Model Compression Jonas Schmitt Ruiping Liu Junwei Zheng Jiaming Zhang Rainer Stiefelhagen VLM 34 0 0 06 Aug 2024
Pruning Large Language Models with Semi-Structural Adaptive Sparse Training Weiyu Huang Yuezhou Hu Guohao Jian Jun Zhu Jianfei Chen 35 5 0 30 Jul 2024
Greedy Output Approximation: Towards Efficient Structured Pruning for LLMs Without Retraining Jianwei Li Yijun Dong Qi Lei 32 5 0 26 Jul 2024
NeuSemSlice: Towards Effective DNN Model Maintenance via Neuron-level Semantic Slicing Shide Zhou Tianlin Li Yihao Huang Ling Shi Kailong Wang Yang Liu Haoyu Wang 18 0 0 26 Jul 2024
FoRA: Low-Rank Adaptation Model beyond Multimodal Siamese Network Weiying Xie Yusi Zhang Tianlin Hui Jiaqing Zhang Jie Lei Yunsong Li 35 1 0 23 Jul 2024
MINI-LLM: Memory-Efficient Structured Pruning for Large Language Models Hongrong Cheng Miao Zhang J. Q. Shi 54 2 0 16 Jul 2024
Isomorphic Pruning for Vision Models Gongfan Fang Xinyin Ma Michael Bi Mi Xinchao Wang VLM ViT 42 6 0 05 Jul 2024
Efficient DNN-Powered Software with Fair Sparse Models Xuanqi Gao Weipeng Jiang Juan Zhai Shiqing Ma Xiaoyu Zhang Chao Shen 50 0 0 03 Jul 2024
DM3D: Distortion-Minimized Weight Pruning for Lossless 3D Object Detection Kaixin Xu Qingtian Feng Hao Chen Zhe Wang Xue Geng Xulei Yang Min-man Wu Xiaoli Li Weisi Lin 39 0 0 02 Jul 2024
LPViT: Low-Power Semi-structured Pruning for Vision Transformers Kaixin Xu Zhe Wang Chunyun Chen Xue Geng Jie Lin Xulei Yang Min-man Wu Min Wu Xiaoli Li Weisi Lin ViT VLM 51 7 0 02 Jul 2024
Computation-Efficient Semi-Supervised Learning for ECG-based Cardiovascular Diseases Detection Rushuang Zhou Zijun Liu Lei A. Clifton David A. Clifton Kannie W. Y. Chan Yuan-Ting Zhang Yining Dong 31 0 0 20 Jun 2024
LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging Jinuk Kim Marwa El Halabi Mingi Ji Hyun Oh Song 46 1 0 18 Jun 2024
Multi-Dimensional Pruning: Joint Channel, Layer and Block Pruning with Latency Constraint Xinglong Sun Barath Lakshmanan Maying Shen Shiyi Lan Jingde Chen Jose Alvarez VLM 44 3 0 17 Jun 2024
RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning Haoyu Wang Tianci Liu Ruirui Li Monica Cheng Tuo Zhao Jing Gao 29 7 0 16 Jun 2024
Center-Sensitive Kernel Optimization for Efficient On-Device Incremental Learning Dingwen Zhang Yan Li De-Chun Cheng N. Wang J. Han CLL 36 0 0 13 Jun 2024
A Generic Layer Pruning Method for Signal Modulation Recognition Deep Learning Models Yao Lu Yutao Zhu Yuqi Li Dongwei Xu Yun Lin Qi Xuan Xiaoniu Yang 39 5 0 12 Jun 2024
ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models Xiang Meng Kayhan Behdin Haoyue Wang Rahul Mazumder 42 3 0 12 Jun 2024
Investigating Calibration and Corruption Robustness of Post-hoc Pruned Perception CNNs: An Image Classification Benchmark Study Pallavi Mitra Gesina Schwalbe Nadja Klein AAML 36 1 0 31 May 2024
Deep Network Pruning: A Comparative Study on CNNs in Face Recognition F. Alonso-Fernandez Kevin Hernandez Diaz Jose Maria Buades Rubio Prayag Tiwari J. Bigün CVBM 3DPC 42 1 0 28 May 2024
Sparsity- and Hybridity-Inspired Visual Parameter-Efficient Fine-Tuning for Medical Diagnosis Mingyuan Liu Lu Xu Shengnan Liu Jicong Zhang 52 1 0 28 May 2024
Magnitude-based Neuron Pruning for Backdoor Defens Nan Li Haoyu Jiang Ping Yi AAML 21 1 0 28 May 2024
Subspace Node Pruning Joshua Offergeld Marcel van Gerven Nasir Ahmad 46 0 0 26 May 2024
CoMERA: Computing- and Memory-Efficient Training via Rank-Adaptive Tensor Optimization Zi Yang Samridhi Choudhary Xinfeng Xie Cao Gao Siegfried Kunzmann Zheng-Wei Zhang VLM 43 6 0 23 May 2024
Reduced storage direct tensor ring decomposition for convolutional neural networks compression Mateusz Gabor R. Zdunek 37 0 0 17 May 2024
VideoQA-SC: Adaptive Semantic Communication for Video Question Answering Jiangyuan Guo Wei Chen Yuxuan Sun Jia-lin Xu Bo Ai 62 4 0 17 May 2024
Differentiable Model Scaling using Differentiable Topk Kai Liu Ruohui Wang Jianfei Gao Kai Chen MedIm VLM 28 1 0 12 May 2024
From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks Xue Geng Zhe Wang Chunyun Chen Qing Xu Kaixin Xu ... Zhenghua Chen M. Aly Jie Lin Min-man Wu Xiaoli Li 33 1 0 09 May 2024
TMPQ-DM: Joint Timestep Reduction and Quantization Precision Selection for Efficient Diffusion Models Haojun Sun Chen Tang Zhi Wang Yuan Meng Jingyan Jiang Xinzhu Ma Wenwu Zhu MQ 39 5 0 15 Apr 2024
ONNXPruner: ONNX-Based General Model Pruning Adapter Dongdong Ren Wenbin Li Tianyu Ding Lei Wang Qi Fan Jing Huo Hongbing Pan Yang Gao 39 3 0 10 Apr 2024
Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models Zihan Fang Zheng Lin Zhe Chen Xianhao Chen Yue Gao Yuguang Fang 56 35 0 09 Apr 2024
Robust feature knowledge distillation for enhanced performance of lightweight crack segmentation models Zhaohui Chen Elyas Asadi Shamsabadi Sheng Jiang Luming Shen Daniel Dias-da-Costa 29 2 0 09 Apr 2024
MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning Matteo Farina Massimiliano Mancini Elia Cunegatti Gaowen Liu Giovanni Iacca Elisa Ricci VLM 42 2 0 08 Apr 2024
Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning Mohamed Elsayed A. R. Mahmood CLL 50 20 0 31 Mar 2024
Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment Alireza Ganjdanesh Shangqian Gao Heng-Chiao Huang 36 5 0 28 Mar 2024
Systematic construction of continuous-time neural networks for linear dynamical systems Chinmay Datar Adwait Datar Felix Dietrich W. Schilders AI4TS 44 1 0 24 Mar 2024
FedMef: Towards Memory-efficient Federated Dynamic Pruning Hong Huang Weiming Zhuang Chen Chen Lingjuan Lyu 65 7 0 21 Mar 2024
Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch Xidong Wu Shangqian Gao Zeyu Zhang Zhenzhen Li Runxue Bao Yanfu Zhang Xiaoqian Wang Heng-Chiao Huang 41 8 0 21 Mar 2024
AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models Zeyu Liu Souvik Kundu Anni Li Junrui Wan Lianghao Jiang P. Beerel 39 9 0 20 Mar 2024
LNPT: Label-free Network Pruning and Training Jinying Xiao Ping Li Zhe Tang Jie Nie 30 2 0 19 Mar 2024
MoPE-CLIP: Structured Pruning for Efficient Vision-Language Models with Module-wise Pruning Error Metric Haokun Lin Haoli Bai Zhili Liu Lu Hou Muyi Sun Linqi Song Ying Wei Zhenan Sun CLIP VLM 63 14 0 12 Mar 2024
Frequency Attention for Knowledge Distillation Cuong Pham Van-Anh Nguyen Trung Le Dinh Q. Phung Gustavo Carneiro Thanh-Toan Do 27 16 0 09 Mar 2024
Towards Explaining Deep Neural Network Compression Through a Probabilistic Latent Space Mahsa Mozafari-Nia Salimeh Yasaei Sekeh 23 0 0 29 Feb 2024
Unveiling Linguistic Regions in Large Language Models Zhihao Zhang Jun Zhao Qi Zhang Tao Gui Xuanjing Huang 55 11 0 22 Feb 2024
Accelerating Sparse DNNs Based on Tiled GEMM Cong Guo Fengchen Xue Jingwen Leng Yuxian Qiu Yue Guan Weihao Cui Quan Chen Minyi Guo 21 10 0 16 Feb 2024
Model Compression and Efficient Inference for Large Language Models: A Survey Wenxiao Wang Wei Chen Yicong Luo Yongliu Long Zhengkai Lin Liye Zhang Binbin Lin Deng Cai Xiaofei He MQ 41 48 0 15 Feb 2024
Towards Meta-Pruning via Optimal Transport Alexander Theus Olin Geimer Friedrich Wicke Thomas Hofmann Sotiris Anagnostidis Sidak Pal Singh MoMe 24 3 0 12 Feb 2024
Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers Abhimanyu Bambhaniya Amir Yazdanbakhsh Suvinay Subramanian Sheng-Chun Kao Shivani Agrawal Utku Evci Tushar Krishna 54 16 0 07 Feb 2024