What is the State of Neural Network Pruning?

6 March 2020

Davis W. Blalock

Jose Javier Gonzalez Ortiz

Jonathan Frankle

John Guttag

ArXiv PDF HTML

Papers citing "What is the State of Neural Network Pruning?"

50 / 176 papers shown

Title
Quantum-Enhanced Parameter-Efficient Learning for Typhoon Trajectory Forecasting Chen-Yu Liu Kuan-Cheng Chen Yi-Chien Chen Samuel Yen-Chi Chen Wei-Hao Huang Wei-Jia Huang Yen-Jui Chang 19 0 0 14 May 2025
ICE-Pruning: An Iterative Cost-Efficient Pruning Pipeline for Deep Neural Networks Wenhao Hu Paul Henderson José Cano 30 0 0 12 May 2025
ORXE: Orchestrating Experts for Dynamically Configurable Efficiency Qingyuan Wang Guoxin Wang B. Cardiff Deepu John 38 0 0 07 May 2025
Knowledge Distillation for Speech Denoising by Latent Representation Alignment with Cosine Distance Diep Luong Mikko Heikkinen K. Drossos Tuomas Virtanen 47 0 0 06 May 2025
HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models Zheng Lin Yuxin Zhang Zhe Chen Zihan Fang Xianhao Chen Praneeth Vepakomma Wei Ni Jun-Jie Luo Yue Gao MoE 41 2 0 05 May 2025
Towards Faster and More Compact Foundation Models for Molecular Property Prediction Yasir Ghunaim Andrés Villa Gergo Ignacz Gyorgy Szekely Motasem Alfarra Bernard Ghanem AI4CE 84 0 0 28 Apr 2025
Hardware/Software Co-Design of RISC-V Extensions for Accelerating Sparse DNNs on FPGAs Muhammad Sabih Abrarul Karim Jakob Wittmann Frank Hannig J. Teich 68 0 0 28 Apr 2025
Towards Symmetric Low-Rank Adapters Tales Panoutsos Rodrygo L. T. Santos Flavio Figueiredo 28 0 0 29 Mar 2025
Neuroplasticity in Artificial Intelligence -- An Overview and Inspirations on Drop In & Out Learning Yupei Li M. Milling Björn Schuller AI4CE 107 0 0 27 Mar 2025
I2CKD : Intra- and Inter-Class Knowledge Distillation for Semantic Segmentation Ayoub Karine Thibault Napoléon M. Jridi VLM 109 0 0 24 Feb 2025
Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries Chris Kolb T. Weber Bernd Bischl David Rügamer 109 0 0 04 Feb 2025
Channel-wise Parallelizable Spiking Neuron with Multiplication-free Dynamics and Large Temporal Receptive Fields Peng Xue Wei Fang Zhengyu Ma Zihan Huang Zhaokun Zhou Yonghong Tian T. Masquelier Huihui Zhou 54 0 0 24 Jan 2025
Over-the-Air Multi-Sensor Inference with Neural Networks Using Memristor-Based Analog Computing Busra Tegin Muhammad Atif Ali T. Duman 63 0 0 20 Jan 2025
Playing the Lottery With Concave Regularizers for Sparse Trainable Neural Networks Giulia Fracastoro Sophie M. Fosson Andrea Migliorati G. Calafiore 40 1 0 19 Jan 2025
Two Sparse Matrices are Better than One: Sparsifying Neural Networks with Double Sparse Factorization Vladimír Boža Vladimír Macko 25 1 0 27 Sep 2024
Structured Pruning for Efficient Visual Place Recognition Oliver Grainge Michael Milford I. Bodala Sarvapali D. Ramchurn Shoaib Ehsan 43 1 0 12 Sep 2024
ThinK: Thinner Key Cache by Query-Driven Pruning Yuhui Xu Zhanming Jie Hanze Dong Lei Wang Xudong Lu Aojun Zhou Amrita Saha Caiming Xiong Doyen Sahoo 67 14 0 30 Jul 2024
SurvReLU: Inherently Interpretable Survival Analysis via Deep ReLU Networks Xiaotong Sun Peijie Qiu Shengfan Zhang OffRL 29 0 0 19 Jul 2024
Loki: A System for Serving ML Inference Pipelines with Hardware and Accuracy Scaling Sohaib Ahmad Hui Guan Ramesh K. Sitaraman 40 4 0 04 Jul 2024
Trimming the Fat: Efficient Compression of 3D Gaussian Splats through Pruning Muhammad Salman Ali Maryam Qamar Sung-Ho Bae Enzo Tartaglione 3DGS 38 11 0 26 Jun 2024
Scorch: A Library for Sparse Deep Learning Bobby Yan Alexander J. Root Trevor Gale David Broman Fredrik Kjolstad 27 0 0 27 May 2024
Neural Network Compression for Reinforcement Learning Tasks Dmitry A. Ivanov D. Larionov Oleg V. Maslennikov V. Voevodin OffRL AI4CE 43 0 0 13 May 2024
Hard-Thresholding Meets Evolution Strategies in Reinforcement Learning Chengqian Gao William de Vazelhes Hualin Zhang Bin Gu Zhiqiang Xu 46 0 0 02 May 2024
Rapid Deployment of DNNs for Edge Computing via Structured Pruning at Initialization Bailey J. Eccles Leon Wong Blesson Varghese 33 2 0 22 Apr 2024
Graph Expansion in Pruned Recurrent Neural Network Layers Preserve Performance Suryam Arnav Kalra Arindam Biswas Pabitra Mitra Biswajit Basu GNN 33 0 0 17 Mar 2024
Sparse Spiking Neural Network: Exploiting Heterogeneity in Timescales for Pruning Recurrent SNN Biswadeep Chakraborty Beomseok Kang H. Kumar Saibal Mukhopadhyay 36 8 0 06 Mar 2024
Towards Meta-Pruning via Optimal Transport Alexander Theus Olin Geimer Friedrich Wicke Thomas Hofmann Sotiris Anagnostidis Sidak Pal Singh MoMe 16 3 0 12 Feb 2024
A survey on robustness in trajectory prediction for autonomous vehicles Jeroen Hagenus Frederik Baymler Mathiesen J. Schumann Arkady Zgonnikov 27 3 0 02 Feb 2024
OnDev-LCT: On-Device Lightweight Convolutional Transformers towards federated learning Chu Myaet Thwal Minh N. H. Nguyen Ye Lin Tun Seongjin Kim My T. Thai Choong Seon Hong 51 5 0 22 Jan 2024
Stochastic Subnetwork Annealing: A Regularization Technique for Fine Tuning Pruned Subnetworks Tim Whitaker Darrell Whitley 30 0 0 16 Jan 2024
Always-Sparse Training by Growing Connections with Guided Stochastic Exploration Mike Heddes Narayan Srinivasa T. Givargis Alexandru Nicolau 91 0 0 12 Jan 2024
Using Cooperative Game Theory to Prune Neural Networks M. Diaz-Ortiz Benjamin Kempinski Daphne Cornelisse Yoram Bachrach Tal Kachman 33 2 0 17 Nov 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets A. D. Cunha Francesco d’Amore Emanuele Natale MLT 19 1 0 16 Nov 2023
Sparse Deep Learning for Time Series Data: Theory and Applications Mingxuan Zhang Y. Sun Faming Liang AI4TS OOD BDL 24 2 0 05 Oct 2023
Elephant Neural Networks: Born to Be a Continual Learner Qingfeng Lan A. R. Mahmood CLL 42 9 0 02 Oct 2023
Neural Networks at a Fraction with Pruned Quaternions Sahel Mohammad Iqbal Subhankar Mishra 28 4 0 13 Aug 2023
Pruning a neural network using Bayesian inference Sunil Mathew D. Rowe 8 0 0 04 Aug 2023
Understanding Activation Patterns in Artificial Neural Networks by Exploring Stochastic Processes S. Lehmler Muhammad Saif-ur-Rehman Tobias Glasmachers Ioannis Iossifidis 19 0 0 01 Aug 2023
My3DGen: A Scalable Personalized 3D Generative Model Luchao Qi Jiaye Wu Annie N. Wang Sheng-Yu Wang Roni Sengupta 3DH 39 3 0 11 Jul 2023
Quantifying lottery tickets under label noise: accuracy, calibration, and complexity V. Arora Daniele Irto Sebastian Goldt G. Sanguinetti 34 2 0 21 Jun 2023
A Simple and Effective Pruning Approach for Large Language Models Mingjie Sun Zhuang Liu Anna Bair J. Zico Kolter 56 355 0 20 Jun 2023
Emergent representations in networks trained with the Forward-Forward algorithm Niccolo Tosato Lorenzo Basile Emanuele Ballarin Giuseppe de Alteriis Alberto Cazzaniga A. Ansuini 26 9 0 26 May 2023
PQA: Exploring the Potential of Product Quantization in DNN Hardware Acceleration Ahmed F. AbouElhamayed Angela Cui Javier Fernandez-Marques Nicholas D. Lane Mohamed S. Abdelfattah MQ 23 4 0 25 May 2023
Evaluation Metrics for DNNs Compression Abanoub Ghobrial S. Budgett Dieter Balemans Hamid Asgari Philippe Reiter Kerstin Eder 24 1 0 18 May 2023
Seeing is Believing: Brain-Inspired Modular Training for Mechanistic Interpretability Ziming Liu Eric Gan Max Tegmark 21 36 0 04 May 2023
Sparsified Model Zoo Twins: Investigating Populations of Sparsified Neural Network Models D. Honegger Konstantin Schurholt Damian Borth 22 4 0 26 Apr 2023
A Framework for Benchmarking Real-Time Embedded Object Detection M. Schlosser D. König Michael Teutsch ObjD 11 0 0 23 Apr 2023
Training Large Language Models Efficiently with Sparsity and Dataflow V. Srinivasan Darshan Gandhi Urmish Thakker R. Prabhakar MoE 30 6 0 11 Apr 2023
MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurations M. Wong M. Ramanujam Guha Balakrishnan Ravi Netravali 29 4 0 04 Apr 2023
Object Motion Sensitivity: A Bio-inspired Solution to the Ego-motion Problem for Event-based Cameras Shay Snyder Hunter Thompson Md. Abdullah-Al Kaiser Gregory Schwartz Akhilesh R. Jaiswal Maryam Parsa 33 2 0 24 Mar 2023