Fast as CHITA: Neural Network Pruning with Combinatorial Optimization

28 February 2023

Papers citing "Fast as CHITA: Neural Network Pruning with Combinatorial Optimization"

22 / 22 papers shown

Title
LiteLMGuard: Seamless and Lightweight On-Device Prompt Filtering for Safeguarding Small Language Models against Quantization-induced Risks and Vulnerabilities Kalyan Nakka Jimmy Dani Ausmit Mondal Nitesh Saxena AAML 30 0 0 08 May 2025
An Optimization Framework for Differentially Private Sparse Fine-Tuning Mehdi Makni Kayhan Behdin Gabriel Afriat Zheng Xu Sergei Vassilvitskii Natalia Ponomareva Hussein Hazimeh Rahul Mazumder 51 0 0 17 Mar 2025
Optimal Brain Apoptosis Mingyuan Sun Zheng Fang Jiaxu Wang Junjie Jiang Delei Kong Chenming Hu Yuetong Fang Renjing Xu AAML 68 0 0 25 Feb 2025
Signal Collapse in One-Shot Pruning: When Sparse Models Fail to Distinguish Neural Representations Dhananjay Saikumar Blesson Varghese 39 0 0 18 Feb 2025
OATS: Outlier-Aware Pruning Through Sparse and Low Rank Decomposition Stephen Zhang V. Papyan VLM 45 1 0 20 Sep 2024
The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Information Diyuan Wu Ionut-Vlad Modoranu M. Safaryan Denis Kuznedelev Dan Alistarh 23 1 0 30 Aug 2024
Free Lunch in the Forest: Functionally-Identical Pruning of Boosted Tree Ensembles Youssouf Emine Alexandre Forel Idriss Malek Thibaut Vidal 37 0 0 28 Aug 2024
Confident magnitude-based neural network pruning Joaquin Alvarez 37 0 0 08 Aug 2024
LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging Jinuk Kim Marwa El Halabi Mingi Ji Hyun Oh Song 39 0 0 18 Jun 2024
ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models Xiang Meng Kayhan Behdin Haoyue Wang Rahul Mazumder 37 3 0 12 Jun 2024
Is On-Device AI Broken and Exploitable? Assessing the Trust and Ethics in Small Language Models Kalyan Nakka Jimmy Dani Nitesh Saxena 43 1 0 08 Jun 2024
MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning Matteo Farina Massimiliano Mancini Elia Cunegatti Gaowen Liu Giovanni Iacca Elisa Ricci VLM 40 2 0 08 Apr 2024
FALCON: FLOP-Aware Combinatorial Optimization for Neural Network Pruning Xiang Meng Wenyu Chen Riade Benbaki Rahul Mazumder 17 3 0 11 Mar 2024
OSSCAR: One-Shot Structured Pruning in Vision and Language Models with Combinatorial Optimization Xiang Meng Shibal Ibrahim Kayhan Behdin Hussein Hazimeh Natalia Ponomareva Rahul Mazumder VLM 41 5 0 02 Mar 2024
SequentialAttention++ for Block Sparsification: Differentiable Pruning Meets Combinatorial Optimization T. Yasuda Kyriakos Axiotis Gang Fu M. Bateni Vahab Mirrokni 41 0 0 27 Feb 2024
Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes Lucio Dery Steven Kolawole Jean-Francois Kagey Virginia Smith Graham Neubig Ameet Talwalkar 39 28 0 08 Feb 2024
Less is KEN: a Universal and Simple Non-Parametric Pruning Algorithm for Large Language Models Michele Mastromattei Fabio Massimo Zanzotto VLM 23 1 0 05 Feb 2024
SWAP: Sparse Entropic Wasserstein Regression for Robust Network Pruning Lei You Hei Victor Cheng 19 2 0 07 Oct 2023
Scaling Laws for Sparsely-Connected Foundation Models Elias Frantar C. Riquelme N. Houlsby Dan Alistarh Utku Evci 18 35 0 15 Sep 2023
A Simple and Effective Pruning Approach for Large Language Models Mingjie Sun Zhuang Liu Anna Bair J. Zico Kolter 56 355 0 20 Jun 2023
L0Learn: A Scalable Package for Sparse Learning using L0 Regularization Hussein Hazimeh Rahul Mazumder Tim Nonet 13 12 0 10 Feb 2022
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 188 1,027 0 06 Mar 2020