Lookahead: A Far-Sighted Alternative of Magnitude-based Pruning

Lookahead: A Far-Sighted Alternative of Magnitude-based Pruning

12 February 2020

Sejun Park

Papers citing "Lookahead: A Far-Sighted Alternative of Magnitude-based Pruning"

16 / 16 papers shown

Title
Torch2Chip: An End-to-end Customizable Deep Neural Network Compression and Deployment Toolkit for Prototype Hardware Accelerator Design Jian Meng Yuan Liao Anupreetham Anupreetham Ahmed Hassan Shixing Yu Han-Sok Suh Xiaofeng Hu Jae-sun Seo MQ 51 2 0 02 May 2024
ONNXPruner: ONNX-Based General Model Pruning Adapter Dongdong Ren Wenbin Li Tianyu Ding Lei Wang Qi Fan Jing Huo Hongbing Pan Yang Gao 51 3 0 10 Apr 2024
Towards Explaining Deep Neural Network Compression Through a Probabilistic Latent Space Mahsa Mozafari-Nia Salimeh Yasaei Sekeh 25 0 0 29 Feb 2024
eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models Minsik Cho Keivan Alizadeh Vahid Qichen Fu Saurabh N. Adya C. C. D. Mundo Mohammad Rastegari Devang Naik Peter Zatloukal MQ 29 6 0 02 Sep 2023
Sparse Weight Averaging with Multiple Particles for Iterative Magnitude Pruning Moonseok Choi Hyungi Lee G. Nam Juho Lee 42 2 0 24 May 2023
Bespoke: A Block-Level Neural Network Optimization Framework for Low-Cost Deployment Jong-Ryul Lee Yong-Hyuk Moon 25 0 0 03 Mar 2023
AP: Selective Activation for De-sparsifying Pruned Neural Networks Shiyu Liu Rohan Ghosh Dylan Tan Mehul Motani AAML 26 0 0 09 Dec 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 53 3 0 22 Aug 2022
SInGE: Sparsity via Integrated Gradients Estimation of Neuron Relevance Edouard Yvinec Arnaud Dapogny Matthieu Cord Kévin Bailly 47 9 0 08 Jul 2022
ViNNPruner: Visual Interactive Pruning for Deep Learning U. Schlegel Samuel Schiegg Daniel A. Keim VLM 32 2 0 31 May 2022
Perturbation of Deep Autoencoder Weights for Model Compression and Classification of Tabular Data Manar D. Samad Sakib Abrar 33 12 0 17 May 2022
RED++ : Data-Free Pruning of Deep Neural Networks via Input Splitting and Output Merging Edouard Yvinec Arnaud Dapogny Matthieu Cord Kévin Bailly 33 15 0 30 Sep 2021
DKM: Differentiable K-Means Clustering Layer for Neural Network Compression Minsik Cho Keivan Alizadeh Vahid Saurabh N. Adya Mohammad Rastegari 42 34 0 28 Aug 2021
Learned Token Pruning for Transformers Sehoon Kim Sheng Shen D. Thorsley A. Gholami Woosuk Kwon Joseph Hassoun Kurt Keutzer 17 146 0 02 Jul 2021
An Information-Theoretic Justification for Model Pruning Berivan Isik Tsachy Weissman Albert No 95 35 0 16 Feb 2021
Layer-adaptive sparsity for the Magnitude-based Pruning Jaeho Lee Sejun Park Sangwoo Mo Sungsoo Ahn Jinwoo Shin 23 189 0 15 Oct 2020