ELSA: Partial Weight Freezing for Overhead-Free Sparse Network
Deployment

v1v2 (latest)

ELSA: Partial Weight Freezing for Overhead-Free Sparse Network Deployment

11 December 2023

Alexandra Peste

Dan Alistarh

Christoph H. Lampert

ArXiv (abs)PDF HTML

Papers citing "ELSA: Partial Weight Freezing for Overhead-Free Sparse Network Deployment"

12 / 12 papers shown

Title
Is Complexity Required for Neural Network Pruning? A Case Study on Global Magnitude Pruning Manas Gupta Efe Camci Vishandi Rudy Keneta Abhishek Vaidyanathan Ritwik Kanodia Chuan-Sheng Foo Wu Min Lin Jie 53 14 0 29 Sep 2022
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 256 495 0 01 Oct 2021
Only Train Once: A One-Shot Neural Network Training And Pruning Framework Tianyi Chen Bo Ji Tianyu Ding Biyi Fang Guanyi Wang Zhihui Zhu Luming Liang Yixin Shi Sheng Yi Xiao Tu 92 105 0 15 Jul 2021
ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks Jungmin Kwon Jeongseop Kim Hyunseong Park I. Choi 96 290 0 23 Feb 2021
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks Torsten Hoefler Dan Alistarh Tal Ben-Nun Nikoli Dryden Alexandra Peste MQ 314 720 0 31 Jan 2021
FreezeNet: Full Performance by Reduced Storage Costs Paul Wimmer Jens Mehnert Alexandru Paul Condurache 51 13 0 28 Nov 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 192 1,350 0 03 Oct 2020
Once-for-All: Train One Network and Specialize it for Efficient Deployment Han Cai Chuang Gan Tianzhe Wang Zhekai Zhang Song Han OOD 105 1,281 0 26 Aug 2019
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 233 3,473 0 09 Mar 2018
Learning Efficient Convolutional Networks through Network Slimming Zhuang Liu Jianguo Li Zhiqiang Shen Gao Huang Shoumeng Yan Changshui Zhang 122 2,421 0 22 Aug 2017
Wide Residual Networks Sergey Zagoruyko N. Komodakis 340 7,985 0 23 May 2016
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 313 6,681 0 08 Jun 2015

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.