Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2102.00554
Cited By
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks
31 January 2021
Torsten Hoefler
Dan Alistarh
Tal Ben-Nun
Nikoli Dryden
Alexandra Peste
MQ
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks"
50 / 361 papers shown
Title
Two Sparse Matrices are Better than One: Sparsifying Neural Networks with Double Sparse Factorization
Vladimír Boža
Vladimír Macko
30
1
0
27 Sep 2024
CRoP: Context-wise Robust Static Human-Sensing Personalization
Sawinder Kaur
Avery Gump
Yi Xiao
Jingyu Xin
Harshit Sharma
Nina R Benway
Jonathan L Preston
Asif Salekin
29
0
0
26 Sep 2024
Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts
Xiaoming Shi
Shiyu Wang
Yuqi Nie
Dianqi Li
Zhou Ye
Qingsong Wen
Ming Jin
AI4TS
46
32
0
24 Sep 2024
Self-Masking Networks for Unsupervised Adaptation
Alfonso Taboada Warmerdam
Mathilde Caron
Yuki M. Asano
54
1
0
11 Sep 2024
On the Complexity of Neural Computation in Superposition
Micah Adler
Nir Shavit
123
3
0
05 Sep 2024
The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Information
Diyuan Wu
Ionut-Vlad Modoranu
M. Safaryan
Denis Kuznedelev
Dan Alistarh
29
1
0
30 Aug 2024
A Tighter Complexity Analysis of SparseGPT
Xiaoyu Li
Yingyu Liang
Zhenmei Shi
Zhao Song
80
22
0
22 Aug 2024
A Greedy Hierarchical Approach to Whole-Network Filter-Pruning in CNNs
Kiran Purohit
Anurag Parvathgari
Sourangshu Bhattacharya
VLM
46
0
0
22 Aug 2024
Understanding Data Movement in Tightly Coupled Heterogeneous Systems: A Case Study with the Grace Hopper Superchip
Luigi Fusco
Mikhail Khalilov
Marcin Chrapek
G. Chukkapalli
T. Schulthess
Torsten Hoefler
GNN
20
8
0
21 Aug 2024
High Performance Unstructured SpMM Computation Using Tensor Cores
Patrik Okanovic
Grzegorz Kwa'sniewski
P. S. Labini
Maciej Besta
Flavio Vella
Torsten Hoefler
49
5
0
21 Aug 2024
Unveiling the Power of Sparse Neural Networks for Feature Selection
Zahra Atashgahi
Tennison Liu
Mykola Pechenizkiy
Raymond N. J. Veldhuis
Decebal Constantin Mocanu
M. Schaar
31
3
0
08 Aug 2024
Sparse Deep Learning Models with the
ℓ
1
\ell_1
ℓ
1
Regularization
Lixin Shen
Rui Wang
Yuesheng Xu
Mingsong Yan
37
0
0
05 Aug 2024
An approach to optimize inference of the DIART speaker diarization pipeline
Roman Aperdannier
Sigurd Schacht
Alexander Piazza
37
0
0
05 Aug 2024
Network Fission Ensembles for Low-Cost Self-Ensembles
Hojung Lee
Jong-Seok Lee
UQCV
64
0
0
05 Aug 2024
Event-based Optical Flow on Neuromorphic Processor: ANN vs. SNN Comparison based on Activation Sparsification
Yingfu Xu
Guangzhi Tang
Amirreza Yousefzadeh
Guido de Croon
Manolis Sifalakis
40
3
0
29 Jul 2024
FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extraction
Feijie Wu
Xingchen Wang
Yaqing Wang
Tianci Liu
Lu Su
Jing Gao
FedML
51
3
0
28 Jul 2024
Greedy Output Approximation: Towards Efficient Structured Pruning for LLMs Without Retraining
Jianwei Li
Yijun Dong
Qi Lei
32
5
0
26 Jul 2024
Compact Language Models via Pruning and Knowledge Distillation
Saurav Muralidharan
Sharath Turuvekere Sreenivas
Raviraj Joshi
Marcin Chochowski
M. Patwary
M. Shoeybi
Bryan Catanzaro
Jan Kautz
Pavlo Molchanov
SyDa
MQ
44
38
0
19 Jul 2024
Weight Block Sparsity: Training, Compilation, and AI Engine Accelerators
P. DÁlberto
Taehee Jeong
Akshai Jain
Shreyas Manjunath
Mrinal Sarmah
Samuel Hsu Yaswanth Raparti
Nitesh Pipralia
44
2
0
12 Jul 2024
Learning Interpretable Differentiable Logic Networks
Chang Yue
N. Jha
NAI
AI4CE
29
0
0
04 Jul 2024
Sparsest Models Elude Pruning: An Exposé of Pruning's Current Capabilities
Stephen Zhang
Vardan Papyan
39
0
0
04 Jul 2024
Tiny-PULP-Dronets: Squeezing Neural Networks for Faster and Lighter Inference on Multi-Tasking Autonomous Nano-Drones
Lorenzo Lamberti
Vlad Niculescu
Michał Barciś
Lorenzo Bellone
E. Natalizio
Luca Benini
Daniele Palossi
22
22
0
02 Jul 2024
Joint Pruning and Channel-wise Mixed-Precision Quantization for Efficient Deep Neural Networks
Beatrice Alessandra Motetti
Matteo Risso
Alessio Burrello
Enrico Macii
M. Poncino
Daniele Jahier Pagliari
MQ
58
2
0
01 Jul 2024
A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender Systems
Hung Vinh Tran
Tong Chen
Quoc Viet Hung Nguyen
Zi-Rui Huang
Lizhen Cui
Hongzhi Yin
45
1
0
25 Jun 2024
Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization
Sungbin Shin
Wonpyo Park
Jaeho Lee
Namhoon Lee
46
1
0
21 Jun 2024
SDQ: Sparse Decomposed Quantization for LLM Inference
Geonhwa Jeong
Po-An Tsai
S. Keckler
Tushar Krishna
MQ
45
3
0
19 Jun 2024
ProtoS-ViT: Visual foundation models for sparse self-explainable classifications
Hugues Turbé
Mina Bjelogrlic
G. Mengaldo
Christian Lovis
ViT
26
6
0
14 Jun 2024
Minimizing Energy Costs in Deep Learning Model Training: The Gaussian Sampling Approach
Challapalli Phanindra Revanth
Sumohana S. Channappayya
C Krishna Mohan
33
23
0
11 Jun 2024
Sparse Bayesian Networks: Efficient Uncertainty Quantification in Medical Image Analysis
Zeinab Abboud
Herve Lombaert
Samuel Kadoury
UQCV
32
1
0
11 Jun 2024
Giving each task what it needs -- leveraging structured sparsity for tailored multi-task learning
Richa Upadhyay
Ronald Phlypo
Rajkumar Saini
Marcus Liwicki
MoE
39
0
0
05 Jun 2024
SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining
Andi Han
Jiaxiang Li
Wei Huang
Mingyi Hong
Akiko Takeda
Pratik Jawanpuria
Bamdev Mishra
46
10
0
04 Jun 2024
Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning
Leonardo Iurada
Marco Ciccone
Tatiana Tommasi
36
3
0
03 Jun 2024
Achieving Sparse Activation in Small Language Models
Jifeng Song
Kai Huang
Xiangyu Yin
Boyuan Yang
Wei Gao
29
4
0
03 Jun 2024
Kolmogorov-Arnold Network for Satellite Image Classification in Remote Sensing
Minjong Cheon
45
44
0
02 Jun 2024
Group Projected Subspace Pursuit for Block Sparse Signal Reconstruction: Convergence Analysis and Applications
Roy Y. He
Haixia Liu
Hao Liu
28
2
0
01 Jun 2024
Effective Interplay between Sparsity and Quantization: From Theory to Practice
Simla Burcu Harma
Ayan Chakraborty
Elizaveta Kostenok
Danila Mishin
Dongho Ha
...
Martin Jaggi
Ming Liu
Yunho Oh
Suvinay Subramanian
Amir Yazdanbakhsh
MQ
44
6
0
31 May 2024
Occam Gradient Descent
B. N. Kausik
ODL
VLM
32
0
0
30 May 2024
Dual sparse training framework: inducing activation map sparsity via Transformed
ℓ
1
\ell1
ℓ
1
regularization
Xiaolong Yu
Cong Tian
52
0
0
30 May 2024
Scorch: A Library for Sparse Deep Learning
Bobby Yan
Alexander J. Root
Trevor Gale
David Broman
Fredrik Kjolstad
33
0
0
27 May 2024
SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
Xudong Lu
Aojun Zhou
Yuhui Xu
Renrui Zhang
Peng Gao
Hongsheng Li
37
7
0
25 May 2024
Robust width: A lightweight and certifiable adversarial defense
Jonathan Peck
Bart Goossens
AAML
45
1
0
24 May 2024
Sparse maximal update parameterization: A holistic approach to sparse training dynamics
Nolan Dey
Shane Bergsma
Joel Hestness
38
5
0
24 May 2024
TriLoRA: Integrating SVD for Advanced Style Personalization in Text-to-Image Generation
Chengcheng Feng
Mu He
Qiuyu Tian
Haojie Yin
Xiaofang Zhao
Hongwei Tang
Xingqiang Wei
DiffM
38
3
0
18 May 2024
Fast and Controllable Post-training Sparsity: Learning Optimal Sparsity Allocation with Global Constraint in Minutes
Ruihao Gong
Yang Yong
Zining Wang
Jinyang Guo
Xiuying Wei
Yuqing Ma
Xianglong Liu
54
5
0
09 May 2024
Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment
Abhinav Agarwalla
Abhay Gupta
Alexandre Marques
Shubhra Pandit
Michael Goin
...
Tuan Nguyen
Mahmoud Salem
Dan Alistarh
Sean Lie
Mark Kurtz
MoE
SyDa
45
11
0
06 May 2024
Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models
Rishav Mukherji
Mark Schöne
Khaleelulla Khan Nazeer
Christian Mayr
David Kappel
Anand Subramoney
42
2
0
01 May 2024
Towards Green AI: Current status and future research
Christian Clemm
Lutz Stobbe
Kishan Wimalawarne
Jan Druschke
49
2
0
01 May 2024
Learning a Sparse Neural Network using IHT
S. Damadi
Soroush Zolfaghari
Mahdi Rezaie
Jinglai Shen
31
0
0
29 Apr 2024
Adaptive Semantic Token Selection for AI-native Goal-oriented Communications
Alessio Devoto
Simone Petruzzi
Jary Pomponi
P. Lorenzo
Simone Scardapane
45
2
0
25 Apr 2024
Decentralized Personalized Federated Learning based on a Conditional Sparse-to-Sparser Scheme
Qianyu Long
Qiyuan Wang
Christos Anagnostopoulos
Daning Bi
FedML
28
0
0
24 Apr 2024
Previous
1
2
3
4
5
6
7
8
Next