Title
Sparse-to-Sparse Training of Diffusion Models Inês Cardoso Oliveira Decebal Constantin Mocanu Luis A. Leiva DiffM 86 0 0 30 Apr 2025
Sculpting Memory: Multi-Concept Forgetting in Diffusion Models via Dynamic Mask and Concept-Aware Optimization Gen Li Yang Xiao Jie Ji Kaiyuan Deng Bo Hui Linke Guo Xiaolong Ma 24 0 0 12 Apr 2025
An Efficient Training Algorithm for Models with Block-wise Sparsity Ding Zhu Zhiqun Zuo Mohammad Mahdi Khalili 39 0 0 27 Mar 2025
Probe Pruning: Accelerating LLMs through Dynamic Pruning via Model-Probing Qi Le Enmao Diao Ziyan Wang Xinran Wang Jie Ding Li Yang Ali Anwar 77 1 0 24 Feb 2025
E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image Segmentation Boqian Wu Q. Xiao Shiwei Liu Lu Yin Mykola Pechenizkiy D. Mocanu M. V. Keulen Elena Mocanu MedIm 53 4 0 20 Feb 2025
Advancing Weight and Channel Sparsification with Enhanced Saliency Xinglong Sun Maying Shen Hongxu Yin Lei Mao Pavlo Molchanov Jose M. Alvarez 54 1 0 05 Feb 2025
Brain-inspired sparse training enables Transformers and LLMs to perform as fully connected Yingtao Zhang Jialin Zhao Wenjing Wu Ziheng Liao Umberto Michieli C. Cannistraci 51 0 0 31 Jan 2025
RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation Jun Liu Zhenglun Kong Peiyan Dong Changdi Yang Xuan Shen ... Wei Niu Wenbin Zhang Xue Lin Dong Huang Yanzhi Wang ALM 46 2 0 08 Jan 2025
Pushing the Limits of Sparsity: A Bag of Tricks for Extreme Pruning Andy Li A. Durrant Milan Markovic Lu Yin Georgios Leontidis Tianlong Chen Lu Yin Georgios Leontidis 75 0 0 20 Nov 2024
Beware of Calibration Data for Pruning Large Language Models Yixin Ji Yang Xiang Juntao Li Qingrong Xia Ping Li Xinyu Duan Zhefeng Wang Min Zhang 42 2 0 23 Oct 2024
Dynamic Sparse Training versus Dense Training: The Unexpected Winner in Image Corruption Robustness Boqian Wu Q. Xiao Shunxin Wang N. Strisciuglio Mykola Pechenizkiy M. V. Keulen D. Mocanu Elena Mocanu OOD 3DH 54 0 0 03 Oct 2024
Are Sparse Neural Networks Better Hard Sample Learners? Q. Xiao Boqian Wu Lu Yin Christopher Neil Gadzinski Tianjin Huang Mykola Pechenizkiy D. Mocanu 40 1 0 13 Sep 2024
$Mixed Sparsity Training: Achieving 4$\times$ FLOP Reduction for Transformer Pretraining$ Mixed Sparsity Training: Achieving 4 $\times$ FLOP Reduction for Transformer Pretraining Pihe Hu Shaolong Li Longbo Huang 33 0 0 21 Aug 2024
Unveiling the Power of Sparse Neural Networks for Feature Selection Zahra Atashgahi Tennison Liu Mykola Pechenizkiy Raymond N. J. Veldhuis D. Mocanu M. Schaar 31 2 0 08 Aug 2024
AyE-Edge: Automated Deployment Space Search Empowering Accuracy yet Efficient Real-Time Object Detection on the Edge Chao Wu Yifan Gong Liangkai Liu Mengquan Li Yushu Wu Xuan Shen Zhimin Li Geng Yuan Weisong Shi Yanzhi Wang 23 1 0 25 Jul 2024
Nerva: a Truly Sparse Implementation of Neural Networks Wieger Wesselink Bram Grooten Qiao Xiao Cássio Machado de Campos Mykola Pechenizkiy 32 0 0 24 Jul 2024
Data Overfitting for On-Device Super-Resolution with Dynamic Algorithm and Compiler Co-Design Gen Li Zhihao Shu Jie Ji Minghai Qin Fatemeh Afghah Wei Niu Xiaolong Ma SupR 38 0 0 03 Jul 2024
Center-Sensitive Kernel Optimization for Efficient On-Device Incremental Learning Dingwen Zhang Yan Li De-Chun Cheng N. Wang J. Han CLL 36 0 0 13 Jun 2024
Boosting Robustness in Preference-Based Reinforcement Learning with Dynamic Sparsity Calarina Muslimani Bram Grooten Deepak Ranganatha Sastry Mamillapalli Mykola Pechenizkiy D. Mocanu M. E. Taylor 54 0 0 10 Jun 2024
Sparse Spectral Training and Inference on Euclidean and Hyperbolic Neural Networks Jialin Zhao Yingtao Zhang Xinghang Li Huaping Liu C. Cannistraci 28 1 0 24 May 2024
Fast and Controllable Post-training Sparsity: Learning Optimal Sparsity Allocation with Global Constraint in Minutes Ruihao Gong Yang Yong Zining Wang Jinyang Guo Xiuying Wei Yuqing Ma Xianglong Liu 38 5 0 09 May 2024
Torch2Chip: An End-to-end Customizable Deep Neural Network Compression and Deployment Toolkit for Prototype Hardware Accelerator Design Jian Meng Yuan Liao Anupreetham Anupreetham Ahmed Hassan Shixing Yu Han-Sok Suh Xiaofeng Hu Jae-sun Seo MQ 49 1 0 02 May 2024
vMCU: Coordinated Memory Management and Kernel Optimization for DNN Inference on MCUs Wenlei Bao Renze Chen Meng Li Zihao Ye Luis Ceze Yun Liang 23 2 0 01 May 2024
Embracing Unknown Step by Step: Towards Reliable Sparse Training in Real World Bowen Lei Dongkuan Xu Ruqi Zhang Bani Mallick UQCV 39 0 0 29 Mar 2024
A Survey of Lottery Ticket Hypothesis Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui UQCV 39 12 0 07 Mar 2024
Two Heads Are Better Than One: Boosting Graph Sparse Training via Semantic and Topological Awareness Guibin Zhang Xinfeng Li Kun Wang Fan Zhang Yongduo Sui Kai Wang Yuxuan Liang Dawei Cheng Shirui Pan Tianlong Chen 27 10 0 02 Feb 2024
SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing Sheng Li Geng Yuan Yuezhen Dai Youtao Zhang Yanzhi Wang Xulong Tang 31 18 0 30 Jan 2024
REST: Enhancing Group Robustness in DNNs through Reweighted Sparse Training Jiaxu Zhao Lu Yin Shiwei Liu Meng Fang Mykola Pechenizkiy 28 2 0 05 Dec 2023
Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs Yu-xin Zhang Lirui Zhao Mingbao Lin Yunyun Sun Yiwu Yao Xingjia Han Jared Tanner Shiwei Liu Rongrong Ji SyDa 42 40 0 13 Oct 2023
Pruning Small Pre-Trained Weights Irreversibly and Monotonically Impairs "Difficult" Downstream Tasks in LLMs Lu Yin Ajay Jaiswal Shiwei Liu Souvik Kundu Zhangyang Wang 27 7 0 29 Sep 2023
One-Shot Pruning for Fast-adapting Pre-trained Models on Devices Haiyan Zhao Guodong Long 13 2 0 10 Jul 2023
Fantastic Weights and How to Find Them: Where to Prune in Dynamic Sparse Training A. Nowak Bram Grooten D. Mocanu Jacek Tabor 26 9 0 21 Jun 2023
Dynamic Sparsity Is Channel-Level Sparsity Learner Lu Yin Gen Li Meng Fang Lijuan Shen Tianjin Huang Zhangyang Wang Vlado Menkovski Xiaolong Ma Mykola Pechenizkiy Shiwei Liu 30 20 0 30 May 2023
Adaptive Sparsity Level during Training for Efficient Time Series Forecasting with Transformers Zahra Atashgahi Mykola Pechenizkiy Raymond N. J. Veldhuis D. Mocanu AI4TS AI4CE 26 1 0 28 May 2023
Dynamic Sparse Training with Structured Sparsity Mike Lasby A. Golubeva Utku Evci Mihai Nica Yani Andrew Ioannou 29 19 0 03 May 2023
Rethinking Graph Lottery Tickets: Graph Sparsity Matters Bo Hui Jocelyn M Mora Adrian V. Dalca I. Aganj 42 22 0 03 May 2023
AUTOSPARSE: Towards Automated Sparse Training of Deep Neural Networks Abhisek Kundu Naveen Mellempudi Dharma Teja Vooturi Bharat Kaul Pradeep Dubey 29 1 0 14 Apr 2023
Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency Vithursan Thangarasa Shreyas Saxena Abhay Gupta Sean Lie 31 3 0 21 Mar 2023
Towards High-Quality and Efficient Video Super-Resolution via Spatial-Temporal Data Overfitting Gen Li Jie Ji Minghai Qin Wei Niu Bin Ren Fatemeh Afghah Lin Guo Xiaolong Ma SupR 95 11 0 15 Mar 2023
Ten Lessons We Have Learned in the New "Sparseland": A Short Handbook for Sparse Neural Network Researchers Shiwei Liu Zhangyang Wang 32 30 0 06 Feb 2023
Voting from Nearest Tasks: Meta-Vote Pruning of Pre-trained Models for Downstream Tasks Haiyan Zhao Tianyi Zhou Guodong Long Jing Jiang Chengqi Zhang 27 0 0 27 Jan 2023
Dynamic Sparse Network for Time Series Classification: Learning What to "see'' Qiao Xiao Boqian Wu Yu Zhang Shiwei Liu Mykola Pechenizkiy Elena Mocanu D. Mocanu AI4TS 38 28 0 19 Dec 2022
All-in-One: A Highly Representative DNN Pruning Framework for Edge Devices with Dynamic Power Management Yifan Gong Zheng Zhan Pu Zhao Yushu Wu Chaoan Wu Caiwen Ding Weiwen Jiang Minghai Qin Yanzhi Wang 28 7 0 09 Dec 2022
Dynamic Sparse Training via Balancing the Exploration-Exploitation Trade-off Shaoyi Huang Bowen Lei Dongkuan Xu Hongwu Peng Yue Sun Mimi Xie Caiwen Ding 26 19 0 30 Nov 2022
Where to Pay Attention in Sparse Training for Feature Selection? Ghada Sokar Zahra Atashgahi Mykola Pechenizkiy D. Mocanu 35 17 0 26 Nov 2022
Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training Zhenglun Kong Haoyu Ma Geng Yuan Mengshu Sun Yanyue Xie ... Tianlong Chen Xiaolong Ma Xiaohui Xie Zhangyang Wang Yanzhi Wang ViT 34 22 0 19 Nov 2022
Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities Brian Bartoldson B. Kailkhura Davis W. Blalock 31 47 0 13 Oct 2022
Why Random Pruning Is All We Need to Start Sparse Advait Gadhikar Sohom Mukherjee R. Burkholz 43 19 0 05 Oct 2022
Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training Geng Yuan Yanyu Li Sheng Li Zhenglun Kong Sergey Tulyakov Xulong Tang Yanzhi Wang Jian Ren 33 15 0 22 Sep 2022
SparCL: Sparse Continual Learning on the Edge Zifeng Wang Zheng Zhan Yifan Gong Geng Yuan Wei Niu T. Jian Bin Ren Stratis Ioannidis Yanzhi Wang Jennifer Dy CLL 63 58 0 20 Sep 2022