Proving the Lottery Ticket Hypothesis: Pruning is All You Need

3 February 2020

Papers citing "Proving the Lottery Ticket Hypothesis: Pruning is All You Need"

50 / 182 papers shown

Title
PrunePEFT: Iterative Hybrid Pruning for Parameter-Efficient Fine-tuning of LLMs Tongzhou Yu Zhuhao Zhang Guanghui Zhu Shen Jiang Meikang Qiu Yihua Huang 30 0 0 09 Jun 2025
Weisfeiler and Leman Go Gambling: Why Expressive Lottery Tickets Win Lorenz Kummer Samir Moustafa Anatol Ehrlich Franka Bause Nikolaus Suess Wilfried Gansterer Nils M. Kriege 57 0 0 04 Jun 2025
DeFTX: Denoised Sparse Fine-Tuning for Zero-Shot Cross-Lingual Transfer Sona Elza Simon Preethi Jyothi VLM 68 0 0 21 May 2025
Communication-Efficient Personalized Distributed Learning with Data and Node Heterogeneity Zhuojun Tian Zhaoyang Zhang Yiwei Li Mehdi Bennis 190 0 0 24 Apr 2025
PRISM: Privacy-Preserving Improved Stochastic Masking for Federated Generative Models Kyeongkook Seo Dong-Jun Han Jaejun Yoo 143 1 0 11 Mar 2025
Iterative Prompt Relocation for Distribution-Adaptive Visual Prompt Tuning Chikai Shang Mengke Li Yiqun Zhang Zhen Chen Jinlin Wu Fangqing Gu Yang Lu Yiu-ming Cheung VLM 111 0 0 10 Mar 2025
Sparse Brains are Also Adaptive Brains: Cognitive-Load-Aware Dynamic Activation for LLMs Yiheng Yang Yujie Wang Chi Ma Lei Yu Emmanuele Chersoni Chu-Ren Huang 146 0 0 26 Feb 2025
The impact of allocation strategies in subset learning on the expressive power of neural networks Ofir Schlisselberg Ran Darshan 125 0 0 10 Feb 2025
Information Consistent Pruning: How to Efficiently Search for Sparse Networks? Soheil Gharatappeh Salimeh Yasaei Sekeh 99 0 0 28 Jan 2025
Playing the Lottery With Concave Regularizers for Sparse Trainable Neural Networks Giulia Fracastoro Sophie M. Fosson Andrea Migliorati G. Calafiore 178 1 0 19 Jan 2025
Pushing the Limits of Sparsity: A Bag of Tricks for Extreme Pruning Andy Li A. Durrant Milan Markovic Lu Yin Georgios Leontidis Tianlong Chen Lu Yin Georgios Leontidis 175 0 0 20 Nov 2024
Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation Yu-Liang Zhan Zhong-Yi Lu Hao Sun Ze-Feng Gao 70 0 0 10 Nov 2024
Finding Strong Lottery Ticket Networks with Genetic Algorithms Philipp Altmann Julian Schonberger Maximilian Zorn Thomas Gabor 68 1 0 07 Nov 2024
Navigating Extremes: Dynamic Sparsity in Large Output Spaces Nasib Ullah Erik Schultheis Mike Lasby Yani Andrew Ioannou Rohit Babbar 114 1 0 05 Nov 2024
Uncovering Capabilities of Model Pruning in Graph Contrastive Learning Wu Junran Chen Xueyuan Li Shangzhe 95 1 0 27 Oct 2024
The Propensity for Density in Feed-forward Models Nandi Schoots Alex Jackson Ali Kholmovaia Peter McBurney Murray Shanahan CVBM 51 0 0 18 Oct 2024
Self-Masking Networks for Unsupervised Adaptation Alfonso Taboada Warmerdam Mathilde Caron Yuki M. Asano 81 2 0 11 Sep 2024
3D Point Cloud Network Pruning: When Some Weights Do not Matter Amrijit Biswas M. Hossain M. M. L. Elahi A. Cheraghian Fuad Rahman Nabeel Mohammed Shafin Rahman 3DPC 60 2 0 26 Aug 2024
First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models Chi Ma Mincong Huang Ying Zhang Chao Wang Yujie Wang Lei Yu Chuan Liu Wei Lin AI4CE LLMSV 81 2 0 21 Aug 2024
Mask in the Mirror: Implicit Sparsification Tom Jacobs R. Burkholz 191 4 0 19 Aug 2024
Masked Random Noise for Communication Efficient Federaetd Learning Shiwei Li Yingyi Cheng Haozhao Wang Xing Tang Shijie Xu Weihong Luo Yuhua Li Dugang Liu Xiuqiang He and Ruixuan Li FedML 79 2 0 06 Aug 2024
Sparsest Models Elude Pruning: An Exposé of Pruning's Current Capabilities Stephen Zhang Vardan Papyan 77 0 0 04 Jul 2024
Expressivity of Neural Networks with Random Weights and Learned Biases Ezekiel Williams Avery Hee-Woon Ryoo Thomas Jiralerspong Alexandre Payeur M. Perich Luca Mazzucato Guillaume Lajoie 137 2 0 01 Jul 2024
MOYU: A Theoretical Study on Massive Over-activation Yielded Uplifts in LLMs Chi Ma Mincong Huang Chao Wang Yujie Wang Lei Yu AI4CE 57 0 0 18 Jun 2024
Optimal Eye Surgeon: Finding Image Priors through Sparse Generators at Initialization Avrajit Ghosh Xitong Zhang Kenneth K. Sun Qing Qu S. Ravishankar Rongrong Wang MedIm 79 5 0 07 Jun 2024
Optimal Recurrent Network Topologies for Dynamical Systems Reconstruction Christoph Jürgen Hemmer Manuel Brenner Florian Hess Daniel Durstewitz 101 4 0 07 Jun 2024
Cyclic Sparse Training: Is it Enough? Advait Gadhikar Sree Harsha Nelaturu R. Burkholz CLL 95 0 0 04 Jun 2024
Sparser, Better, Deeper, Stronger: Improving Sparse Training with Exact Orthogonal Initialization A. Nowak Lukasz Gniecki Filip Szatkowski Jacek Tabor 80 1 0 03 Jun 2024
Survival of the Fittest Representation: A Case Study with Modular Addition Xiaoman Delores Ding Zifan Carl Guo Eric J. Michaud Ziming Liu Max Tegmark 119 4 0 27 May 2024
ONNXPruner: ONNX-Based General Model Pruning Adapter Dongdong Ren Wenbin Li Tianyu Ding Lei Wang Qi Fan Jing Huo Hongbing Pan Yang Gao 90 3 0 10 Apr 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 295 403 0 21 Mar 2024
A Survey of Lottery Ticket Hypothesis Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui UQCV 91 15 0 07 Mar 2024
Masks, Signs, And Learning Rate Rewinding Advait Gadhikar R. Burkholz 98 10 0 29 Feb 2024
How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers G. Buzaglo I. Harel Mor Shpigel Nacson Alon Brutzkus Nathan Srebro Daniel Soudry 124 7 0 09 Feb 2024
Less is KEN: a Universal and Simple Non-Parametric Pruning Algorithm for Large Language Models Michele Mastromattei Fabio Massimo Zanzotto VLM 71 1 0 05 Feb 2024
KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Models Fei Yuan Chang Ma Shuai Yuan Qiushi Sun Lei Li 57 3 0 05 Feb 2024
Defining Neural Network Architecture through Polytope Structures of Dataset Sangmin Lee Abbas Mammadov Jong Chul Ye 93 1 0 04 Feb 2024
Multicoated and Folded Graph Neural Networks with Strong Lottery Tickets Jiale Yan Hiroaki Ito Ángel López García-Arias Yasuyuki Okoshi Hikari Otsuka Kazushi Kawamura Thiem Van Chu Masato Motomura 86 4 0 06 Dec 2023
Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars Kaiyue Wen Yuchen Li Bing Liu Andrej Risteski 88 24 0 03 Dec 2023
Using Cooperative Game Theory to Prune Neural Networks M. Diaz-Ortiz Benjamin Kempinski Daphne Cornelisse Yoram Bachrach Tal Kachman 91 2 0 17 Nov 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets A. D. Cunha Francesco d’Amore Emanuele Natale MLT 66 1 0 16 Nov 2023
Bridging Lottery Ticket and Grokking: Understanding Grokking from Inner Structure of Networks Gouki Minegishi Yusuke Iwasawa Yutaka Matsuo 48 1 0 30 Oct 2023
Proving Linear Mode Connectivity of Neural Networks via Optimal Transport Damien Ferbach Baptiste Goujaud Gauthier Gidel Aymeric Dieuleveut MoMe 129 16 0 29 Oct 2023
Successfully Applying Lottery Ticket Hypothesis to Diffusion Model Chao Jiang Bo Hui Bohan Liu Da Yan DiffM 78 14 0 28 Oct 2023
Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modeling Zhenyu Zhu Francesco Locatello Volkan Cevher 74 7 0 27 Oct 2023
Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalization Zhuo Huang Muyang Li Li Shen Jun-chen Yu Chen Gong Bo Han Tongliang Liu OOD 118 11 0 25 Oct 2023
One is More: Diverse Perspectives within a Single Network for Efficient DRL Yiqin Tan Ling Pan Longbo Huang OffRL 80 0 0 21 Oct 2023
A Primer on Bayesian Neural Networks: Review and Debates Federico Danieli Konstantinos Pitas M. Vladimirova Vincent Fortuin BDL AAML 103 20 0 28 Sep 2023
Adaptive Consensus: A network pruning approach for decentralized optimization S. Shah A. Berahas Raghu Bollapragada 54 2 0 06 Sep 2023
Equitable-FL: Federated Learning with Sparsity for Resource-Constrained Environment Indrajeet Kumar Sinha Shekhar Verma Krishna Pratap Singh FedML 150 0 0 02 Sep 2023