v1v2v3v4 (latest)

Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask

3 May 2019

Papers citing "Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask"

50 / 250 papers shown

Title
DASS: Differentiable Architecture Search for Sparse neural networks H. Mousavi Mohammad Loni Mina Alibeigi Masoud Daneshtalab 67 11 0 14 Jul 2022
Exploring Lottery Ticket Hypothesis in Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Ruokai Yin Priyadarshini Panda 129 48 0 04 Jul 2022
FasterAI: A Lightweight Library for Creating Sparse Neural Networks Nathan Hubens 23 0 0 03 Jul 2022
Winning the Lottery Ahead of Time: Efficient Early Network Pruning John Rachwan Daniel Zügner Bertrand Charpentier Simon Geisler Morgane Ayle Stephan Günnemann 79 26 0 21 Jun 2022
The State of Sparse Training in Deep Reinforcement Learning L. Graesser Utku Evci Erich Elsen Pablo Samuel Castro OffRL 75 40 0 17 Jun 2022
DiSparse: Disentangled Sparsification for Multitask Model Compression Xing Sun Ali Hassani Zhangyang Wang Gao Huang Humphrey Shi 129 21 0 09 Jun 2022
HideNseek: Federated Lottery Ticket via Server-side Pruning and Sign Supermask Anish K. Vallapuram Pengyuan Zhou Young D. Kwon Lik Hang Lee Hengwei Xu Pan Hui 57 10 0 09 Jun 2022
A Local Optima Network Analysis of the Feedforward Neural Architecture Space Isak Potgieter C. Cleghorn Anna Sergeevna Bosman 39 9 0 02 Jun 2022
Meta-ticket: Finding optimal subnetworks for few-shot learning within randomly initialized neural networks Daiki Chijiwa Shin'ya Yamaguchi Atsutoshi Kumagai Yasutoshi Ida 80 9 0 31 May 2022
Modular and On-demand Bias Mitigation with Attribute-Removal Subnetworks Lukas Hauzenberger Shahed Masoudian Deepak Kumar Markus Schedl Navid Rekabsaz 82 18 0 30 May 2022
E2FL: Equal and Equitable Federated Learning Hamid Mozaffari Amir Houmansadr FedML 74 10 0 20 May 2022
Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a Survey Paul Wimmer Jens Mehnert Alexandru Paul Condurache DD 91 21 0 17 May 2022
Analyzing Lottery Ticket Hypothesis from PAC-Bayesian Theory Perspective Keitaro Sakamoto Issei Sato 83 9 0 15 May 2022
Convolutional and Residual Networks Provably Contain Lottery Tickets R. Burkholz UQCV MLT 77 13 0 04 May 2022
Most Activation Functions Can Win the Lottery Without Excessive Depth R. Burkholz MLT 115 18 0 04 May 2022
Structured Pruning Learns Compact and Accurate Models Mengzhou Xia Zexuan Zhong Danqi Chen VLM 109 189 0 01 Apr 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 92 49 0 09 Mar 2022
Provable and Efficient Continual Representation Learning Yingcong Li Mingchen Li M. Salman Asif Samet Oymak CLL 59 13 0 03 Mar 2022
Extracting Effective Subnetworks with Gumbel-Softmax Robin Dupont M. Alaoui H. Sahbi A. Lebois 39 6 0 25 Feb 2022
Bit-wise Training of Neural Network Weights Cristian Ivan MQ 42 0 0 19 Feb 2022
Convolutional Network Fabric Pruning With Label Noise Ilias Benjelloun B. Lamiroy E. Koudou 40 0 0 15 Feb 2022
HARFE: Hard-Ridge Random Feature Expansion Esha Saha Hayden Schaeffer Giang Tran 119 15 0 06 Feb 2022
Robust Binary Models by Pruning Randomly-initialized Networks Chen Liu Ziqi Zhao Sabine Süsstrunk Mathieu Salzmann TPM AAML MQ 80 4 0 03 Feb 2022
Fortuitous Forgetting in Connectionist Networks Hattie Zhou Ankit Vani Hugo Larochelle Aaron Courville CLL 68 45 0 01 Feb 2022
Signing the Supermask: Keep, Hide, Invert Nils Koster O. Grothe Achim Rettinger 93 12 0 31 Jan 2022
OptG: Optimizing Gradient-driven Criteria in Network Sparsity Yuxin Zhang Mingbao Lin Mengzhao Chen Chia-Wen Lin Rongrong Ji 109 5 0 30 Jan 2022
A Multi-channel Training Method Boost the Performance Yingdong Hu 40 1 0 27 Dec 2021
Neural Network Module Decomposition and Recomposition Hiroaki Kingetsu Kenichi Kobayashi Taiji Suzuki 87 11 0 25 Dec 2021
Visualizing the Loss Landscape of Winning Lottery Tickets Robert Bain UQCV 70 3 0 16 Dec 2021
SHRIMP: Sparser Random Feature Models via Iterative Magnitude Pruning Yuege Xie Bobby Shi Hayden Schaeffer Rachel A. Ward 125 10 0 07 Dec 2021
Equal Bits: Enforcing Equally Distributed Binary Network Weights Yun-qiang Li S. Pintea Jan van Gemert MQ 89 15 0 02 Dec 2021
Putting 3D Spatially Sparse Networks on a Diet Junha Lee Chris Choy Jaesik Park 3DV 77 3 0 02 Dec 2021
The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image Yuki M. Asano Aaqib Saeed 92 7 0 01 Dec 2021
Hidden-Fold Networks: Random Recurrent Residuals Using Sparse Supermasks Ángel López García-Arias Masanori Hashimoto Masato Motomura Jaehoon Yu 61 5 0 24 Nov 2021
Plant ñ' Seek: Can You Find the Winning Ticket? Jonas Fischer R. Burkholz 81 21 0 22 Nov 2021
ConformalLayers: A non-linear sequential neural network with associative layers Zhen Wan Zhuoyuan Mao C. N. Vasconcelos 51 3 0 23 Oct 2021
Lottery Tickets with Nonzero Biases Jonas Fischer Advait Gadhikar R. Burkholz 59 6 0 21 Oct 2021
Finding Everything within Random Binary Networks Kartik K. Sreenivasan Shashank Rajput Jy-yong Sohn Dimitris Papailiopoulos 39 10 0 18 Oct 2021
S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks Shiyu Liu Chong Min John Tan Mehul Motani CLL 66 4 0 17 Oct 2021
Composable Sparse Fine-Tuning for Cross-Lingual Transfer Alan Ansell Edoardo Ponti Anna Korhonen Ivan Vulić CLL MoE 154 143 0 14 Oct 2021
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks Shuai Zhang Meng Wang Sijia Liu Pin-Yu Chen Jinjun Xiong UQCV MLT 76 13 0 12 Oct 2021
Mining the Weights Knowledge for Optimizing Neural Network Structures Mengqiao Han Xiabi Liu Zhaoyang Hai Xin Duan 15 1 0 11 Oct 2021
FRL: Federated Rank Learning Hamid Mozaffari Virat Shejwalkar Amir Houmansadr FedML 130 11 0 08 Oct 2021
End-to-End Supermask Pruning: Learning to Prune Image Captioning Models J. Tan C. Chan Joon Huang Chuah VLM 129 16 0 07 Oct 2021
What's Hidden in a One-layer Randomly Weighted Transformer? Sheng Shen Z. Yao Douwe Kiela Kurt Keutzer Michael W. Mahoney 50 4 0 08 Sep 2021
Continual learning under domain transfer with sparse synaptic bursting Shawn L. E. Beaulieu Jeff Clune Nick Cheney CLL OOD 73 1 0 26 Aug 2021
How much pre-training is enough to discover a good subnetwork? Cameron R. Wolfe Fangshuo Liao Qihan Wang Junhyung Lyle Kim Anastasios Kyrillidis 90 3 0 31 Jul 2021
A Lottery Ticket Hypothesis Framework for Low-Complexity Device-Robust Neural Acoustic Scene Classification Hao Yen Chao-Han Huck Yang Hu Hu Sabato Marco Siniscalchi Qing Wang ... Yuanjun Zhao Yuzhong Wu Yannan Wang Jun Du Chin-Hui Lee 52 17 0 03 Jul 2021
Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot? Xiaolong Ma Geng Yuan Xuan Shen Tianlong Chen Xuxi Chen ... Ning Liu Minghai Qin Sijia Liu Zhangyang Wang Yanzhi Wang 159 64 0 01 Jul 2021
AdaptCL: Efficient Collaborative Learning with Dynamic and Adaptive Pruning Guangmeng Zhou Ke Xu Qi Li Yang Liu Yi Zhao 54 8 0 27 Jun 2021