The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

9 March 2018

Papers citing "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"

50 / 746 papers shown

Title
Weight Evolution: Improving Deep Neural Networks Training through Evolving Inferior Weight Values Zhenquan Lin K. Guo Xiaofen Xing Xiangmin Xu ODL 24 1 0 09 Oct 2021
Towards Sample-efficient Apprenticeship Learning from Suboptimal Demonstration Letian Chen Rohan R. Paleja Matthew C. Gombolay 21 2 0 08 Oct 2021
End-to-End Supermask Pruning: Learning to Prune Image Captioning Models J. Tan C. Chan Joon Huang Chuah VLM 54 16 0 07 Oct 2021
Efficient and Private Federated Learning with Partially Trainable Networks Hakim Sidahmed Zheng Xu Ankush Garg Yuan Cao Mingqing Chen FedML 59 13 0 06 Oct 2021
On the Interplay Between Sparsity, Naturalness, Intelligibility, and Prosody in Speech Synthesis Cheng-I Jeff Lai Erica Cooper Yang Zhang Shiyu Chang Kaizhi Qian ... Yung-Sung Chuang Alexander H. Liu Junichi Yamagishi David D. Cox James R. Glass 26 6 0 04 Oct 2021
Powerpropagation: A sparsity inducing weight reparameterisation Jonathan Richard Schwarz Siddhant M. Jayakumar Razvan Pascanu P. Latham Yee Whye Teh 98 54 0 01 Oct 2021
Prune Your Model Before Distill It Jinhyuk Park Albert No VLM 48 27 0 30 Sep 2021
RED++ : Data-Free Pruning of Deep Neural Networks via Input Splitting and Output Merging Edouard Yvinec Arnaud Dapogny Matthieu Cord Kévin Bailly 33 15 0 30 Sep 2021
Recent Advances of Continual Learning in Computer Vision: An Overview Haoxuan Qu Hossein Rahmani Li Xu Bryan M. Williams Jun Liu VLM CLL 30 73 0 23 Sep 2021
Neural network relief: a pruning algorithm based on neural activity Aleksandr Dekhovich David Tax M. Sluiter Miguel A. Bessa 46 10 0 22 Sep 2021
Backdoor Attacks on Federated Learning with Lottery Ticket Hypothesis Zeyuan Yin Ye Yuan Panfeng Guo Pan Zhou FedML 45 7 0 22 Sep 2021
HCDG: A Hierarchical Consistency Framework for Domain Generalization on Medical Image Segmentation Yijun Yang Shujun Wang Lei Zhu Lequan Yu 37 10 0 13 Sep 2021
Illuminating Diverse Neural Cellular Automata for Level Generation Sam Earle J. Snider Matthew C. Fontaine Stefanos Nikolaidis Julian Togelius 56 37 0 12 Sep 2021
Prioritized Subnet Sampling for Resource-Adaptive Supernet Training Bohong Chen Mingbao Lin Rongrong Ji Liujuan Cao 32 2 0 12 Sep 2021
What's Hidden in a One-layer Randomly Weighted Transformer? Sheng Shen Z. Yao Douwe Kiela Kurt Keutzer Michael W. Mahoney 34 4 0 08 Sep 2021
LightNER: A Lightweight Tuning Paradigm for Low-resource NER via Pluggable Prompting Xiang Chen Lei Li Shumin Deng Chuanqi Tan Changliang Xu Fei Huang Luo Si Huajun Chen Ningyu Zhang VLM 42 65 0 31 Aug 2021
Neuron-level Interpretation of Deep NLP Models: A Survey Hassan Sajjad Nadir Durrani Fahim Dalvi MILM AI4CE 40 82 0 30 Aug 2021
Greenformers: Improving Computation and Memory Efficiency in Transformer Models via Low-Rank Approximation Samuel Cahyawijaya 31 12 0 24 Aug 2021
An Information Theory-inspired Strategy for Automatic Network Pruning Xiawu Zheng Yuexiao Ma Teng Xi Gang Zhang Errui Ding Yuchao Li Jie Chen Yonghong Tian Rongrong Ji 54 13 0 19 Aug 2021
Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search Zheng Zhan Yifan Gong Pu Zhao Geng Yuan Wei Niu ... Malith Jayaweera David Kaeli Bin Ren Xue Lin Yanzhi Wang SupR 38 41 0 18 Aug 2021
Learning Transferable Parameters for Unsupervised Domain Adaptation Zhongyi Han Haoliang Sun Yilong Yin OOD 35 45 0 13 Aug 2021
Logic Explained Networks Gabriele Ciravegna Pietro Barbiero Francesco Giannini Marco Gori Pietro Lio Marco Maggini S. Melacci 42 69 0 11 Aug 2021
Differentiable Subset Pruning of Transformer Heads Jiaoda Li Ryan Cotterell Mrinmaya Sachan 45 54 0 10 Aug 2021
Spartus: A 9.4 TOp/s FPGA-based LSTM Accelerator Exploiting Spatio-Temporal Sparsity Chang Gao T. Delbruck Shih-Chii Liu 23 44 0 04 Aug 2021
Curriculum learning for language modeling Daniel Fernando Campos 16 32 0 04 Aug 2021
Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer Yifan Xu Zhijie Zhang Mengdan Zhang Kekai Sheng Ke Li Weiming Dong Liqing Zhang Changsheng Xu Xing Sun ViT 34 205 0 03 Aug 2021
Rethinking Hard-Parameter Sharing in Multi-Domain Learning Lijun Zhang Qizheng Yang Xiao Liu Hui Guan OOD 36 14 0 23 Jul 2021
Towards Low-Latency Energy-Efficient Deep SNNs via Attention-Guided Compression Souvik Kundu Gourav Datta Massoud Pedram Peter A. Beerel 23 14 0 16 Jul 2021
Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion Mingbao Lin Bohong Chen Rongrong Ji Rongrong Ji VLM 35 23 0 14 Jul 2021
Immunization of Pruning Attack in DNN Watermarking Using Constant Weight Code Minoru Kuribayashi Tatsuya Yasui Asad U. Malik N. Funabiki AAML 23 1 0 07 Jul 2021
A Lottery Ticket Hypothesis Framework for Low-Complexity Device-Robust Neural Acoustic Scene Classification Hao Yen Chao-Han Huck Yang Hu Hu Sabato Marco Siniscalchi Qing Wang ... Yuanjun Zhao Yuzhong Wu Yannan Wang Jun Du Chin-Hui Lee 19 16 0 03 Jul 2021
Learned Token Pruning for Transformers Sehoon Kim Sheng Shen D. Thorsley A. Gholami Woosuk Kwon Joseph Hassoun Kurt Keutzer 17 146 0 02 Jul 2021
What do End-to-End Speech Models Learn about Speaker, Language and Channel Information? A Layer-wise and Neuron-level Analysis Shammur A. Chowdhury Nadir Durrani Ahmed M. Ali 49 12 0 01 Jul 2021
Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot? Xiaolong Ma Geng Yuan Xuan Shen Tianlong Chen Xuxi Chen ... Ning Liu Minghai Qin Sijia Liu Zhangyang Wang Yanzhi Wang 30 63 0 01 Jul 2021
Laplace Redux -- Effortless Bayesian Deep Learning Erik A. Daxberger Agustinus Kristiadi Alexander Immer Runa Eschenhagen Matthias Bauer Philipp Hennig BDL UQCV 63 290 0 28 Jun 2021
LNS-Madam: Low-Precision Training in Logarithmic Number System using Multiplicative Weight Update Jiawei Zhao Steve Dai Rangharajan Venkatesan Brian Zimmer Mustafa Ali Xuan Li Brucek Khailany B. Dally Anima Anandkumar MQ 39 13 0 26 Jun 2021
Sparse Flows: Pruning Continuous-depth Models Lucas Liebenwein Ramin Hasani Alexander Amini Daniela Rus 26 16 0 24 Jun 2021
Sparse Training via Boosting Pruning Plasticity with Neuroregeneration Shiwei Liu Tianlong Chen Xiaohan Chen Zahra Atashgahi Lu Yin Huanyu Kou Li Shen Mykola Pechenizkiy Zhangyang Wang Decebal Constantin Mocanu 45 112 0 19 Jun 2021
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models Elad Ben-Zaken Shauli Ravfogel Yoav Goldberg 100 1,164 0 18 Jun 2021
A Random CNN Sees Objects: One Inductive Bias of CNN and Its Applications Yun Cao Jianxin Wu SSL 31 26 0 17 Jun 2021
Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI Geng Yuan Zhiheng Liao Xiaolong Ma Yuxuan Cai Zhenglun Kong ... Hongwu Peng Ning Liu Ao Ren Jinhui Wang Yanzhi Wang AAML 38 33 0 16 Jun 2021
A Winning Hand: Compressing Deep Networks Can Improve Out-Of-Distribution Robustness James Diffenderfer Brian Bartoldson Shreya Chaganti Jize Zhang B. Kailkhura OOD 31 69 0 16 Jun 2021
Towards Understanding Iterative Magnitude Pruning: Why Lottery Tickets Win Jaron Maene Mingxiao Li Marie-Francine Moens 13 15 0 13 Jun 2021
XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation Subhabrata Mukherjee Ahmed Hassan Awadallah Jianfeng Gao 19 22 0 08 Jun 2021
Efficient Lottery Ticket Finding: Less Data is More Zhenyu Zhang Xuxi Chen Tianlong Chen Zhangyang Wang 19 54 0 06 Jun 2021
Can Subnetwork Structure be the Key to Out-of-Distribution Generalization? Dinghuai Zhang Kartik Ahuja Yilun Xu Yisen Wang Aaron Courville OOD 30 95 0 05 Jun 2021
GANs Can Play Lottery Tickets Too Xuxi Chen Zhenyu Zhang Yongduo Sui Tianlong Chen GAN 24 58 0 31 May 2021
1xN Pattern for Pruning Convolutional Neural Networks Mingbao Lin Yu-xin Zhang Yuchao Li Bohong Chen Rongrong Ji Mengdi Wang Shen Li Yonghong Tian Rongrong Ji 3DPC 33 40 0 31 May 2021
Joint-DetNAS: Upgrade Your Detector with NAS, Pruning and Dynamic Distillation Lewei Yao Renjie Pi Hang Xu Wei Zhang Zhenguo Li Tong Zhang 89 38 0 27 May 2021
Learning Language Specific Sub-network for Multilingual Machine Translation Zehui Lin Liwei Wu Mingxuan Wang Lei Li 24 81 0 19 May 2021