The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

9 March 2018

Papers citing "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"

50 / 746 papers shown

Title
Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verification Yen-Lun Liao Xuan-Bo Chen Chung-Che Wang J. Jang AAML 46 8 0 31 Mar 2022
PADA: Pruning Assisted Domain Adaptation for Self-Supervised Speech Representations L. D. Prasad Sreyan Ghosh S. Umesh 30 12 0 31 Mar 2022
1-D CNN based Acoustic Scene Classification via Reducing Layer-wise Dimensionality Arshdeep Singh 33 1 0 31 Mar 2022
TextPruner: A Model Pruning Toolkit for Pre-Trained Language Models Ziqing Yang Yiming Cui Zhigang Chen SyDa VLM 31 12 0 30 Mar 2022
CNN Filter DB: An Empirical Investigation of Trained Convolutional Filters Paul Gavrikov J. Keuper AAML 24 31 0 29 Mar 2022
Automated Progressive Learning for Efficient Training of Vision Transformers Changlin Li Bohan Zhuang Guangrun Wang Xiaodan Liang Xiaojun Chang Yi Yang 33 46 0 28 Mar 2022
Playing Lottery Tickets in Style Transfer Models Meihao Kong Jing Huo Wenbin Li Jing Wu Yu-Kun Lai Yang Gao 29 1 0 25 Mar 2022
Minimum Variance Unbiased N:M Sparsity for the Neural Gradients Brian Chmiel Itay Hubara Ron Banner Daniel Soudry 23 10 0 21 Mar 2022
Delta Keyword Transformer: Bringing Transformers to the Edge through Dynamically Pruned Multi-Head Self-Attention Zuzana Jelčicová Marian Verhelst 33 5 0 20 Mar 2022
Stability and Risk Bounds of Iterative Hard Thresholding Xiao-Tong Yuan P. Li 39 12 0 17 Mar 2022
Symmetry Group Equivariant Architectures for Physics A. Bogatskiy S. Ganguly Thomas Kipf Risi Kondor David W. Miller ... Jan T. Offermann M. Pettee P. Shanahan C. Shimmin S. Thais AI4CE 32 27 0 11 Mar 2022
Improve Convolutional Neural Network Pruning by Maximizing Filter Variety Nathan Hubens M. Mancas B. Gosselin Marius Preda T. Zaharia 21 2 0 11 Mar 2022
Language Adaptive Cross-lingual Speech Representation Learning with Sparse Sharing Sub-networks Yizhou Lu Mingkun Huang Xinghua Qu Pengfei Wei Zejun Ma 29 19 0 09 Mar 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 46 48 0 09 Mar 2022
Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing Performance Shiwei Liu Yuesong Tian Tianlong Chen Li Shen 41 8 0 05 Mar 2022
Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning Seunghyun Lee B. Song 32 8 0 05 Mar 2022
Structured Pruning is All You Need for Pruning CNNs at Initialization Yaohui Cai Weizhe Hua Hongzheng Chen G. E. Suh Christopher De Sa Zhiru Zhang CVBM 49 14 0 04 Mar 2022
Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning Weixin Liang Yuhui Zhang Yongchan Kwon Serena Yeung James Zou VLM 52 394 0 03 Mar 2022
Dynamic N:M Fine-grained Structured Sparse Attention Mechanism Zhaodong Chen Yuying Quan Zheng Qu L. Liu Yufei Ding Yuan Xie 36 22 0 28 Feb 2022
Extracting Effective Subnetworks with Gumbel-Softmax Robin Dupont M. Alaoui H. Sahbi A. Lebois 22 6 0 25 Feb 2022
The rise of the lottery heroes: why zero-shot pruning is hard Enzo Tartaglione 29 6 0 24 Feb 2022
Rare Gems: Finding Lottery Tickets at Initialization Kartik K. Sreenivasan Jy-yong Sohn Liu Yang Matthew Grinde Alliot Nagle Hongyi Wang Eric P. Xing Kangwook Lee Dimitris Papailiopoulos 32 42 0 24 Feb 2022
Wavebender GAN: An architecture for phonetically meaningful speech manipulation Gustavo Teodoro Döhler Beck Ulme Wennberg Zofia Malisz G. Henter AI4CE 32 8 0 22 Feb 2022
Sparsity Winning Twice: Better Robust Generalization from More Efficient Training Tianlong Chen Zhenyu Zhang Pengju Wang Santosh Balachandra Haoyu Ma Zehao Wang Zhangyang Wang OOD AAML 100 47 0 20 Feb 2022
Bit-wise Training of Neural Network Weights Cristian Ivan MQ 18 0 0 19 Feb 2022
A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruning Hengshun Zhou Jun Du Chao-Han Huck Yang Shifu Xiong Chin-Hui Lee VLM 26 3 0 17 Feb 2022
Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters Mingbao Lin Liujuan Cao Yuxin Zhang Ling Shao Chia-Wen Lin Rongrong Ji 37 51 0 15 Feb 2022
A Survey on Model Compression and Acceleration for Pretrained Language Models Canwen Xu Julian McAuley 33 58 0 15 Feb 2022
Finding Dynamics Preserving Adversarial Winning Tickets Xupeng Shi Pengfei Zheng Adam Ding Yuan Gao Weizhong Zhang AAML 31 1 0 14 Feb 2022
Evolving Neural Networks with Optimal Balance between Information Flow and Connections Cost A. Khalili A. Bouchachia 17 0 0 12 Feb 2022
Deadwooding: Robust Global Pruning for Deep Neural Networks Sawinder Kaur Ferdinando Fioretto Asif Salekin 32 4 0 10 Feb 2022
Membership Inference Attacks and Defenses in Neural Network Pruning Xiaoyong Yuan Lan Zhang AAML 24 44 0 07 Feb 2022
HARFE: Hard-Ridge Random Feature Expansion Esha Saha Hayden Schaeffer Giang Tran 45 14 0 06 Feb 2022
Differentiable Economics for Randomized Affine Maximizer Auctions Michael J. Curry T. Sandholm John P. Dickerson 41 29 0 06 Feb 2022
Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data Yaoqing Yang Ryan Theisen Liam Hodgkinson Joseph E. Gonzalez Kannan Ramchandran Charles H. Martin Michael W. Mahoney 97 17 0 06 Feb 2022
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models Chen Liang Haoming Jiang Simiao Zuo Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen T. Zhao 25 14 0 06 Feb 2022
Robust Binary Models by Pruning Randomly-initialized Networks Chen Liu Ziqi Zhao Sabine Süsstrunk Mathieu Salzmann TPM AAML MQ 32 4 0 03 Feb 2022
Accelerating DNN Training with Structured Data Gradient Pruning Bradley McDanel Helia Dinh J. Magallanes 19 7 0 01 Feb 2022
Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank? Sheikh Shams Azam Seyyedali Hosseinalipour Qiang Qiu Christopher G. Brinton FedML 36 20 0 01 Feb 2022
Fortuitous Forgetting in Connectionist Networks Hattie Zhou Ankit Vani Hugo Larochelle Aaron Courville CLL 16 42 0 01 Feb 2022
Signing the Supermask: Keep, Hide, Invert Nils Koster O. Grothe Achim Rettinger 36 10 0 31 Jan 2022
Backdoors Stuck At The Frontdoor: Multi-Agent Backdoor Attacks That Backfire Siddhartha Datta N. Shadbolt AAML 41 7 0 28 Jan 2022
On the Convergence of Heterogeneous Federated Learning with Arbitrary Adaptive Online Model Pruning Hanhan Zhou Tian-Shing Lan Guru Venkataramani Wenbo Ding FedML 32 6 0 27 Jan 2022
Achieving Personalized Federated Learning with Sparse Local Models Tiansheng Huang Shiwei Liu Li Shen Fengxiang He Weiwei Lin Dacheng Tao FedML 38 43 0 27 Jan 2022
Auto-Compressing Subset Pruning for Semantic Image Segmentation Konstantin Ditschuneit Johannes Otterbach 21 5 0 26 Jan 2022
Iterative Activation-based Structured Pruning Kaiqi Zhao Animesh Jain Ming Zhao 42 0 0 22 Jan 2022
Overview frequency principle/spectral bias in deep learning Z. Xu Tao Luo Yaoyu Zhang FaML 38 66 0 19 Jan 2022
Learning grammar with a divide-and-concur neural network S. Deyo V. Elser 21 0 0 18 Jan 2022
Moses: Efficient Exploitation of Cross-device Transferable Features for Tensor Program Optimization Zhihe Zhao Xian Shuai Yang Bai Neiwen Ling Nan Guan Zhenyu Yan Guoliang Xing 33 6 0 15 Jan 2022
Neural Circuit Architectural Priors for Embodied Control Nikhil X. Bhattasali A. Zador Tatiana A. Engel 88 5 0 13 Jan 2022