The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

9 March 2018

Papers citing "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"

50 / 2,031 papers shown

Title
HCDG: A Hierarchical Consistency Framework for Domain Generalization on Medical Image Segmentation Yijun Yang Shujun Wang Lei Zhu Lequan Yu 136 11 0 13 Sep 2021
Illuminating Diverse Neural Cellular Automata for Level Generation Sam Earle J. Snider Matthew C. Fontaine Stefanos Nikolaidis Julian Togelius 114 37 0 12 Sep 2021
Prioritized Subnet Sampling for Resource-Adaptive Supernet Training Bohong Chen Mingbao Lin Rongrong Ji Liujuan Cao 34 2 0 12 Sep 2021
What's Hidden in a One-layer Randomly Weighted Transformer? Sheng Shen Z. Yao Douwe Kiela Kurt Keutzer Michael W. Mahoney 50 4 0 08 Sep 2021
Juvenile state hypothesis: What we can learn from lottery ticket hypothesis researches? Di Zhang 33 1 0 08 Sep 2021
Fair Comparison: Quantifying Variance in Resultsfor Fine-grained Visual Categorization M. Gwilliam Adam Teuscher Connor Anderson Ryan Farrell 45 13 1 07 Sep 2021
Cluster-Promoting Quantization with Bit-Drop for Minimizing Network Quantization Loss J. H. Lee Jihun Yun Sung Ju Hwang Eunho Yang MQ 89 15 0 05 Sep 2021
Sparsifying the Update Step in Graph Neural Networks J. Lutzeyer Changmin Wu Michalis Vazirgiannis 77 4 0 02 Sep 2021
LightNER: A Lightweight Tuning Paradigm for Low-resource NER via Pluggable Prompting Xiang Chen Lei Li Shumin Deng Chuanqi Tan Changliang Xu Fei Huang Luo Si Huajun Chen Ningyu Zhang VLM 126 71 0 31 Aug 2021
Pruning with Compensation: Efficient Channel Pruning for Deep Convolutional Neural Networks Zhouyang Xie Yan Fu Sheng-Zhao Tian Junlin Zhou Duanbing Chen 3DV 43 0 0 31 Aug 2021
On the effects of biased quantum random numbers on the initialization of artificial neural networks R. Heese Moritz Wolter Sascha Mucke L. Franken Nico Piatkowski 143 3 0 30 Aug 2021
Neuron-level Interpretation of Deep NLP Models: A Survey Hassan Sajjad Nadir Durrani Fahim Dalvi MILM AI4CE 108 85 0 30 Aug 2021
Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions Yang Wu Dingheng Wang Xiaotong Lu Fan Yang Guoqi Li W. Dong Jianbo Shi 100 18 0 30 Aug 2021
Layer Adaptive Node Selection in Bayesian Neural Networks: Statistical Guarantees and Implementation Details Sanket Jantre Shrijita Bhattacharya T. Maiti BDL 88 13 0 25 Aug 2021
Greenformers: Improving Computation and Memory Efficiency in Transformer Models via Low-Rank Approximation Samuel Cahyawijaya 103 12 0 24 Aug 2021
Pruning in the Face of Adversaries F. Merkle Maximilian Samsinger Pascal Schöttle AAML CVBM 61 3 0 19 Aug 2021
An Information Theory-inspired Strategy for Automatic Network Pruning Xiawu Zheng Yuexiao Ma Teng Xi Gang Zhang Errui Ding Yuchao Li Jie Chen Yonghong Tian Rongrong Ji 191 13 0 19 Aug 2021
Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search Zheng Zhan Yifan Gong Pu Zhao Geng Yuan Wei Niu ... Malith Jayaweera David Kaeli Bin Ren Xue Lin Yanzhi Wang SupR 69 42 0 18 Aug 2021
A fast asynchronous MCMC sampler for sparse Bayesian inference Yves F. Atchadé Liwei Wang 46 3 0 14 Aug 2021
Towards Structured Dynamic Sparse Pre-Training of BERT A. Dietrich Frithjof Gressmann Douglas Orr Ivan Chelombiev Daniel Justus Carlo Luschi 66 17 0 13 Aug 2021
Learning Transferable Parameters for Unsupervised Domain Adaptation Zhongyi Han Haoliang Sun Yilong Yin OOD 87 47 0 13 Aug 2021
Logic Explained Networks Gabriele Ciravegna Pietro Barbiero Francesco Giannini Marco Gori Pietro Lio Marco Maggini S. Melacci 90 70 0 11 Aug 2021
On the Effect of Pruning on Adversarial Robustness Artur Jordão Hélio Pedrini AAML 111 23 0 10 Aug 2021
Differentiable Subset Pruning of Transformer Heads Jiaoda Li Ryan Cotterell Mrinmaya Sachan 134 57 0 10 Aug 2021
Membership Inference Attacks on Lottery Ticket Networks Aadesh Bagmar Shishira R. Maiya Shruti Bidwalka Amol Deshpande MIACV 92 5 0 07 Aug 2021
Spartus: A 9.4 TOp/s FPGA-based LSTM Accelerator Exploiting Spatio-Temporal Sparsity Chang Gao T. Delbruck Shih-Chii Liu 72 46 0 04 Aug 2021
Curriculum learning for language modeling Daniel Fernando Campos 57 33 0 04 Aug 2021
Learning Compatible Embeddings Qiang Meng Chixiang Zhang Xiaoqiang Xu F. Zhou VLM 66 38 0 04 Aug 2021
Grounding Representation Similarity with Statistical Testing Frances Ding Jean-Stanislas Denain Jacob Steinhardt 80 30 0 03 Aug 2021
Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer Yifan Xu Zhijie Zhang Mengdan Zhang Kekai Sheng Ke Li Weiming Dong Liqing Zhang Changsheng Xu Xing Sun ViT 94 215 0 03 Aug 2021
How much pre-training is enough to discover a good subnetwork? Cameron R. Wolfe Fangshuo Liao Qihan Wang Junhyung Lyle Kim Anastasios Kyrillidis 84 3 0 31 Jul 2021
The History of Speech Recognition to the Year 2030 Awni Y. Hannun AI4TS 121 21 0 30 Jul 2021
Model Preserving Compression for Neural Networks Jerry Chee Megan Flynn Anil Damle Chris De Sa 33 10 0 30 Jul 2021
Structure and Performance of Fully Connected Neural Networks: Emerging Complex Network Properties Leonardo F. S. Scabini Odemir M. Bruno GNN 38 58 0 29 Jul 2021
New Metrics to Evaluate the Performance and Fairness of Personalized Federated Learning Siddharth Divi Yi-Shan Lin Habiba Farrukh Z. Berkay Celik FedML 122 18 0 28 Jul 2021
Experiments on Properties of Hidden Structures of Sparse Neural Networks Julian Stier Harsh Darji Michael Granitzer 35 2 0 27 Jul 2021
COPS: Controlled Pruning Before Training Starts Paul Wimmer Jens Mehnert Alexandru Paul Condurache 51 8 0 27 Jul 2021
Rethinking Hard-Parameter Sharing in Multi-Domain Learning Lijun Zhang Qizheng Yang Xiao Liu Hui Guan OOD 77 15 0 23 Jul 2021
More Parameters? No Thanks! Zeeshan Khan Kartheek Akella Vinay P. Namboodiri C. V. Jawahar 40 1 0 20 Jul 2021
Towards Low-Latency Energy-Efficient Deep SNNs via Attention-Guided Compression Souvik Kundu Gourav Datta Massoud Pedram Peter A. Beerel 64 14 0 16 Jul 2021
Only Train Once: A One-Shot Neural Network Training And Pruning Framework Tianyi Chen Bo Ji Tianyu Ding Biyi Fang Guanyi Wang Zhihui Zhu Luming Liang Yixin Shi Sheng Yi Xiao Tu 127 105 0 15 Jul 2021
Training for temporal sparsity in deep neural networks, application in video processing Amirreza Yousefzadeh Manolis Sifalakis 67 3 0 15 Jul 2021
Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion Mingbao Lin Bohong Chen Chia-Wen Lin Rongrong Ji VLM 73 23 0 14 Jul 2021
Correlation Analysis between the Robustness of Sparse Neural Networks and their Random Hidden Structural Priors M. B. Amor Julian Stier Michael Granitzer OOD AAML 19 2 0 13 Jul 2021
How many degrees of freedom do we need to train deep networks: a loss landscape perspective Brett W. Larsen Stanislav Fort Nico Becker Surya Ganguli UQCV 114 29 0 13 Jul 2021
LANA: Latency Aware Network Acceleration Pavlo Molchanov Jimmy Hall Hongxu Yin Jan Kautz Nicolò Fusi Arash Vahdat 129 10 0 12 Jul 2021
Structured Directional Pruning via Perturbation Orthogonal Projection YinchuanLi XiaofengLiu YunfengShao QingWang YanhuiGeng 41 2 0 12 Jul 2021
HEMP: High-order Entropy Minimization for neural network comPression Enzo Tartaglione Stéphane Lathuilière Attilio Fiandrotti Marco Cagnazzo Marco Grangetto MQ 46 7 0 12 Jul 2021
Blending Pruning Criteria for Convolutional Neural Networks Wei He Zhongzhan Huang Mingfu Liang Senwei Liang Haizhao Yang CVBM 65 15 0 11 Jul 2021
Joint Matrix Decomposition for Deep Convolutional Neural Networks Compression Shaowu Chen Jihao Zhou Weize Sun Lei Huang 34 21 0 09 Jul 2021