The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

9 March 2018

Papers citing "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"

50 / 2,030 papers shown

Title
Learning N:M Fine-grained Structured Sparse Neural Networks From Scratch Aojun Zhou Yukun Ma Junnan Zhu Jianbo Liu Zhijie Zhang Kun Yuan Wenxiu Sun Hongsheng Li 215 250 0 08 Feb 2021
Extracting the Auditory Attention in a Dual-Speaker Scenario from EEG using a Joint CNN-LSTM Model Ivine Kuruvila J. Muncke Eghart Fischer U. Hoppe 30 25 0 08 Feb 2021
SeReNe: Sensitivity based Regularization of Neurons for Structured Sparsity in Neural Networks Enzo Tartaglione Andrea Bragagnolo Francesco Odierna Attilio Fiandrotti Marco Grangetto 88 18 0 07 Feb 2021
A Deeper Look into Convolutions via Eigenvalue-based Pruning Ilke Çugu Emre Akbas FAtt 28 1 0 04 Feb 2021
A Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network Mo Zhou Rong Ge Chi Jin 145 46 0 04 Feb 2021
Truly Sparse Neural Networks at Scale Selima Curci Decebal Constantin Mocanu Mykola Pechenizkiy 141 22 0 02 Feb 2021
Spectral Roll-off Points Variations: Exploring Useful Information in Feature Maps by Its Variations Yunkai Yu Yuyang You Zhihong Yang Guozheng Liu Peiyao Li Zhicheng Yang Wenjing Shan 37 2 0 31 Jan 2021
A Unified Paths Perspective for Pruning at Initialization Thomas Gebhart Udit Saxena Paul Schrater 88 14 0 26 Jan 2021
Pruning and Quantization for Deep Neural Network Acceleration: A Survey Tailin Liang C. Glossner Lei Wang Shaobo Shi Xiaotong Zhang MQ 233 704 0 24 Jan 2021
Time-Correlated Sparsification for Communication-Efficient Federated Learning Emre Ozfatura Kerem Ozfatura Deniz Gunduz FedML 86 49 0 21 Jan 2021
Zero-Cost Proxies for Lightweight NAS Mohamed S. Abdelfattah Abhinav Mehrotra Łukasz Dudziak Nicholas D. Lane 85 261 0 20 Jan 2021
Network Pruning using Adaptive Exemplar Filters Mingbao Lin Rongrong Ji Shaojie Li Yan Wang Yongjian Wu Feiyue Huang QiXiang Ye VLM 70 54 0 20 Jan 2021
SparseDNN: Fast Sparse Deep Learning Inference on CPUs Ziheng Wang MQ 194 20 0 20 Jan 2021
Learnable Embedding Sizes for Recommender Systems Siyi Liu Chen Gao Yihong Chen Depeng Jin Yong Li 136 86 0 19 Jan 2021
ES-ENAS: Efficient Evolutionary Optimization for Large Hybrid Search Spaces Xingyou Song K. Choromanski Jack Parker-Holder Yunhao Tang Qiuyi Zhang ... Deepali Jain Wenbo Gao Aldo Pacchiano Tamás Sarlós Yuxiang Yang 66 0 0 19 Jan 2021
Knowledge Distillation Methods for Efficient Unsupervised Adaptation Across Multiple Domains Le Thanh Nguyen-Meidine Atif Belal M. Kiran Jose Dolz Louis-Antoine Blais-Morin Eric Granger 83 27 0 18 Jan 2021
Model Compression for Domain Adaptation through Causal Effect Estimation Guy Rotman Amir Feder Roi Reichart CML 77 7 0 18 Jan 2021
KCP: Kernel Cluster Pruning for Dense Labeling Neural Networks Po-Hsiang Yu Sih-Sian Wu Liang-Gee Chen VLM 27 0 0 17 Jan 2021
Slot Machines: Discovering Winning Combinations of Random Weights in Neural Networks Maxwell Mbabilla Aladago Lorenzo Torresani 54 10 0 16 Jan 2021
Rescaling CNN through Learnable Repetition of Network Parameters Arnav Chavan Udbhav Bamba Rishabh Tiwari D. K. Gupta 22 0 0 14 Jan 2021
Activation Density based Mixed-Precision Quantization for Energy Efficient Neural Networks Karina Vasquez Yeshwanth Venkatesha Abhiroop Bhattacharjee Abhishek Moitra Priyadarshini Panda MQ 73 15 0 12 Jan 2021
Deeplite Neutrino: An End-to-End Framework for Constrained Deep Learning Model Optimization A. Sankaran Olivier Mastropietro Ehsan Saboori Yasser Idris Davis Sawyer Mohammadhossein Askarihemmat G. B. Hacene 73 4 0 11 Jan 2021
Spending Your Winning Lottery Better After Drawing It Ajay Jaiswal Haoyu Ma Tianlong Chen Ying Ding Zhangyang Wang 48 6 0 08 Jan 2021
EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets Xiaohan Chen Yu Cheng Shuohang Wang Zhe Gan Zhangyang Wang Jingjing Liu 113 100 0 31 Dec 2020
Reservoir Transformers Sheng Shen Alexei Baevski Ari S. Morcos Kurt Keutzer Michael Auli Douwe Kiela 84 18 0 30 Dec 2020
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps Tri Dao N. Sohoni Albert Gu Matthew Eichhorn Amit Blonder Megan Leszczynski Atri Rudra Christopher Ré 90 49 0 29 Dec 2020
Disentangling semantics in language through VAEs and a certain architectural choice G. Felhi Joseph Le Roux Djamé Seddah CoGe DRL 41 1 0 24 Dec 2020
A Survey on Visual Transformer Kai Han Yunhe Wang Hanting Chen Xinghao Chen Jianyuan Guo ... Chunjing Xu Yixing Xu Zhaohui Yang Yiman Zhang Dacheng Tao ViT 229 2,262 0 23 Dec 2020
Finding Sparse Structures for Domain Specific Neural Machine Translation Jianze Liang Chengqi Zhao Mingxuan Wang Xipeng Qiu Lei Li CLL 73 4 0 19 Dec 2020
Enabling Retrain-free Deep Neural Network Pruning using Surrogate Lagrangian Relaxation Deniz Gurevin Shangli Zhou Lynn Pepin Bingbing Li Mikhail A. Bragin Caiwen Ding Fei Miao 28 3 0 18 Dec 2020
Provable Benefits of Overparameterization in Model Compression: From Double Descent to Pruning Neural Networks Xiangyu Chang Yingcong Li Samet Oymak Christos Thrampoulidis 86 51 0 16 Dec 2020
NeurIPS 2020 Competition: Predicting Generalization in Deep Learning Yiding Jiang Pierre Foret Scott Yak Daniel M. Roy H. Mobahi Gintare Karolina Dziugaite Samy Bengio Suriya Gunasekar Isabelle M Guyon Behnam Neyshabur Google Research OOD 74 55 0 14 Dec 2020
The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Michael Carbin Zhangyang Wang 95 123 0 12 Dec 2020
Sparsifying networks by traversing Geodesics G. Raghavan Matt Thomson 16 2 0 12 Dec 2020
Robustness and Transferability of Universal Attacks on Compressed Models Alberto G. Matachana Kenneth T. Co Luis Muñoz-González David Martínez Emil C. Lupu AAML 48 10 0 10 Dec 2020
Interpreting Neural Networks as Gradual Argumentation Frameworks (Including Proof Appendix) Nico Potyka AI4CE 111 50 0 10 Dec 2020
The Lottery Ticket Hypothesis for Object Recognition Sharath Girish Shishira R. Maiya Kamal Gupta Hao Chen L. Davis Abhinav Shrivastava 144 61 0 08 Dec 2020
Rethinking FUN: Frequency-Domain Utilization Networks Kfir Goldberg Stav Shapiro Elad Richardson S. Avidan 54 8 0 06 Dec 2020
Effect of the initial configuration of weights on the training and function of artificial neural networks Ricardo J. Jesus Mário Antunes R. A. D. Costa S. Dorogovtsev J. F. F. Mendes R. Aguiar 61 15 0 04 Dec 2020
The Self-Simplifying Machine: Exploiting the Structure of Piecewise Linear Neural Networks to Create Interpretable Models William Knauth 14 1 0 02 Dec 2020
An Once-for-All Budgeted Pruning Framework for ConvNets Considering Input Resolution Wenyu Sun Jian Cao Pengtao Xu Xiangcheng Liu Pu Li 36 0 0 02 Dec 2020
NPAS: A Compiler-aware Framework of Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration Zhengang Li Geng Yuan Wei Niu Pu Zhao Yanyu Li ... Sijia Liu Kaiyuan Yang Bin Ren Yanzhi Wang Xue Lin MQ 100 27 0 01 Dec 2020
Quick and Robust Feature Selection: the Strength of Energy-efficient Sparse Training for Autoencoders Zahra Atashgahi Ghada Sokar T. Lee Elena Mocanu Decebal Constantin Mocanu Raymond N. J. Veldhuis Mykola Pechenizkiy 94 41 0 01 Dec 2020
Unsupervised Anomaly Detection From Semantic Similarity Scores Nima Rafiee Rahil Gholamipoor M. Kollmann OODD 34 2 0 01 Dec 2020
Solvable Model for Inheriting the Regularization through Knowledge Distillation Luca Saglietti Lenka Zdeborová 46 20 0 01 Dec 2020
Deconstructing the Structure of Sparse Neural Networks M. V. Gelder Mitchell Wortsman Kiana Ehsani 28 1 0 30 Nov 2020
Locally Linear Attributes of ReLU Neural Networks Benjamin Sattelberg R. Cavalieri Michael Kirby C. Peterson Ross Beveridge FAtt 45 10 0 30 Nov 2020
KD-Lib: A PyTorch library for Knowledge Distillation, Pruning and Quantization Het Shah Avishree Khare Neelay Shah Khizir Siddiqui MQ 40 6 0 30 Nov 2020
Towards Fast and Light-Weight Restoration of Dark Images Mohit Lamba Atul Balaji Kaushik Mitra 51 26 0 28 Nov 2020
FreezeNet: Full Performance by Reduced Storage Costs Paul Wimmer Jens Mehnert Alexandru Paul Condurache 77 13 0 28 Nov 2020