The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

9 March 2018

Papers citing "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"

50 / 2,030 papers shown

Title
Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework Wenxiao Wang Minghao Chen Shuai Zhao Long Chen Jinming Hu Haifeng Liu Deng Cai Xiaofei He Wei Liu 112 60 0 10 Oct 2020
Self-play for Data Efficient Language Acquisition Charles Lovering Ellie Pavlick SyDa 32 0 0 10 Oct 2020
AxFormer: Accuracy-driven Approximation of Transformers for Faster, Smaller and more Accurate NLP Models Amrit Nagarajan Sanchari Sen Jacob R. Stevens A. Raghunathan 18 3 0 07 Oct 2020
Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win Utku Evci Yani Andrew Ioannou Cem Keskin Yann N. Dauphin 63 94 0 07 Oct 2020
Less is more: Faster and better music version identification with embedding distillation Furkan Yesiler Joan Serrà E. Gómez 29 11 0 07 Oct 2020
Winning Lottery Tickets in Deep Generative Models Neha Kalibhat Yogesh Balaji Soheil Feizi WIGM 94 42 0 05 Oct 2020
Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks Róbert Csordás Sjoerd van Steenkiste Jürgen Schmidhuber 102 97 0 05 Oct 2020
HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients Enmao Diao Jie Ding Vahid Tarokh FedML 100 560 0 03 Oct 2020
Data-Efficient Pretraining via Contrastive Self-Supervision Nils Rethmeier Isabelle Augenstein 100 21 0 02 Oct 2020
Which *BERT? A Survey Organizing Contextualized Encoders Patrick Xia Shijie Wu Benjamin Van Durme 60 50 0 02 Oct 2020
Pruning Filter in Filter Fanxu Meng Hao Cheng Ke Li Huixiang Luo Xiao-Wei Guo Guangming Lu Xing Sun VLM 83 108 0 30 Sep 2020
Grow-Push-Prune: aligning deep discriminants for effective structural network compression Qing Tian Tal Arbel James J. Clark 24 8 0 29 Sep 2020
Learning Optimal Representations with the Decodable Information Bottleneck Yann Dubois Douwe Kiela D. Schwab Ramakrishna Vedantam 115 43 0 27 Sep 2020
A Gradient Flow Framework For Analyzing Network Pruning Ekdeep Singh Lubana Robert P. Dick 127 52 0 24 Sep 2020
Procrustes: a Dataflow and Accelerator for Sparse Deep Neural Network Training Dingqing Yang Amin Ghasemazar X. Ren Maximilian Golub G. Lemieux Mieszko Lis 68 49 0 23 Sep 2020
Pruning Convolutional Filters using Batch Bridgeout Najeeb Khan Ian Stavness 35 3 0 23 Sep 2020
Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot Jingtong Su Yihang Chen Tianle Cai Tianhao Wu Ruiqi Gao Liwei Wang Jason D. Lee 69 86 0 22 Sep 2020
Alleviating the Inequality of Attention Heads for Neural Machine Translation Zewei Sun Shujian Huang Xinyu Dai Jiajun Chen 63 7 0 21 Sep 2020
Pruning Neural Networks at Initialization: Why are We Missing the Mark? Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy Michael Carbin 84 240 0 18 Sep 2020
MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks Zhiqiang Shen Marios Savvides 76 63 0 17 Sep 2020
Holistic Filter Pruning for Efficient Deep Neural Networks Lukas Enderich Fabian Timm Wolfram Burgard 67 7 0 17 Sep 2020
Achieving Adversarial Robustness via Sparsity Shu-Fan Wang Ningyi Liao Liyao Xiang Nanyang Ye Quanshi Zhang AAML 56 16 0 11 Sep 2020
Disentangling Neural Architectures and Weights: A Case Study in Supervised Classification Nicolo Colombo Yang Gao 45 2 0 11 Sep 2020
Multi-Task Learning with Deep Neural Networks: A Survey M. Crawshaw CVBM 217 626 0 10 Sep 2020
Prune Responsibly Michela Paganini VLM 70 21 0 10 Sep 2020
FleXOR: Trainable Fractional Quantization Dongsoo Lee S. Kwon Byeongwook Kim Yongkweon Jeon Baeseong Park Jeongin Yun MQ 50 13 0 09 Sep 2020
CNNPruner: Pruning Convolutional Neural Networks with Visual Analytics Guan Li Junpeng Wang Han-Wei Shen Kaixin Chen Guihua Shan Zhonghua Lu AAML 52 47 0 08 Sep 2020
FlipOut: Uncovering Redundant Weights via Sign Flipping A. Apostol M. Stol Patrick Forré UQCV 16 1 0 05 Sep 2020
Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language Modelling Tsendsuren Munkhdalai CLL OffRL 45 4 0 03 Sep 2020
It's Hard for Neural Networks To Learn the Game of Life Jacob Mitchell Springer Garrett Kenyon 85 21 0 03 Sep 2020
Understanding the wiring evolution in differentiable neural architecture search Sirui Xie Shou-Yong Hu Xinjiang Wang Chunxiao Liu Jianping Shi Xunying Liu Dahua Lin 76 9 0 02 Sep 2020
Efficient and Sparse Neural Networks by Pruning Weights in a Multiobjective Learning Approach Malena Reiners K. Klamroth Michael Stiglmayr 56 18 0 31 Aug 2020
Against Membership Inference Attack: Pruning is All You Need Yijue Wang Chenghong Wang Zigeng Wang Shangli Zhou Hang Liu J. Bi Caiwen Ding Sanguthevar Rajasekaran MIACV 147 49 0 28 Aug 2020
SparseRT: Accelerating Unstructured Sparsity on GPUs for Deep Learning Inference Ziheng Wang 86 68 0 26 Aug 2020
Properties Of Winning Tickets On Skin Lesion Classification Sherin Muckatira 24 5 0 25 Aug 2020
HALO: Learning to Prune Neural Networks with Shrinkage Skyler Seto M. Wells Wenyu Zhang 34 0 0 24 Aug 2020
One Weight Bitwidth to Rule Them All Ting-Wu Chin P. Chuang Vikas Chandra Diana Marculescu MQ 57 25 0 22 Aug 2020
NCS4CVR: Neuron-Connection Sharing for Multi-Task Learning in Video Conversion Rate Prediction Xuanji Xiao Huabin Chen Yuzhen Liu Xing Yao Pei Liu Chaosheng Fan Nian Ji Xirong Jiang 18 1 0 22 Aug 2020
Training Sparse Neural Networks using Compressed Sensing Jonathan W. Siegel Jianhong Chen Pengchuan Zhang Jinchao Xu 82 5 0 21 Aug 2020
A Survey of Coded Distributed Computing Jer Shyuan Ng Wei Yang Bryan Lim Nguyen Cong Luong Zehui Xiong Alia Asheralieva Dusit Niyato Cyril Leung Chunyan Miao 54 25 0 20 Aug 2020
Data-Independent Structured Pruning of Neural Networks via Coresets Ben Mussay Dan Feldman Samson Zhou Vladimir Braverman Margarita Osadchy 80 26 0 19 Aug 2020
Feature Products Yield Efficient Networks Philipp Grüning T. Martinetz Erhardt Barth 18 3 0 18 Aug 2020
Intelligence plays dice: Stochasticity is essential for machine learning M. Sabuncu 127 6 0 17 Aug 2020
Skyline: Interactive In-Editor Computational Performance Profiling for Deep Neural Network Training Geoffrey X. Yu Tovi Grossman Gennady Pekhimenko 41 17 0 15 Aug 2020
Neural Network-based Automatic Factor Construction Jie Fang Jianwu Lin Shutao Xia Yong Jiang Zhikang Xia Xiang Liu 362 8 0 14 Aug 2020
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning Sai Praneeth Karimireddy Martin Jaggi Satyen Kale M. Mohri Sashank J. Reddi Sebastian U. Stich A. Suresh FedML 165 217 0 08 Aug 2020
LotteryFL: Personalized and Communication-Efficient Federated Learning with Lottery Ticket Hypothesis on Non-IID Datasets Ang Li Jingwei Sun Binghui Wang Lin Duan Sicheng Li Yiran Chen H. Li FedML 82 127 0 07 Aug 2020
Improve Generalization and Robustness of Neural Networks via Weight Scale Shifting Invariant Regularizations Ziquan Liu Yufei Cui Antoni B. Chan 122 13 0 07 Aug 2020
Iterative Compression of End-to-End ASR Model using AutoML Abhinav Mehrotra Łukasz Dudziak Jinsu Yeo Young-Yoon Lee Ravichander Vipperla ... Samin S. Ishtiaq Alberto Gil C. P. Ramos Sangjeong Lee Daehyun Kim Nicholas D. Lane OffRL 15 8 0 06 Aug 2020
Shallow Univariate ReLu Networks as Splines: Initialization, Loss Surface, Hessian, & Gradient Flow Dynamics Justin Sahs Ryan Pyle Aneel Damaraju J. O. Caro Onur Tavaslioglu Andy Lu Ankit B. Patel 60 19 0 04 Aug 2020