The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

9 March 2018

Papers citing "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"

50 / 2,030 papers shown

Title
Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future Grace W. Lindsay MedIm 119 436 0 20 Jan 2020
On Iterative Neural Network Pruning, Reinitialization, and the Similarity of Masks Michela Paganini Jessica Zosa Forde 78 19 0 14 Jan 2020
Universal Differential Equations for Scientific Machine Learning Christopher Rackauckas Yingbo Ma Julius Martensen Collin Warner K. Zubov R. Supekar Dominic J. Skinner Ali Ramadhan Alan Edelman AI4CE 113 599 0 13 Jan 2020
Pruning Convolutional Neural Networks with Self-Supervision Mathilde Caron Ari S. Morcos Piotr Bojanowski Julien Mairal Armand Joulin SSL 3DPC 59 12 0 10 Jan 2020
Campfire: Compressible, Regularization-Free, Structured Sparse Training for Hardware Accelerators Noah Gamboa Kais Kudrolli Anand Dhoot A. Pedram 33 10 0 09 Jan 2020
Least squares binary quantization of neural networks Hadi Pouransari Zhucheng Tu Oncel Tuzel MQ 82 32 0 09 Jan 2020
Sparse Weight Activation Training Md Aamir Raihan Tor M. Aamodt 129 73 0 07 Jan 2020
Lossless Compression of Deep Neural Networks Thiago Serra Abhinav Kumar Srikumar Ramalingam 100 56 0 01 Jan 2020
Mixed-Precision Quantized Neural Network with Progressively Decreasing Bitwidth For Image Classification and Object Detection Tianshu Chu Qin Luo Jie Yang Xiaolin Huang MQ 32 6 0 29 Dec 2019
NAS evaluation is frustratingly hard Antoine Yang P. Esperança Fabio Maria Carlucci 84 168 0 28 Dec 2019
Alpha Discovery Neural Network based on Prior Knowledge Jie Fang Shutao Xia Jianwu Lin Zhikang Xia Xiang Liu Yong Jiang 324 8 0 26 Dec 2019
Deep learning architectures for nonlinear operator functions and nonlinear inverse problems Maarten V. de Hoop Matti Lassas C. Wong 78 26 0 23 Dec 2019
Landscape Connectivity and Dropout Stability of SGD Solutions for Over-parameterized Neural Networks Aleksandr Shevchenko Marco Mondelli 194 37 0 20 Dec 2019
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 137 169 0 19 Dec 2019
WaLDORf: Wasteless Language-model Distillation On Reading-comprehension J. Tian A. Kreuzer Pai-Hung Chen Hans-Martin Will VLM 58 3 0 13 Dec 2019
Linear Mode Connectivity and the Lottery Ticket Hypothesis Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy Michael Carbin MoMe 177 630 0 11 Dec 2019
Is Feature Diversity Necessary in Neural Network Initialization? Yaniv Blumenfeld D. Gilboa Daniel Soudry 15 0 0 11 Dec 2019
Frivolous Units: Wider Networks Are Not Really That Wide Stephen Casper Xavier Boix Vanessa D’Amario Ling Guo Martin Schrimpf Kasper Vinken Gabriel Kreiman 55 19 0 10 Dec 2019
Winning the Lottery with Continuous Sparsification Pedro H. P. Savarese Hugo Silva Michael Maire 89 137 0 10 Dec 2019
Explicit Group Sparse Projection with Applications to Deep Learning and NMF Riyasat Ohib Nicolas Gillis Niccolò Dalmasso Sameena Shah Vamsi K. Potluru Sergey Plis 76 9 0 09 Dec 2019
Explaining Sequence-Level Knowledge Distillation as Data-Augmentation for Neural Machine Translation Mitchell A. Gordon Kevin Duh 45 28 0 06 Dec 2019
The Search for Sparse, Robust Neural Networks J. Cosentino Federico Zaiter Dan Pei Jun Zhu AAML OOD 43 18 0 05 Dec 2019
TX-Ray: Quantifying and Explaining Model-Knowledge Transfer in (Un-)Supervised NLP Nils Rethmeier V. Saxena Isabelle Augenstein FAtt 68 2 0 02 Dec 2019
One-Shot Pruning of Recurrent Neural Networks by Jacobian Spectrum Evaluation Matthew Shunshi Zhang Bradly C. Stadie 60 32 0 30 Nov 2019
What's Hidden in a Randomly Weighted Neural Network? Vivek Ramanujan Mitchell Wortsman Aniruddha Kembhavi Ali Farhadi Mohammad Rastegari 72 362 0 29 Nov 2019
Semi-Relaxed Quantization with DropBits: Training Low-Bit Neural Networks via Bit-wise Regularization J. H. Lee Jihun Yun Sung Ju Hwang Eunho Yang MQ 22 0 0 29 Nov 2019
QKD: Quantization-aware Knowledge Distillation Jangho Kim Yash Bhalgat Jinwon Lee Chirag I. Patel Nojun Kwak MQ 97 66 0 28 Nov 2019
Rigging the Lottery: Making All Tickets Winners Utku Evci Trevor Gale Jacob Menick Pablo Samuel Castro Erich Elsen 203 610 0 25 Nov 2019
Trajectory growth lower bounds for random sparse deep ReLU networks Ilan Price Jared Tanner 49 5 0 25 Nov 2019
A Conceptual Framework for Lifelong Learning Charles X. Ling Tanner A. Bohn CLL 71 3 0 21 Nov 2019
DARB: A Density-Aware Regular-Block Pruning for Deep Neural Networks Ao Ren Tao Zhang Yuhao Wang Sheng Lin Peiyan Dong Yen-kuang Chen Yuan Xie Yanzhi Wang 78 11 0 19 Nov 2019
Provable Filter Pruning for Efficient Neural Networks Lucas Liebenwein Cenk Baykal Harry Lang Dan Feldman Daniela Rus VLM 3DPC 85 141 0 18 Nov 2019
Learning Sparse Sharing Architectures for Multiple Tasks Tianxiang Sun Yunfan Shao Xiaonan Li Pengfei Liu Hang Yan Xipeng Qiu Xuanjing Huang MoE 86 132 0 12 Nov 2019
Blockwise Self-Attention for Long Document Understanding J. Qiu Hao Ma Omer Levy Scott Yih Sinong Wang Jie Tang 109 254 0 07 Nov 2019
A Programmable Approach to Neural Network Compression Vinu Joseph Saurav Muralidharan Animesh Garg M. Garland Ganesh Gopalakrishnan 54 10 0 06 Nov 2019
E2-Train: Training State-of-the-art CNNs with Over 80% Energy Savings Yue Wang Ziyu Jiang Xiaohan Chen Pengfei Xu Yang Zhao Yingyan Lin Zhangyang Wang MQ 104 83 0 29 Oct 2019
Active Subspace of Neural Networks: Structural Analysis and Universal Attacks Chunfeng Cui Kaiqi Zhang Talgat Daulbaev Julia Gusak Ivan Oseledets Zheng Zhang AAML 61 25 0 29 Oct 2019
Evaluating Lottery Tickets Under Distributional Shifts Shrey Desai Hongyuan Zhan Ahmed Aly UQCV OOD 81 41 0 28 Oct 2019
Neural Network Distiller: A Python Package For DNN Compression Research Neta Zmora Guy Jacob Lev Zlotnik Bar Elharar Gal Novik 58 74 0 27 Oct 2019
Reversible designs for extreme memory cost reduction of CNN training T. Hascoet Q. Febvre Y. Ariki T. Takiguchi 3DV 15 2 0 24 Oct 2019
Global Capacity Measures for Deep ReLU Networks via Path Sampling Ryan Theisen Jason M. Klusowski Huan Wang N. Keskar Caiming Xiong R. Socher 36 3 0 22 Oct 2019
Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI Alejandro Barredo Arrieta Natalia Díaz Rodríguez Javier Del Ser Adrien Bennetot Siham Tabik ... S. Gil-Lopez Daniel Molina Richard Benjamins Raja Chatila Francisco Herrera XAI 157 6,340 0 22 Oct 2019
Spiking neural networks trained with backpropagation for low power neuromorphic implementation of voice activity detection Flavio Martinelli Giorgia Dellaferrera Pablo Mainar Milos Cernak 54 31 0 22 Oct 2019
Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System Ze Yang Linjun Shou Ming Gong Wutao Lin Daxin Jiang 67 94 0 18 Oct 2019
Path homologies of deep feedforward networks Samir Chowdhury Thomas Gebhart Steve Huntsman Matvey Yutin 39 23 0 16 Oct 2019
SiPPing Neural Networks: Sensitivity-informed Provable Pruning of Neural Networks Cenk Baykal Lucas Liebenwein Igor Gilitschenski Dan Feldman Daniela Rus 92 18 0 11 Oct 2019
Structured Pruning of Large Language Models Ziheng Wang Jeremy Wohlwend Tao Lei 85 293 0 10 Oct 2019
Interpreting Deep Learning-Based Networking Systems Zili Meng Minhu Wang Jia-Ju Bai Mingwei Xu Hongzi Mao Hongxin Hu AI4CE 38 3 0 09 Oct 2019
Differentiable Sparsification for Deep Neural Networks Yognjin Lee 70 7 0 08 Oct 2019
Convolutional Neural Networks for Speech Controlled Prosthetic Hands Yichao Fu Runlong Su BDL 47 5 0 03 Oct 2019