The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

9 March 2018

Papers citing "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"

50 / 2,030 papers shown

Title
$Distillation $\approx$ Early Stopping? Harvesting Dark Knowledge Utilizing Anisotropic Information Retrieval For Overparameterized Neural Network$ Distillation $\approx$ Early Stopping? Harvesting Dark Knowledge Utilizing Anisotropic Information Retrieval For Overparameterized Neural Network Bin Dong Jikai Hou Yiping Lu Zhihua Zhang 74 41 0 02 Oct 2019
ConfusionFlow: A model-agnostic visualization for temporal analysis of classifier confusion A. Hinterreiter Peter Ruch Holger Stitz Martin Ennemoser J. Bernard Hendrik Strobelt M. Streit 77 46 0 02 Oct 2019
How does topology influence gradient propagation and model performance of deep networks with DenseNet-type skip connections? Kartikeya Bhardwaj Guihong Li R. Marculescu 58 1 0 02 Oct 2019
Global Sparse Momentum SGD for Pruning Very Deep Neural Networks Xiaohan Ding Guiguang Ding Xiangxin Zhou Yuchen Guo Jungong Han Ji Liu 89 165 0 27 Sep 2019
Pruning from Scratch Yulong Wang Xiaolu Zhang Lingxi Xie Jun Zhou Hang Su Bo Zhang Xiaolin Hu 71 195 0 27 Sep 2019
In-training Matrix Factorization for Parameter-frugal Neural Machine Translation Zachary Kaden Teven Le Scao R. Olivier 29 1 0 27 Sep 2019
Optimizing Speech Recognition For The Edge Yuan Shangguan Jian Li Qiao Liang R. Álvarez Ian McGraw 78 64 0 26 Sep 2019
Model Pruning Enables Efficient Federated Learning on Edge Devices Yuang Jiang Shiqiang Wang Victor Valls Bongjun Ko Wei-Han Lee Kin K. Leung Leandros Tassiulas 158 465 0 26 Sep 2019
Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems Antonio A. Ginart Maxim Naumov Dheevatsa Mudigere Jiyan Yang James Zou 100 101 0 25 Sep 2019
Wider Networks Learn Better Features D. Gilboa Guy Gur-Ari 46 7 0 25 Sep 2019
Class-dependent Compression of Deep Neural Networks R. Entezari O. Saukh 70 7 0 23 Sep 2019
GEN: Highly Efficient SMILES Explorer Using Autodidactic Generative Examination Networks R. V. Deursen P. Ertl Igor V. Tetko Guillaume Godin 23 32 0 10 Sep 2019
RNN Architecture Learning with Sparse Regularization Jesse Dodge Roy Schwartz Hao Peng Noah A. Smith 77 10 0 06 Sep 2019
LCA: Loss Change Allocation for Neural Network Training Janice Lan Rosanne Liu Hattie Zhou J. Yosinski 70 25 0 03 Sep 2019
Learning Digital Circuits: A Journey Through Weight Invariant Self-Pruning Neural Networks Amey Agrawal Rohit Karlupia 21 0 0 30 Aug 2019
Image Captioning with Sparse Recurrent Neural Network J. Tan Chee Seng Chan Joon Huang Chuah VLM 47 6 0 28 Aug 2019
Revealing the Dark Secrets of BERT Olga Kovaleva Alexey Romanov Anna Rogers Anna Rumshisky 53 555 0 21 Aug 2019
A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problems Meng Tang Yimin Liu L. Durlofsky AI4CE 62 265 0 16 Aug 2019
Group Pruning using a Bounded-Lp norm for Group Gating and Regularization Chaithanya Kumar Mummadi Tim Genewein Dan Zhang Thomas Brox Volker Fischer 53 3 0 09 Aug 2019
Convolutional Dictionary Learning in Hierarchical Networks Javier Zazo Bahareh Tolooshams Demba E. Ba BDL 54 5 0 23 Jul 2019
Light Multi-segment Activation for Model Compression Zhenhui Xu Guolin Ke Jia Zhang Jiang Bian Tie-Yan Liu 25 2 0 16 Jul 2019
Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks Alejandro Molina P. Schramowski Kristian Kersting ODL 49 82 0 15 Jul 2019
Batch-Shaping for Learning Conditional Channel Gated Networks B. Bejnordi Tijmen Blankevoort Max Welling AI4CE 78 78 0 15 Jul 2019
Bringing Giant Neural Networks Down to Earth with Unlabeled Data Yehui Tang Shan You Chang Xu Boxin Shi Chao Xu 81 11 0 13 Jul 2019
Deep network as memory space: complexity, generalization, disentangled representation and interpretability X. Dong L. Zhou 46 1 0 12 Jul 2019
Sparsely Activated Networks Paschalis A. Bizopoulos D. Koutsouris 31 12 0 12 Jul 2019
Sparse Networks from Scratch: Faster Training without Losing Performance Tim Dettmers Luke Zettlemoyer 156 340 0 10 Jul 2019
Reinforcement Learning with Chromatic Networks for Compact Architecture Search Xingyou Song K. Choromanski Jack Parker-Holder Yunhao Tang Wenbo Gao Aldo Pacchiano Tamás Sarlós Deepali Jain Yuxiang Yang 28 1 0 10 Jul 2019
XNect: Real-time Multi-Person 3D Motion Capture with a Single RGB Camera Dushyant Mehta Oleksandr Sotnychenko Franziska Mueller Weipeng Xu Mohamed A. Elgharib Pascal Fua Hans-Peter Seidel Helge Rhodin Gerard Pons-Moll Christian Theobalt 3DH 95 171 0 01 Jul 2019
Dissecting Pruned Neural Networks Jonathan Frankle David Bau 39 8 0 29 Jun 2019
Selection via Proxy: Efficient Data Selection for Deep Learning Cody Coleman Christopher Yeh Stephen Mussmann Baharan Mirzasoleiman Peter Bailis Percy Liang J. Leskovec Matei A. Zaharia 116 350 0 26 Jun 2019
BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learning Andreas Kirsch Joost R. van Amersfoort Y. Gal FedML 93 629 0 19 Jun 2019
Finding the Needle in the Haystack with Convolutions: on the benefits of architectural bias Stéphane dÁscoli Levent Sagun Joan Bruna Giulio Biroli 79 37 0 16 Jun 2019
A Signal Propagation Perspective for Pruning Neural Networks at Initialization Namhoon Lee Thalaiyasingam Ajanthan Stephen Gould Philip Torr AAML 78 155 0 14 Jun 2019
Towards Compact and Robust Deep Neural Networks Vikash Sehwag Shiqi Wang Prateek Mittal Suman Jana AAML 82 40 0 14 Jun 2019
Large Scale Structure of Neural Network Loss Landscapes Stanislav Fort Stanislaw Jastrzebski 69 84 0 11 Jun 2019
Taxonomy of Saliency Metrics for Channel Pruning Kaveena Persand Andrew Anderson David Gregg 43 7 0 11 Jun 2019
Weight Agnostic Neural Networks Adam Gaier David R Ha OOD 67 242 0 11 Jun 2019
BlockSwap: Fisher-guided Block Substitution for Network Compression on a Budget Jack Turner Elliot J. Crowley Michael F. P. O'Boyle Amos Storkey Gavia Gray 84 38 0 10 Jun 2019
The Generalization-Stability Tradeoff In Neural Network Pruning Brian Bartoldson Ari S. Morcos Adrian Barbu G. Erlebacher 92 76 0 09 Jun 2019
One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers Ari S. Morcos Haonan Yu Michela Paganini Yuandong Tian 83 229 0 06 Jun 2019
Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP Haonan Yu Sergey Edunov Yuandong Tian Ari S. Morcos 60 150 0 06 Jun 2019
Gated recurrent units viewed through the lens of continuous time dynamical systems I. Jordan Piotr A. Sokól Il Memming Park 72 59 0 03 Jun 2019
Discovering Neural Wirings Mitchell Wortsman Ali Farhadi Mohammad Rastegari AI4CE 122 121 0 03 Jun 2019
DeepShift: Towards Multiplication-Less Neural Networks Mostafa Elhoushi Zihao Chen F. Shafiq Ye Tian Joey Yiwei Li MQ 128 102 0 30 May 2019
SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers Igor Fedorov Ryan P. Adams Matthew Mattina P. Whatmough 87 168 0 28 May 2019
Self-supervised audio representation learning for mobile devices Marco Tagliasacchi Beat Gfeller Félix de Chaumont Quitry Dominik Roblek SSL AI4TS 71 47 0 24 May 2019
Learning Low-Rank Approximation for CNNs Dongsoo Lee S. Kwon Byeongwook Kim Gu-Yeon Wei 106 19 0 24 May 2019
Structured Compression by Weight Encryption for Unstructured Pruning and Quantization S. Kwon Dongsoo Lee Byeongwook Kim Parichay Kapoor Baeseong Park Gu-Yeon Wei MQ 74 51 0 24 May 2019
Exploring Structural Sparsity of Deep Networks via Inverse Scale Spaces Yanwei Fu Chen Liu Donghao Li Zuyuan Zhong Xinwei Sun Jinshan Zeng Yuan Yao 35 10 0 23 May 2019