On the importance of single directions for generalization

19 March 2018

Papers citing "On the importance of single directions for generalization"

31 / 181 papers shown

Title
RePr: Improved Training of Convolutional Filters Aaditya (Adi) Prakash J. Storer D. Florêncio Cha Zhang VLM CVBM 35 57 0 18 Nov 2018
Characterizing Well-Behaved vs. Pathological Deep Neural Networks Mitchell Stern 21 0 0 07 Nov 2018
YASENN: Explaining Neural Networks via Partitioning Activation Sequences Yaroslav Zharov Denis Korzhenkov J. Lyu Alexander Tuzhilin FAtt AAML 11 6 0 07 Nov 2018
Identifying and Controlling Important Neurons in Neural Machine Translation A. Bau Yonatan Belinkov Hassan Sajjad Nadir Durrani Fahim Dalvi James R. Glass MILM 21 180 0 03 Nov 2018
Auditing Data Provenance in Text-Generation Models Congzheng Song Vitaly Shmatikov MLAU 14 17 0 01 Nov 2018
Analyzing biological and artificial neural networks: challenges with opportunities for synergy? David Barrett Ari S. Morcos Jakob H. Macke AI4CE 25 110 0 31 Oct 2018
Gather-Excite: Exploiting Feature Context in Convolutional Neural Networks Jie Hu Li Shen Samuel Albanie Gang Sun Andrea Vedaldi 23 569 0 29 Oct 2018
Distilling Critical Paths in Convolutional Neural Networks Fuxun Yu Zhuwei Qin Xiang Chen 28 22 0 28 Oct 2018
MCA-based Rule Mining Enables Interpretable Inference in Clinical Psychiatry Qingzhu Gao H. González P. Ahammad 12 3 0 26 Oct 2018
Batch Normalization Sampling Zhaodong Chen Lei Deng Guoqi Li Jiawei Sun Xing Hu Xin Ma Yuan Xie 21 0 0 25 Oct 2018
Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel Colin Wei J. Lee Qiang Liu Tengyu Ma 26 245 0 12 Oct 2018
Detecting Memorization in ReLU Networks Edo Collins Siavash Bigdeli Sabine Süsstrunk 36 4 0 08 Oct 2018
Dynamic Sparse Graph for Efficient Deep Learning L. Liu Lei Deng Xing Hu Maohua Zhu Guoqi Li Yufei Ding Yuan Xie GNN 40 42 0 01 Oct 2018
Relational Forward Models for Multi-Agent Learning Andrea Tacchetti H. F. Song P. Mediano V. Zambaldi Neil C. Rabinowitz T. Graepel M. Botvinick Peter W. Battaglia AI4CE 19 77 0 28 Sep 2018
Towards Understanding Regularization in Batch Normalization Ping Luo Xinjiang Wang Wenqi Shao Zhanglin Peng MLT AI4CE 23 179 0 04 Sep 2018
HyperNets and their application to learning spatial transformations A. Potapov O. Shcherbakov I. Zhdanov S. Rodionov Nikolai Skorobogatko 4 3 0 12 Jul 2018
A Benchmark for Interpretability Methods in Deep Neural Networks Sara Hooker D. Erhan Pieter-Jan Kindermans Been Kim FAtt UQCV 31 670 0 28 Jun 2018
Detecting Dead Weights and Units in Neural Networks Utku Evci CVBM 29 7 0 15 Jun 2018
Insights on representational similarity in neural networks with canonical correlation Ari S. Morcos M. Raghu Samy Bengio DRL 32 432 0 14 Jun 2018
Revisiting the Importance of Individual Units in CNNs via Ablation Bolei Zhou Yiyou Sun David Bau Antonio Torralba FAtt 59 116 0 07 Jun 2018
Layer rotation: a surprisingly powerful indicator of generalization in deep networks? Simon Carbonnelle Christophe De Vleeschouwer MLT 11 1 0 05 Jun 2018
How Important Is a Neuron? Kedar Dhamdhere Mukund Sundararajan Qiqi Yan FAtt GNN 22 128 0 30 May 2018
How Does Batch Normalization Help Optimization? Shibani Santurkar Dimitris Tsipras Andrew Ilyas A. Madry ODL 32 1,523 0 29 May 2018
Deep learning generalizes because the parameter-function map is biased towards simple functions Guillermo Valle Pérez Chico Q. Camargo A. Louis MLT AI4CE 18 226 0 22 May 2018
The Roles of Supervised Machine Learning in Systems Neuroscience Joshua I. Glaser Ari S. Benjamin Roozbeh Farhoodi Konrad Paul Kording 18 114 0 21 May 2018
Understanding Neural Networks and Individual Neuron Importance via Information-Ordered Cumulative Ablation Rana Ali Amjad Kairen Liu Bernhard C. Geiger FAtt 27 18 0 18 Apr 2018
Pooling is neither necessary nor sufficient for appropriate deformation stability in CNNs Avraham Ruderman Neil C. Rabinowitz Ari S. Morcos Daniel Zoran 6 41 0 12 Apr 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 32 631 0 14 Feb 2018
Squeeze-and-Excitation Networks Jie Hu Li Shen Samuel Albanie Gang Sun Enhua Wu 81 26,062 0 05 Sep 2017
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 718 6,748 0 26 Sep 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,892 0 15 Sep 2016