Exploring Generalization in Deep Learning

Exploring Generalization in Deep Learning

27 June 2017

Behnam Neyshabur

Srinadh Bhojanapalli

David A. McAllester

Papers citing "Exploring Generalization in Deep Learning"

16 / 766 papers shown

Title
To understand deep learning we need to understand kernel learning M. Belkin Siyuan Ma Soumik Mandal 11 414 0 05 Feb 2018
Fix your classifier: the marginal value of training the last weight layer Elad Hoffer Itay Hubara Daniel Soudry 35 101 0 14 Jan 2018
Theory of Deep Learning III: explaining the non-overfitting puzzle T. Poggio Kenji Kawaguchi Q. Liao Brando Miranda Lorenzo Rosasco Xavier Boix Jack Hidary H. Mhaskar ODL 16 128 0 30 Dec 2017
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 106 1,844 0 28 Dec 2017
Entropy-SGD optimizes the prior of a PAC-Bayes bound: Generalization properties of Entropy-SGD and data-dependent priors Gintare Karolina Dziugaite Daniel M. Roy MLT 30 144 0 26 Dec 2017
Algorithmic Regularization in Over-parameterized Matrix Sensing and Neural Networks with Quadratic Activations Yuanzhi Li Tengyu Ma Hongyang R. Zhang 18 31 0 26 Dec 2017
MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels Lu Jiang Zhengyuan Zhou Thomas Leung Li-Jia Li Li Fei-Fei NoLa 50 1,437 0 14 Dec 2017
Fisher-Rao Metric, Geometry, and Complexity of Neural Networks Tengyuan Liang T. Poggio Alexander Rakhlin J. Stokes 25 224 0 05 Nov 2017
Certifying Some Distributional Robustness with Principled Adversarial Training Aman Sinha Hongseok Namkoong Riccardo Volpi John C. Duchi OOD 43 854 0 29 Oct 2017
The Implicit Bias of Gradient Descent on Separable Data Daniel Soudry Elad Hoffer Mor Shpigel Nacson Suriya Gunasekar Nathan Srebro 16 897 0 27 Oct 2017
SGD Learns Over-parameterized Networks that Provably Generalize on Linearly Separable Data Alon Brutzkus Amir Globerson Eran Malach Shai Shalev-Shwartz MLT 50 276 0 27 Oct 2017
Generalization in Deep Learning Kenji Kawaguchi L. Kaelbling Yoshua Bengio ODL 39 460 0 16 Oct 2017
A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks Behnam Neyshabur Srinadh Bhojanapalli Nathan Srebro 14 600 0 29 Jul 2017
Emergence of Invariance and Disentanglement in Deep Representations Alessandro Achille Stefano Soatto OOD DRL 23 468 0 05 Jun 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,890 0 15 Sep 2016
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 127 577 0 27 Feb 2015