NeurIPS 2020 Competition: Predicting Generalization in Deep Learning

14 December 2020

Gintare Karolina Dziugaite

Samy Bengio

Suriya Gunasekar

Isabelle M Guyon

Behnam Neyshabur Google Research

OOD

ArXiv PDF HTML

Papers citing "NeurIPS 2020 Competition: Predicting Generalization in Deep Learning"

28 / 28 papers shown

Title
Self-Distillation Amplifies Regularization in Hilbert Space H. Mobahi Mehrdad Farajtabar Peter L. Bartlett 59 234 0 13 Feb 2020
Observational Overfitting in Reinforcement Learning Xingyou Song Yiding Jiang Stephen Tu Yilun Du Behnam Neyshabur OffRL 55 139 0 06 Dec 2019
Fantastic Generalization Measures and Where to Find Them Yiding Jiang Behnam Neyshabur H. Mobahi Dilip Krishnan Samy Bengio AI4CE 62 599 0 04 Dec 2019
The intriguing role of module criticality in the generalization of deep networks Niladri S. Chatterji Behnam Neyshabur Hanie Sedghi 48 51 0 02 Dec 2019
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 148 149 0 06 Nov 2019
Fast-rate PAC-Bayes Generalization Bounds via Shifted Rademacher Processes Jun Yang Shengyang Sun Daniel M. Roy 29 28 0 20 Aug 2019
Towards Task and Architecture-Independent Generalization Gap Predictors Scott Yak J. Gonzalvo Hanna Mazzawi UQCV AI4CE 24 27 0 04 Jun 2019
Rethinking the Value of Network Pruning Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang Trevor Darrell 28 1,460 0 11 Oct 2018
Predicting the Generalization Gap in Deep Networks with Margin Distributions Yiding Jiang Dilip Krishnan H. Mobahi Samy Bengio UQCV 69 199 0 28 Sep 2018
Implicit Bias of Gradient Descent on Linear Convolutional Networks Suriya Gunasekar Jason D. Lee Daniel Soudry Nathan Srebro MDE 52 408 0 01 Jun 2018
Large Margin Deep Networks for Classification Gamaleldin F. Elsayed Dilip Krishnan H. Mobahi Kevin Regan Samy Bengio MQ 45 282 0 15 Mar 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 168 3,433 0 09 Mar 2018
Characterizing Implicit Bias in Terms of Optimization Geometry Suriya Gunasekar Jason D. Lee Daniel Soudry Nathan Srebro AI4CE 60 404 0 22 Feb 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 69 637 0 14 Feb 2018
Entropy-SGD optimizes the prior of a PAC-Bayes bound: Generalization properties of Entropy-SGD and data-dependent priors Gintare Karolina Dziugaite Daniel M. Roy MLT 50 145 0 26 Dec 2017
The Implicit Bias of Gradient Descent on Separable Data Daniel Soudry Elad Hoffer Mor Shpigel Nacson Suriya Gunasekar Nathan Srebro 66 908 0 27 Oct 2017
Implicit Regularization in Deep Learning Behnam Neyshabur 35 145 0 06 Sep 2017
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 165 8,807 0 25 Aug 2017
A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks Behnam Neyshabur Srinadh Bhojanapalli Nathan Srebro 58 604 0 29 Jul 2017
Exploring Generalization in Deep Learning Behnam Neyshabur Srinadh Bhojanapalli David A. McAllester Nathan Srebro FAtt 132 1,245 0 27 Jun 2017
Implicit Regularization in Matrix Factorization Suriya Gunasekar Blake E. Woodworth Srinadh Bhojanapalli Behnam Neyshabur Nathan Srebro 60 490 0 25 May 2017
Geometry of Optimization and Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Ruslan Salakhutdinov Nathan Srebro AI4CE 47 132 0 08 May 2017
Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data Gintare Karolina Dziugaite Daniel M. Roy 77 808 0 31 Mar 2017
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 226 6,628 0 08 Jun 2015
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 220 583 0 27 Feb 2015
In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Nathan Srebro AI4CE 63 655 0 20 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 923 99,991 0 04 Sep 2014
Network In Network Min Lin Qiang Chen Shuicheng Yan 225 6,267 0 16 Dec 2013