Generalization in Deep Networks: The Role of Distance from Initialization

7 January 2019

J. Zico Kolter

Papers citing "Generalization in Deep Networks: The Role of Distance from Initialization"

25 / 75 papers shown

Title
Improved generalization by noise enhancement Takashi Mori Masahito Ueda 24 3 0 28 Sep 2020
A Gradient Flow Framework For Analyzing Network Pruning Ekdeep Singh Lubana Robert P. Dick 34 52 0 24 Sep 2020
Implicit Gradient Regularization David Barrett Benoit Dherin 22 147 0 23 Sep 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 44 79 0 17 Sep 2020
Extreme Memorization via Scale of Initialization Harsh Mehta Ashok Cutkosky Behnam Neyshabur 22 20 0 31 Aug 2020
Neural Complexity Measures Yoonho Lee Juho Lee Sung Ju Hwang Eunho Yang Seungjin Choi 28 8 0 07 Aug 2020
Deployment-Efficient Reinforcement Learning via Model-Based Offline Optimization T. Matsushima Hiroki Furuta Y. Matsuo Ofir Nachum S. Gu OffRL 25 147 0 05 Jun 2020
Is deeper better? It depends on locality of relevant features Takashi Mori Masahito Ueda OOD 25 4 0 26 May 2020
Observational Overfitting in Reinforcement Learning Xingyou Song Yiding Jiang Stephen Tu Yilun Du Behnam Neyshabur OffRL 33 138 0 06 Dec 2019
Fantastic Generalization Measures and Where to Find Them Yiding Jiang Behnam Neyshabur H. Mobahi Dilip Krishnan Samy Bengio AI4CE 16 597 0 04 Dec 2019
The intriguing role of module criticality in the generalization of deep networks Niladri S. Chatterji Behnam Neyshabur Hanie Sedghi 28 51 0 02 Dec 2019
On Warm-Starting Neural Network Training Jordan T. Ash Ryan P. Adams AI4CE 31 21 0 18 Oct 2019
Generalization Bounds for Neural Networks via Approximate Description Length Amit Daniely Elad Granot 30 20 0 13 Oct 2019
The Generalization-Stability Tradeoff In Neural Network Pruning Brian Bartoldson Ari S. Morcos Adrian Barbu G. Erlebacher 32 72 0 09 Jun 2019
Deterministic PAC-Bayesian generalization bounds for deep networks via generalizing noise-resilience Vaishnavh Nagarajan J. Zico Kolter 27 100 0 30 May 2019
Generalization bounds for deep convolutional neural networks Philip M. Long Hanie Sedghi MLT 42 90 0 29 May 2019
Quantifying the generalization error in deep learning in terms of data distribution and neural network smoothness Pengzhan Jin Lu Lu Yifa Tang George Karniadakis 14 60 0 27 May 2019
Simple and Effective Regularization Methods for Training on Noisily Labeled Data with Generalization Guarantee Wei Hu Zhiyuan Li Dingli Yu NoLa 25 12 0 27 May 2019
The Impact of Neural Network Overparameterization on Gradient Confusion and Stochastic Gradient Descent Karthik A. Sankararaman Soham De Zheng Xu Yifan Jiang Tom Goldstein ODL 27 103 0 15 Apr 2019
Implicit Regularization in Over-parameterized Neural Networks M. Kubo Ryotaro Banno Hidetaka Manabe Masataka Minoji 25 23 0 05 Mar 2019
Uniform convergence may be unable to explain generalization in deep learning Vaishnavh Nagarajan J. Zico Kolter MoMe AI4CE 17 310 0 13 Feb 2019
Understanding training and generalization in deep learning by Fourier analysis Zhi-Qin John Xu AI4CE 24 92 0 13 Aug 2018
Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data Yuanzhi Li Yingyu Liang MLT 34 651 0 03 Aug 2018
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 310 2,896 0 15 Sep 2016
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 127 577 0 27 Feb 2015