Exploring Generalization in Deep Learning

27 June 2017

Srinadh Bhojanapalli

Papers citing "Exploring Generalization in Deep Learning"

50 / 766 papers shown

Title
Abstraction Mechanisms Predict Generalization in Deep Neural Networks Alex Gain H. Siegelmann AI4CE 19 6 0 27 May 2019
Quantifying the generalization error in deep learning in terms of data distribution and neural network smoothness Pengzhan Jin Lu Lu Yifa Tang George Karniadakis 9 60 0 27 May 2019
Learning to Auto Weight: Entirely Data-driven and Highly Efficient Weighting Framework Zhenmao Li Yichao Wu Ken Chen Yudong Wu Shunfeng Zhou Jiaheng Liu Junjie Yan 13 5 0 27 May 2019
A Geometric Modeling of Occam's Razor in Deep Learning Ke Sun Frank Nielsen 16 4 0 27 May 2019
Explicitizing an Implicit Bias of the Frequency Principle in Two-layer Neural Networks Yaoyu Zhang Zhi-Qin John Xu Tao Luo Zheng Ma MLT AI4CE 28 38 0 24 May 2019
How degenerate is the parametrization of neural networks with the ReLU activation function? Julius Berner Dennis Elbrächter Philipp Grohs ODL 30 28 0 23 May 2019
The role of invariance in spectral complexity-based generalization bounds Konstantinos Pitas Andreas Loukas Mike Davies P. Vandergheynst BDL 6 1 0 23 May 2019
Fine-grained Optimization of Deep Neural Networks Mete Ozay ODL 14 1 0 22 May 2019
The sharp, the flat and the shallow: Can weakly interacting agents learn to escape bad minima? N. Kantas P. Parpas G. Pavliotis ODL 21 8 0 10 May 2019
Data-dependent Sample Complexity of Deep Neural Networks via Lipschitz Augmentation Colin Wei Tengyu Ma 25 109 0 09 May 2019
Generalization ability of region proposal networks for multispectral person detection Kevin Fritz D. König U. Klauck Michael Teutsch ObjD 14 15 0 07 May 2019
Stability and Generalization of Graph Convolutional Neural Networks Saurabh Verma Zhi-Li Zhang GNN MLT 30 153 0 03 May 2019
A supervised-learning-based strategy for optimal demand response of an HVAC System Young-Jin Kim AI4CE 17 55 0 29 Apr 2019
Improving Image Classification Robustness through Selective CNN-Filters Fine-Tuning Alessandro Bianchi Moreno Raimondo Vendra P. Protopapas Marco Brambilla 14 8 0 08 Apr 2019
Why ResNet Works? Residuals Generalize Fengxiang He Tongliang Liu Dacheng Tao 16 243 0 02 Apr 2019
On the Stability and Generalization of Learning with Kernel Activation Functions M. Cirillo Simone Scardapane S. Van Vaerenbergh A. Uncini 11 0 0 28 Mar 2019
Theory III: Dynamics and Generalization in Deep Networks Andrzej Banburski Q. Liao Brando Miranda Lorenzo Rosasco Fernanda De La Torre Jack Hidary T. Poggio AI4CE 32 3 0 12 Mar 2019
Positively Scale-Invariant Flatness of ReLU Neural Networks Mingyang Yi Qi Meng Wei-neng Chen Zhi-Ming Ma Tie-Yan Liu 26 17 0 06 Mar 2019
Statistical Guarantees for the Robustness of Bayesian Neural Networks L. Cardelli Marta Kwiatkowska Luca Laurenti Nicola Paoletti A. Patané Matthew Wicker AAML 31 54 0 05 Mar 2019
An Empirical Study of Large-Batch Stochastic Gradient Descent with Structured Covariance Noise Yeming Wen Kevin Luk Maxime Gazeau Guodong Zhang Harris Chan Jimmy Ba ODL 20 22 0 21 Feb 2019
Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting Jun Shu Qi Xie Lixuan Yi Qian Zhao Sanping Zhou Zongben Xu Deyu Meng NoLa 12 4 0 20 Feb 2019
Uniform convergence may be unable to explain generalization in deep learning Vaishnavh Nagarajan J. Zico Kolter MoMe AI4CE 17 309 0 13 Feb 2019
Identity Crisis: Memorization and Generalization under Extreme Overparameterization Chiyuan Zhang Samy Bengio Moritz Hardt Michael C. Mozer Y. Singer 14 87 0 13 Feb 2019
Adaptive Posterior Learning: few-shot learning with a surprise-based memory module Tiago Ramalho M. Garnelo BDL 33 77 0 07 Feb 2019
Are All Layers Created Equal? Chiyuan Zhang Samy Bengio Y. Singer 20 140 0 06 Feb 2019
Generalization Error Bounds of Gradient Descent for Learning Over-parameterized Deep ReLU Networks Yuan Cao Quanquan Gu ODL MLT AI4CE 25 155 0 04 Feb 2019
Asymmetric Valleys: Beyond Sharp and Flat Local Minima Haowei He Gao Huang Yang Yuan ODL MLT 28 147 0 02 Feb 2019
Effect of Various Regularizers on Model Complexities of Neural Networks in Presence of Input Noise Mayank Sharma Aayush Yadav Sumit Soman Jayadeva Jayadeva 4 1 0 31 Jan 2019
Sample Complexity Bounds for Recurrent Neural Networks with Application to Combinatorial Graph Problems Nil-Jana Akpinar Bernhard Kratzwald Stefan Feuerriegel GNN 15 9 0 29 Jan 2019
Variational Characterizations of Local Entropy and Heat Regularization in Deep Learning Nicolas García Trillos Zachary T. Kaplan D. Sanz-Alonso ODL 20 3 0 29 Jan 2019
Complexity of Linear Regions in Deep Networks Boris Hanin David Rolnick 4 224 0 25 Jan 2019
Heavy-Tailed Universality Predicts Trends in Test Accuracies for Very Large Pre-Trained Deep Neural Networks Charles H. Martin Michael W. Mahoney 13 55 0 24 Jan 2019
Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks Zhi-Qin John Xu Yaoyu Zhang Tao Luo Yan Xiao Zheng Ma 12 502 0 19 Jan 2019
A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks Umut Simsekli Levent Sagun Mert Gurbuzbalaban 26 237 0 18 Jan 2019
A Primer on PAC-Bayesian Learning Benjamin Guedj 13 221 0 16 Jan 2019
Normalized Flat Minima: Exploring Scale Invariant Definition of Flat Minima for Neural Networks using PAC-Bayesian Analysis Yusuke Tsuzuku Issei Sato Masashi Sugiyama 22 74 0 15 Jan 2019
Generalization in Deep Networks: The Role of Distance from Initialization Vaishnavh Nagarajan J. Zico Kolter ODL 4 94 0 07 Jan 2019
A Theoretical Analysis of Deep Q-Learning Jianqing Fan Zhuoran Yang Yuchen Xie Zhaoran Wang 23 595 0 01 Jan 2019
On the Benefit of Width for Neural Networks: Disappearance of Bad Basins Dawei Li Tian Ding Ruoyu Sun 29 37 0 28 Dec 2018
Improving Generalization of Deep Neural Networks by Leveraging Margin Distribution Shen-Huan Lyu Lu Wang Zhi-Hua Zhou 22 11 0 27 Dec 2018
A deep learning-based remaining useful life prediction approach for bearings Cheng Cheng Guijun Ma Yong Zhang Mingyang Sun Fei Teng Han Ding Ye Yuan 11 130 0 08 Dec 2018
A Differential Topological View of Challenges in Learning with Feedforward Neural Networks Hao Shen AAML AI4CE 23 6 0 26 Nov 2018
Stochastic Gradient Descent Optimizes Over-parameterized Deep ReLU Networks Difan Zou Yuan Cao Dongruo Zhou Quanquan Gu ODL 33 446 0 21 Nov 2018
Analytic Network Learning Kar-Ann Toh 22 9 0 20 Nov 2018
Neural Lander: Stable Drone Landing Control using Learned Dynamics Guanya Shi Xichen Shi Michael O'Connell Rose Yu Kamyar Azizzadenesheli Anima Anandkumar Yisong Yue Soon-Jo Chung 27 271 0 19 Nov 2018
Deep Frank-Wolfe For Neural Network Optimization Leonard Berrada Andrew Zisserman M. P. Kumar ODL 11 40 0 19 Nov 2018
Generalizable Adversarial Training via Spectral Normalization Farzan Farnia Jesse M. Zhang David Tse OOD AAML 37 137 0 19 Nov 2018
Unsupervised domain adaptation for medical imaging segmentation with self-ensembling C. Perone P. Ballester Rodrigo C. Barros Julien Cohen-Adad OOD 33 207 0 14 Nov 2018
Sorting out Lipschitz function approximation Cem Anil James Lucas Roger C. Grosse 21 317 0 13 Nov 2018
Characterizing Well-Behaved vs. Pathological Deep Neural Networks Mitchell Stern 21 0 0 07 Nov 2018