On Tighter Generalization Bound for Deep Neural Networks: CNNs, ResNets, and Beyond

13 June 2018

Papers citing "On Tighter Generalization Bound for Deep Neural Networks: CNNs, ResNets, and Beyond"

25 / 25 papers shown

Title
Generalization Error Bounds of Gradient Descent for Learning Over-parameterized Deep ReLU Networks Yuan Cao Quanquan Gu ODL MLT AI4CE 70 156 0 04 Feb 2019
Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers Zeyuan Allen-Zhu Yuanzhi Li Yingyu Liang MLT 159 772 0 12 Nov 2018
Understanding Generalization and Optimization Performance of Deep CNNs Pan Zhou Jiashi Feng MLT 99 50 0 28 May 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 84 639 0 14 Feb 2018
Size-Independent Sample Complexity of Neural Networks Noah Golowich Alexander Rakhlin Ohad Shamir 122 547 0 18 Dec 2017
Deep Hyperspherical Learning Weiyang Liu Yanming Zhang Xingguo Li Zhen Liu Bo Dai T. Zhao Le Song 64 135 0 08 Nov 2017
Approximating Continuous Functions by ReLU Nets of Minimal Width Boris Hanin Mark Sellke 97 234 0 31 Oct 2017
Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networks Lei Huang Xianglong Liu B. Lang Adams Wei Yu Yongliang Wang Bo Li ODL 69 228 0 16 Sep 2017
Optimal approximation of piecewise smooth functions using deep ReLU neural networks P. Petersen Felix Voigtländer 191 475 0 15 Sep 2017
A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks Behnam Neyshabur Srinadh Bhojanapalli Nathan Srebro 77 605 0 29 Jul 2017
On the Complexity of Learning Neural Networks Le Song Santosh Vempala John Wilmes Bo Xie 34 59 0 14 Jul 2017
Spectrally-normalized margin bounds for neural networks Peter L. Bartlett Dylan J. Foster Matus Telgarsky ODL 175 1,216 0 26 Jun 2017
SphereFace: Deep Hypersphere Embedding for Face Recognition Weiyang Liu Yandong Wen Zhiding Yu Ming Li Bhiksha Raj Le Song CVBM 226 2,798 0 26 Apr 2017
Sharp Minima Can Generalize For Deep Nets Laurent Dinh Razvan Pascanu Samy Bengio Yoshua Bengio ODL 110 771 0 15 Mar 2017
All You Need is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks with Orthonormality and Modulation Di Xie Jiang Xiong Shiliang Pu 106 182 0 06 Mar 2017
On the ability of neural nets to express distributions Holden Lee Rong Ge Tengyu Ma Andrej Risteski Sanjeev Arora BDL 64 84 0 22 Feb 2017
Distribution-Specific Hardness of Learning Neural Networks Ohad Shamir 68 116 0 05 Sep 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 330 10,467 0 21 Jul 2016
The Power of Depth for Feedforward Neural Networks Ronen Eldan Ohad Shamir 189 732 0 12 Dec 2015
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.8K 193,426 0 10 Dec 2015
All you need is a good init Dmytro Mishkin Jirí Matas ODL 82 610 0 19 Nov 2015
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 263 587 0 27 Feb 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 409 43,234 0 11 Feb 2015
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.3K 100,213 0 04 Sep 2014
Natural Language Processing (almost) from Scratch R. Collobert Jason Weston Léon Bottou Michael Karlen Koray Kavukcuoglu Pavel P. Kuksa 151 7,721 0 02 Mar 2011