v1v2 (latest)

Generalization Error Bounds for Deep Neural Networks Trained by SGD

7 June 2022

Chao Ma

Papers citing "Generalization Error Bounds for Deep Neural Networks Trained by SGD"

31 / 31 papers shown

Title
Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability Jeremy M. Cohen Simran Kaur Yuanzhi Li J. Zico Kolter Ameet Talwalkar ODL 95 277 0 26 Feb 2021
Complexity Measures for Neural Networks with General Activation Functions Using Path-based Norms Zhong Li Chao Ma Lei Wu 50 24 0 14 Sep 2020
Stability of Stochastic Gradient Descent on Nonsmooth Convex Losses Raef Bassily Vitaly Feldman Cristóbal Guzmán Kunal Talwar MLT 54 198 0 12 Jun 2020
Sharpened Generalization Bounds based on Conditional Mutual Information and an Application to Noisy, Iterative Algorithms Mahdi Haghifam Jeffrey Negrea Ashish Khisti Daniel M. Roy Gintare Karolina Dziugaite 168 107 0 27 Apr 2020
Reasoning About Generalization via Conditional Mutual Information Thomas Steinke Lydia Zakynthinou 150 166 0 24 Jan 2020
Sharper bounds for uniformly stable algorithms Olivier Bousquet Yegor Klochkov Nikita Zhivotovskiy 64 122 0 17 Oct 2019
Generalization Bounds for Convolutional Neural Networks Shan Lin Jingwei Zhang MLT 56 35 0 03 Oct 2019
A Priori Estimates of the Population Risk for Residual Networks E. Weinan Chao Ma Qingcan Wang UQCV 71 61 0 06 Mar 2019
Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks Sanjeev Arora S. Du Wei Hu Zhiyuan Li Ruosong Wang MLT 208 974 0 24 Jan 2019
Tightening Mutual Information Based Bounds on Generalization Error Yuheng Bu Shaofeng Zou Venugopal V. Veeravalli 58 177 0 15 Jan 2019
A Priori Estimates of the Population Risk for Two-layer Neural Networks Weinan E Chao Ma Lei Wu 65 132 0 15 Oct 2018
Neural Tangent Kernel: Convergence and Generalization in Neural Networks Arthur Jacot Franck Gabriel Clément Hongler 273 3,219 0 20 Jun 2018
On Tighter Generalization Bound for Deep Neural Networks: CNNs, ResNets, and Beyond Xingguo Li Junwei Lu Zhaoran Wang Jarvis Haupt T. Zhao 55 80 0 13 Jun 2018
Chaining Mutual Information and Tightening Generalization Bounds Amir-Reza Asadi Emmanuel Abbe S. Verdú AI4CE 50 124 0 11 Jun 2018
Understanding Generalization and Optimization Performance of Deep CNNs Pan Zhou Jiashi Feng MLT 106 50 0 28 May 2018
A Mean Field View of the Landscape of Two-Layers Neural Networks Song Mei Andrea Montanari Phan-Minh Nguyen MLT 103 862 0 18 Apr 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 89 643 0 14 Feb 2018
Size-Independent Sample Complexity of Neural Networks Noah Golowich Alexander Rakhlin Ohad Shamir 154 551 0 18 Dec 2017
Fisher-Rao Metric, Geometry, and Complexity of Neural Networks Tengyuan Liang T. Poggio Alexander Rakhlin J. Stokes 76 226 0 05 Nov 2017
Generalization Bounds of SGLD for Non-convex Learning: Two Theoretical Viewpoints Wenlong Mou Liwei Wang Xiyu Zhai Kai Zheng MLT 57 159 0 19 Jul 2017
Exploring Generalization in Deep Learning Behnam Neyshabur Srinadh Bhojanapalli David A. McAllester Nathan Srebro FAtt 160 1,259 0 27 Jun 2017
Spectrally-normalized margin bounds for neural networks Peter L. Bartlett Dylan J. Foster Matus Telgarsky ODL 210 1,225 0 26 Jun 2017
Train longer, generalize better: closing the generalization gap in large batch training of neural networks Elad Hoffer Itay Hubara Daniel Soudry ODL 178 800 0 24 May 2017
Information-theoretic analysis of generalization capability of learning algorithms Aolin Xu Maxim Raginsky 176 447 0 22 May 2017
Opening the Black Box of Deep Neural Networks via Information Ravid Shwartz-Ziv Naftali Tishby AI4CE 111 1,416 0 02 Mar 2017
A Hitting Time Analysis of Stochastic Gradient Langevin Dynamics Yuchen Zhang Percy Liang Moses Charikar 69 236 0 18 Feb 2017
Non-convex learning via Stochastic Gradient Langevin Dynamics: a nonasymptotic analysis Maxim Raginsky Alexander Rakhlin Matus Telgarsky 75 521 0 13 Feb 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 348 4,635 0 10 Nov 2016
Train faster, generalize better: Stability of stochastic gradient descent Moritz Hardt Benjamin Recht Y. Singer 116 1,243 0 03 Sep 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 338 18,651 0 06 Feb 2015
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.7K 100,508 0 04 Sep 2014