A Near Complete Nonasymptotic Generalization Theory For Multilayer Neural Networks: Beyond the Bias-Variance Tradeoff

3 March 2025

Papers citing "A Near Complete Nonasymptotic Generalization Theory For Multilayer Neural Networks: Beyond the Bias-Variance Tradeoff"

16 / 16 papers shown

Title
Unraveling the Enigma of Double Descent: An In-depth Analysis through the Lens of Learned Feature Space Yufei Gu Xiaoqing Zheng T. Aste 50 3 0 20 Oct 2023
Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle Rylan Schaeffer Mikail Khona Zachary Robertson Akhilan Boopathy Kateryna Pistunova J. Rocks Ila Rani Fiete Oluwasanmi Koyejo 104 34 0 24 Mar 2023
Generalization Error Bounds for Deep Neural Networks Trained by SGD Mingze Wang Chao Ma 15 14 0 07 Jun 2022
Characterization of the Variation Spaces Corresponding to Shallow Neural Networks Jonathan W. Siegel Jinchao Xu 61 43 0 28 Jun 2021
A Multi-resolution Theory for Approximating Infinite- $p$ -Zero- $n$ : Transitional Inference, Individualized Predictions, and a World Without Bias-Variance Trade-off Xinran Li Xiangxu Meng 22 13 0 17 Oct 2020
On the Banach spaces associated with multi-layer ReLU networks: Function representation, approximation theory and gradient descent dynamics E. Weinan Stephan Wojtowytsch MLT 36 53 0 30 Jul 2020
Rethinking Bias-Variance Trade-off for Generalization of Neural Networks Zitong Yang Yaodong Yu Chong You Jacob Steinhardt Yi-An Ma 55 183 0 26 Feb 2020
Surprises in High-Dimensional Ridgeless Least Squares Interpolation Trevor Hastie Andrea Montanari Saharon Rosset Robert Tibshirani 135 737 0 19 Mar 2019
Sharp Analysis for Nonconvex SGD Escaping from Saddle Points Cong Fang Zhouchen Lin Tong Zhang 59 104 0 01 Feb 2019
Generalization in Deep Networks: The Role of Distance from Initialization Vaishnavh Nagarajan J. Zico Kolter ODL 67 96 0 07 Jan 2019
Reconciling modern machine learning practice and the bias-variance trade-off M. Belkin Daniel J. Hsu Siyuan Ma Soumik Mandal 178 1,628 0 28 Dec 2018
Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers Zeyuan Allen-Zhu Yuanzhi Li Yingyu Liang MLT 142 769 0 12 Nov 2018
Gradient Descent Provably Optimizes Over-parameterized Neural Networks S. Du Xiyu Zhai Barnabás Póczós Aarti Singh MLT ODL 161 1,261 0 04 Oct 2018
Generalization Error in Deep Learning Daniel Jakubovitz Raja Giryes M. Rodrigues AI4CE 122 111 0 03 Aug 2018
Trainability and Accuracy of Neural Networks: An Interacting Particle System Approach Grant M. Rotskoff Eric Vanden-Eijnden 89 119 0 02 May 2018
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 242 583 0 27 Feb 2015