Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel

27 July 2021

Papers citing "Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel"

19 / 19 papers shown

Title
Stability and Generalization of Quantum Neural Networks Jiaqi Yang Wei Xie Xiaohua Xu 40 1 0 22 Jan 2025
Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods Hossein Taheri Christos Thrampoulidis Arya Mazumdar MLT 36 0 0 13 Oct 2024
Bootstrap SGD: Algorithmic Stability and Robustness Andreas Christmann Yunwen Lei 40 0 0 02 Sep 2024
Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes Dan Qiao Kaiqi Zhang Esha Singh Daniel Soudry Yu-Xiang Wang NoLa 36 3 0 10 Jun 2024
NTK-Guided Few-Shot Class Incremental Learning Jingren Liu Zhong Ji Yanwei Pang YunLong Yu CLL 39 3 0 19 Mar 2024
On the Optimization and Generalization of Multi-head Attention Puneesh Deora Rouzbeh Ghaderi Hossein Taheri Christos Thrampoulidis MLT 47 33 0 19 Oct 2023
Stability and Generalization for Minibatch SGD and Local SGD Yunwen Lei Tao Sun Mingrui Liu 32 3 0 02 Oct 2023
Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent Xiaoge Deng Li Shen Shengwei Li Tao Sun Dongsheng Li Dacheng Tao 28 3 0 18 Aug 2023
A Linearly Convergent GAN Inversion-based Algorithm for Reverse Engineering of Deceptions D. Thaker Paris V. Giampouras René Vidal AAML 24 0 0 07 Jun 2023
Three-Way Trade-Off in Multi-Objective Learning: Optimization, Generalization and Conflict-Avoidance Lisha Chen H. Fernando Yiming Ying Tianyi Chen 21 21 0 31 May 2023
Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks Puyu Wang Yunwen Lei Di Wang Yiming Ying Ding-Xuan Zhou MLT 29 3 0 26 May 2023
Generalization and Stability of Interpolating Neural Networks with Minimal Width Hossein Taheri Christos Thrampoulidis 37 16 0 18 Feb 2023
Norm-based Generalization Bounds for Compositionally Sparse Neural Networks Tomer Galanti Mengjia Xu Liane Galanti T. Poggio 30 9 0 28 Jan 2023
Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks Yunwen Lei Rong Jin Yiming Ying MLT 40 18 0 19 Sep 2022
Stability and Generalization of Stochastic Optimization with Nonconvex and Nonsmooth Problems Yunwen Lei 11 16 0 14 Jun 2022
Black-Box Generalization: Stability of Zeroth-Order Learning Konstantinos E. Nikolakakis Farzin Haddadpour Dionysios S. Kalogerias Amin Karbasi MLT 24 2 0 14 Feb 2022
On the Role of Optimization in Double Descent: A Least Squares Study Ilja Kuzborskij Csaba Szepesvári Omar Rivasplata Amal Rannen-Triki Razvan Pascanu 26 10 0 27 Jul 2021
Nonparametric Regression with Shallow Overparameterized Neural Networks Trained by GD with Early Stopping Ilja Kuzborskij Csaba Szepesvári 52 7 0 12 Jul 2021
Early-stopped neural networks are consistent Ziwei Ji Justin D. Li Matus Telgarsky 14 36 0 10 Jun 2021