Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds, and Benign Overfitting

17 June 2021

Papers citing "Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds, and Benign Overfitting"

45 / 45 papers shown

Title
Quantifying Overfitting along the Regularization Path for Two-Part-Code MDL in Supervised Classification Xiaohan Zhu Nathan Srebro 53 0 0 03 Mar 2025
Overfitting Regimes of Nadaraya-Watson Interpolators Daniel Barzilai Guy Kornowski Ohad Shamir 73 0 0 11 Feb 2025
Universality of Estimator for High-Dimensional Linear Models with Block Dependency Toshiki Tsuda Masaaki Imaizumi 22 0 0 25 Oct 2024
Overfitting Behaviour of Gaussian Kernel Ridgeless Regression: Varying Bandwidth or Dimensionality Marko Medvedev Gal Vardi Nathan Srebro 59 3 0 05 Sep 2024
The Star Geometry of Critic-Based Regularizer Learning Oscar Leong Eliza O'Reilly Yong Sheng Soh AAML 42 0 0 29 Aug 2024
Implicit Regularization Paths of Weighted Neural Representations Jin-Hong Du Pratik Patil 27 0 0 28 Aug 2024
Bayesian Inference for Consistent Predictions in Overparameterized Nonlinear Regression Tomoya Wakayama BDL 57 0 0 06 Apr 2024
Near-Interpolators: Rapid Norm Growth and the Trade-Off between Interpolation and Generalization Yutong Wang Rishi Sonthalia Wei Hu 38 5 0 12 Mar 2024
Benign overfitting in leaky ReLU networks with moderate input dimension Kedar Karhadkar Erin E. George Michael Murray Guido Montúfar Deanna Needell MLT 43 2 0 11 Mar 2024
More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory James B. Simon Dhruva Karkada Nikhil Ghosh Mikhail Belkin AI4CE BDL 26 13 0 24 Nov 2023
Regularization properties of adversarially-trained linear regression Antônio H. Ribeiro Dave Zachariah Francis Bach Thomas B. Schon AAML 26 8 0 16 Oct 2023
Universality of max-margin classifiers Andrea Montanari Feng Ruan Basil Saeed Youngtak Sohn 26 3 0 29 Sep 2023
Towards Last-layer Retraining for Group Robustness with Fewer Annotations Tyler LaBonte Vidya Muthukumar Abhishek Kumar 38 36 0 15 Sep 2023
Six Lectures on Linearized Neural Networks Theodor Misiakiewicz Andrea Montanari 34 12 0 25 Aug 2023
Noisy Interpolation Learning with Shallow Univariate ReLU Networks Nirmit Joshi Gal Vardi Nathan Srebro 32 8 0 28 Jul 2023
An Agnostic View on the Cost of Overfitting in (Kernel) Ridge Regression Lijia Zhou James B. Simon Gal Vardi Nathan Srebro 22 2 0 22 Jun 2023
Training shallow ReLU networks on noisy data using hinge loss: when do we overfit and is it benign? Erin E. George Michael Murray W. Swartworth Deanna Needell MLT 10 4 0 16 Jun 2023
Benign Overfitting in Deep Neural Networks under Lazy Training Zhenyu Zhu Fanghui Liu Grigorios G. Chrysos Francesco Locatello V. Cevher AI4CE 18 10 0 30 May 2023
Bayesian Analysis for Over-parameterized Linear Model via Effective Spectra Tomoya Wakayama Masaaki Imaizumi 51 1 0 25 May 2023
From Tempered to Benign Overfitting in ReLU Neural Networks Guy Kornowski Gilad Yehudai Ohad Shamir 20 12 0 24 May 2023
Benign Overfitting of Non-Sparse High-Dimensional Linear Regression with Correlated Noise Toshiki Tsuda Masaaki Imaizumi CML 21 5 0 08 Apr 2023
Finite-Sample Analysis of Learning High-Dimensional Single ReLU Neuron Jingfeng Wu Difan Zou Zixiang Chen Vladimir Braverman Quanquan Gu Sham Kakade 90 6 0 03 Mar 2023
Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization Spencer Frei Gal Vardi Peter L. Bartlett Nathan Srebro 30 22 0 02 Mar 2023
Interpolation Learning With Minimum Description Length N. Manoj Nathan Srebro 25 4 0 14 Feb 2023
Implicit Regularization Leads to Benign Overfitting for Sparse Linear Regression Mo Zhou Rong Ge 27 2 0 01 Feb 2023
$Tight bounds for maximum $\ell_1$-margin classifiers$ Tight bounds for maximum $\ell_1$ -margin classifiers Stefan Stojanovic Konstantin Donhauser Fanny Yang 35 0 0 07 Dec 2022
A PAC-Bayesian Generalization Bound for Equivariant Networks Arash Behboodi Gabriele Cesa Taco S. Cohen 48 17 0 24 Oct 2022
A Non-Asymptotic Moreau Envelope Theory for High-Dimensional Generalized Linear Models Lijia Zhou Frederic Koehler Pragya Sur Danica J. Sutherland Nathan Srebro 83 9 0 21 Oct 2022
The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers Zong-xiao Li Chong You Srinadh Bhojanapalli Daliang Li A. S. Rawat ... Kenneth Q Ye Felix Chern Felix X. Yu Ruiqi Guo Surinder Kumar MoE 25 87 0 12 Oct 2022
Deep Linear Networks can Benignly Overfit when Shallow Ones Do Niladri S. Chatterji Philip M. Long 17 8 0 19 Sep 2022
A Universal Trade-off Between the Model Size, Test Loss, and Training Loss of Linear Predictors Nikhil Ghosh M. Belkin 13 7 0 23 Jul 2022
Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting Neil Rohit Mallinar James B. Simon Amirhesam Abedsoltan Parthe Pandit M. Belkin Preetum Nakkiran 24 37 0 14 Jul 2022
Max-Margin Works while Large Margin Fails: Generalization without Uniform Convergence Margalit Glasgow Colin Wei Mary Wootters Tengyu Ma 38 5 0 16 Jun 2022
Fast Rates for Noisy Interpolation Require Rethinking the Effects of Inductive Bias Konstantin Donhauser Nicolò Ruggeri Stefan Stojanovic Fanny Yang 10 20 0 07 Mar 2022
The Sample Complexity of One-Hidden-Layer Neural Networks Gal Vardi Ohad Shamir Nathan Srebro 17 10 0 13 Feb 2022
Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data Spencer Frei Niladri S. Chatterji Peter L. Bartlett MLT 34 69 0 11 Feb 2022
Predicting Out-of-Distribution Error with the Projection Norm Yaodong Yu Zitong Yang Alexander Wei Yi-An Ma Jacob Steinhardt OODD 12 43 0 11 Feb 2022
Benign-Overfitting in Conditional Average Treatment Effect Prediction with Linear Regression Masahiro Kato Masaaki Imaizumi CML OOD 46 1 0 10 Feb 2022
Optimistic Rates: A Unifying Theory for Interpolation Learning and Regularization in Linear Regression Lijia Zhou Frederic Koehler Danica J. Sutherland Nathan Srebro 89 24 0 08 Dec 2021
Tight bounds for minimum l1-norm interpolation of noisy data Guillaume Wang Konstantin Donhauser Fanny Yang 79 20 0 10 Nov 2021
Foolish Crowds Support Benign Overfitting Niladri S. Chatterji Philip M. Long 83 20 0 06 Oct 2021
A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning Yehuda Dar Vidya Muthukumar Richard G. Baraniuk 29 71 0 06 Sep 2021
Failures of model-dependent generalization bounds for least-norm interpolation Peter L. Bartlett Philip M. Long 80 29 0 16 Oct 2020
Benign overfitting in ridge regression Alexander Tsigler Peter L. Bartlett 20 159 0 29 Sep 2020
Learning without Concentration S. Mendelson 85 334 0 01 Jan 2014