Harmless interpolation of noisy data in regression

21 March 2019

Papers citing "Harmless interpolation of noisy data in regression"

47 / 47 papers shown

Title
Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Grouping Guannan Lai Yujie Li Xiangkun Wang Jingyang Zhang Tianrui Li Xin Yang CLL 51 0 0 27 Feb 2025
Analysis of Overparameterization in Continual Learning under a Linear Model Daniel Goldfarb Paul Hand CLL 39 0 0 11 Feb 2025
On Memorization of Large Language Models in Logical Reasoning Chulin Xie Yangsibo Huang Chiyuan Zhang Da Yu Xinyun Chen Bill Yuchen Lin Bo Li Badih Ghazi Ravi Kumar LRM 58 24 0 30 Oct 2024
Provable Weak-to-Strong Generalization via Benign Overfitting David X. Wu A. Sahai 79 6 0 06 Oct 2024
Investigating the Impact of Model Complexity in Large Language Models Jing Luo Huiyuan Wang Weiran Huang 41 0 0 01 Oct 2024
Overfitting Behaviour of Gaussian Kernel Ridgeless Regression: Varying Bandwidth or Dimensionality Marko Medvedev Gal Vardi Nathan Srebro 70 3 0 05 Sep 2024
Implicit Bias and Fast Convergence Rates for Self-attention Bhavya Vasudeva Puneesh Deora Christos Thrampoulidis 39 15 0 08 Feb 2024
Precise Asymptotic Generalization for Multiclass Classification with Overparameterized Linear Models David X. Wu A. Sahai 29 2 0 23 Jun 2023
Gibbs-Based Information Criteria and the Over-Parameterized Regime Haobo Chen Yuheng Bu Greg Wornell 29 1 0 08 Jun 2023
Least Squares Regression Can Exhibit Under-Parameterized Double Descent Xinyue Li Rishi Sonthalia 44 3 0 24 May 2023
Subsample Ridge Ensembles: Equivalences and Generalized Cross-Validation Jin-Hong Du Pratik V. Patil Arun K. Kuchibhotla 26 11 0 25 Apr 2023
General Loss Functions Lead to (Approximate) Interpolation in High Dimensions Kuo-Wei Lai Vidya Muthukumar 34 5 0 13 Mar 2023
DSD $^2$ : Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free? Victor Quétu Enzo Tartaglione 34 7 0 02 Mar 2023
Can we avoid Double Descent in Deep Neural Networks? Victor Quétu Enzo Tartaglione AI4CE 20 3 0 26 Feb 2023
Implicit Regularization Leads to Benign Overfitting for Sparse Linear Regression Mo Zhou Rong Ge 37 2 0 01 Feb 2023
Strong inductive biases provably prevent harmless interpolation Michael Aerni Marco Milanta Konstantin Donhauser Fanny Yang 42 9 0 18 Jan 2023
High Dimensional Binary Classification under Label Shift: Phase Transition and Regularization Jiahui Cheng Minshuo Chen Hao Liu Tuo Zhao Wenjing Liao 44 0 0 01 Dec 2022
Interpolating Discriminant Functions in High-Dimensional Gaussian Latent Mixtures Xin Bing M. Wegkamp 21 1 0 25 Oct 2022
A Non-Asymptotic Moreau Envelope Theory for High-Dimensional Generalized Linear Models Lijia Zhou Frederic Koehler Pragya Sur Danica J. Sutherland Nathan Srebro 83 9 0 21 Oct 2022
Monotonicity and Double Descent in Uncertainty Estimation with Gaussian Processes Liam Hodgkinson Christopher van der Heide Fred Roosta Michael W. Mahoney UQCV 20 5 0 14 Oct 2022
On the Impossible Safety of Large AI Models El-Mahdi El-Mhamdi Sadegh Farhadkhani R. Guerraoui Nirupam Gupta L. Hoang Rafael Pinot Sébastien Rouault John Stephan 37 31 0 30 Sep 2022
Deep Double Descent via Smooth Interpolation Matteo Gamba Erik Englesson Mårten Björkman Hossein Azizpour 63 11 0 21 Sep 2022
Deep Linear Networks can Benignly Overfit when Shallow Ones Do Niladri S. Chatterji Philip M. Long 23 8 0 19 Sep 2022
Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting Neil Rohit Mallinar James B. Simon Amirhesam Abedsoltan Parthe Pandit M. Belkin Preetum Nakkiran 26 37 0 14 Jul 2022
Random Features Model with General Convex Regularization: A Fine Grained Analysis with Precise Asymptotic Learning Curves David Bosch Ashkan Panahi Ayça Özçelikkale Devdatt Dubhash MLT 29 2 0 06 Apr 2022
Estimation under Model Misspecification with Fake Features Martin Hellkvist Ayça Özçelikkale Anders Ahlén 27 11 0 07 Mar 2022
A Domain-Theoretic Framework for Robustness Analysis of Neural Networks Can Zhou R. A. Shaikh Yiran Li Amin Farjudian OOD 41 4 0 01 Mar 2022
SCORE: Approximating Curvature Information under Self-Concordant Regularization Adeyemi Damilare Adeoye Alberto Bemporad 20 4 0 14 Dec 2021
Tight bounds for minimum l1-norm interpolation of noisy data Guillaume Wang Konstantin Donhauser Fanny Yang 81 20 0 10 Nov 2021
Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model A. Bodin N. Macris 39 13 0 22 Oct 2021
Classification and Adversarial examples in an Overparameterized Linear Model: A Signal Processing Perspective Adhyyan Narang Vidya Muthukumar A. Sahai SILM AAML 36 1 0 27 Sep 2021
A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning Yehuda Dar Vidya Muthukumar Richard G. Baraniuk 38 71 0 06 Sep 2021
Interpolation can hurt robust generalization even when there is no noise Konstantin Donhauser Alexandru cTifrea Michael Aerni Reinhard Heckel Fanny Yang 34 14 0 05 Aug 2021
Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds, and Benign Overfitting Frederic Koehler Lijia Zhou Danica J. Sutherland Nathan Srebro 32 56 0 17 Jun 2021
Double Descent and Other Interpolation Phenomena in GANs Lorenzo Luzi Yehuda Dar Richard Baraniuk 26 5 0 07 Jun 2021
Towards an Understanding of Benign Overfitting in Neural Networks Zhu Li Zhi-Hua Zhou Arthur Gretton MLT 33 35 0 06 Jun 2021
Risk Bounds for Over-parameterized Maximum Margin Classification on Sub-Gaussian Mixtures Yuan Cao Quanquan Gu M. Belkin 11 51 0 28 Apr 2021
Memorizing without overfitting: Bias, variance, and interpolation in over-parameterized models J. Rocks Pankaj Mehta 23 41 0 26 Oct 2020
On the proliferation of support vectors in high dimensions Daniel J. Hsu Vidya Muthukumar Ji Xu 26 42 0 22 Sep 2020
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 46 441 0 09 Aug 2020
How benign is benign overfitting? Amartya Sanyal P. Dokania Varun Kanade Philip Torr NoLa AAML 23 57 0 08 Jul 2020
To Each Optimizer a Norm, To Each Norm its Generalization Sharan Vaswani Reza Babanezhad Jose Gallego Aaron Mishkin Simon Lacoste-Julien Nicolas Le Roux 26 8 0 11 Jun 2020
Classification vs regression in overparameterized regimes: Does the loss function matter? Vidya Muthukumar Adhyyan Narang Vignesh Subramanian M. Belkin Daniel J. Hsu A. Sahai 43 149 0 16 May 2020
Exact expressions for double descent and implicit regularization via surrogate random design Michal Derezinski Feynman T. Liang Michael W. Mahoney 27 77 0 10 Dec 2019
A Model of Double Descent for High-dimensional Binary Linear Classification Zeyu Deng A. Kammoun Christos Thrampoulidis 39 145 0 13 Nov 2019
Benign Overfitting in Linear Regression Peter L. Bartlett Philip M. Long Gábor Lugosi Alexander Tsigler MLT 8 763 0 26 Jun 2019
Optimal ridge penalty for real-world high-dimensional data can be zero or negative due to the implicit ridge regularization D. Kobak Jonathan Lomond Benoit Sanchez 35 89 0 28 May 2018