Just Interpolate: Kernel "Ridgeless" Regression Can Generalize

1 August 2018

Papers citing "Just Interpolate: Kernel "Ridgeless" Regression Can Generalize"

18 / 18 papers shown

Title
Directional Convergence, Benign Overfitting of Gradient Descent in leaky ReLU two-layer Neural Networks Ichiro Hashimoto MLT 42 0 0 22 May 2025
Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance Dimitris Oikonomou Nicolas Loizou 64 5 0 06 Jun 2024
Thermodynamic limit in learning period three Yuichiro Terasaki Kohei Nakajima 61 1 0 12 May 2024
Benign Overfitting in Time Series Linear Models with Over-Parameterization Shogo H. Nakakita Masaaki Imaizumi AI4TS 159 5 0 18 Apr 2022
Precise High-Dimensional Asymptotics for Quantifying Heterogeneous Transfers Fan Yang Hongyang R. Zhang Sen Wu Christopher Ré Weijie J. Su 78 11 0 22 Oct 2020
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 98 454 0 09 Aug 2020
Optimal Regularization Can Mitigate Double Descent Preetum Nakkiran Prayaag Venkat Sham Kakade Tengyu Ma 67 130 0 04 Mar 2020
Training Neural Networks as Learning Data-adaptive Kernels: Provable Representation and Approximation Benefits Xialiang Dou Tengyuan Liang MLT 54 42 0 21 Jan 2019
Does data interpolation contradict statistical optimality? M. Belkin Alexander Rakhlin Alexandre B. Tsybakov 62 218 0 25 Jun 2018
Overfitting or perfect fitting? Risk bounds for classification and regression rules that interpolate M. Belkin Daniel J. Hsu P. Mitra AI4CE 125 256 0 13 Jun 2018
To understand deep learning we need to understand kernel learning M. Belkin Siyuan Ma Soumik Mandal 42 418 0 05 Feb 2018
Approximation beats concentration? An approximation view on inference with smooth radial kernels M. Belkin 77 69 0 10 Jan 2018
Algorithmic Regularization in Over-parameterized Matrix Sensing and Neural Networks with Quadratic Activations Yuanzhi Li Tengyu Ma Hongyang R. Zhang 53 31 0 26 Dec 2017
Implicit Regularization in Matrix Factorization Suriya Gunasekar Blake E. Woodworth Srinadh Bhojanapalli Behnam Neyshabur Nathan Srebro 65 490 0 25 May 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 269 4,620 0 10 Nov 2016
In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Nathan Srebro AI4CE 78 655 0 20 Dec 2014
Kernels for Vector-Valued Functions: a Review Mauricio A. Alvarez Lorenzo Rosasco Neil D. Lawrence GP 150 918 0 30 Jun 2011
The spectrum of kernel random matrices N. Karoui 122 223 0 04 Jan 2010