Deep Linear Networks can Benignly Overfit when Shallow Ones Do

Deep Linear Networks can Benignly Overfit when Shallow Ones Do

19 September 2022

Niladri S. Chatterji

Papers citing "Deep Linear Networks can Benignly Overfit when Shallow Ones Do"

10 / 10 papers shown

Title
Towards understanding epoch-wise double descent in two-layer linear neural networks Amanda Olmin Fredrik Lindsten MLT 27 3 0 13 Jul 2024
Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics Soo Min Kwon Zekai Zhang Dogyoon Song Laura Balzano Qing Qu 41 2 0 08 Nov 2023
Why Does Sharpness-Aware Minimization Generalize Better Than SGD? Zixiang Chen Junkai Zhang Yiwen Kou Xiangning Chen Cho-Jui Hsieh Quanquan Gu 32 13 0 11 Oct 2023
Benign Overfitting in Two-Layer ReLU Convolutional Neural Networks for XOR Data Xuran Meng Difan Zou Yuan Cao MLT 29 8 0 03 Oct 2023
Precise Asymptotic Generalization for Multiclass Classification with Overparameterized Linear Models David X. Wu A. Sahai 26 2 0 23 Jun 2023
From Tempered to Benign Overfitting in ReLU Neural Networks Guy Kornowski Gilad Yehudai Ohad Shamir 20 12 0 24 May 2023
Benign Overfitting for Two-layer ReLU Convolutional Neural Networks Yiwen Kou Zi-Yuan Chen Yuanzhou Chen Quanquan Gu MLT 49 13 0 07 Mar 2023
The Implicit Bias of Benign Overfitting Ohad Shamir 99 37 0 27 Jan 2022
Foolish Crowds Support Benign Overfitting Niladri S. Chatterji Philip M. Long 83 20 0 06 Oct 2021
Failures of model-dependent generalization bounds for least-norm interpolation Peter L. Bartlett Philip M. Long 90 29 0 16 Oct 2020