Understanding deep learning requires rethinking generalization

10 November 2016

Benjamin Recht

Papers citing "Understanding deep learning requires rethinking generalization"

50 / 927 papers shown

Title
Neural Networks as Kernel Learners: The Silent Alignment Effect Alexander B. Atanasov Blake Bordelon Cengiz Pehlevan MLT 26 75 0 29 Oct 2021
PAC-Bayesian Learning of Aggregated Binary Activated Neural Networks with Probabilities over Representations Louis Fortier-Dubois Gaël Letarte Benjamin Leblanc Franccois Laviolette Pascal Germain UQCV 17 0 0 28 Oct 2021
Addressing out-of-distribution label noise in webly-labelled data Paul Albert Diego Ortego Eric Arazo Noel E. O'Connor Kevin McGuinness NoLa 16 16 0 26 Oct 2021
Rethinking Neural vs. Matrix-Factorization Collaborative Filtering: the Theoretical Perspectives Zida Cheng Chuanwei Ruan Siheng Chen Sushant Kumar Ya Zhang 27 16 0 23 Oct 2021
PropMix: Hard Sample Filtering and Proportional MixUp for Learning with Noisy Labels F. Cordeiro Vasileios Belagiannis Ian Reid G. Carneiro NoLa 30 18 0 22 Oct 2021
Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model A. Bodin N. Macris 37 13 0 22 Oct 2021
On the Regularization of Autoencoders Harald Steck Dario Garcia-Garcia SSL AI4CE 30 4 0 21 Oct 2021
Behavioral Experiments for Understanding Catastrophic Forgetting Samuel J. Bell Neil D. Lawrence 35 4 0 20 Oct 2021
Noisy Annotation Refinement for Object Detection Jiafeng Mao Qing Yu Yoko Yamakata Kiyoharu Aizawa NoLa 42 10 0 20 Oct 2021
Interpretive Blindness Nicholas M. Asher Julie Hunter 19 0 0 19 Oct 2021
Mitigating Memorization of Noisy Labels via Regularization between Representations Hao Cheng Zhaowei Zhu Xing Sun Yang Liu NoLa 38 28 0 18 Oct 2021
Alleviating Noisy-label Effects in Image Classification via Probability Transition Matrix Ziqi Zhang Yuexiang Li Hongxin Wei Kai Ma Tao Xu Yefeng Zheng NoLa 30 5 0 17 Oct 2021
Deep Active Learning by Leveraging Training Dynamics Haonan Wang Wei Huang Ziwei Wu A. Margenot Hanghang Tong Jingrui He AI4CE 27 33 0 16 Oct 2021
Clean or Annotate: How to Spend a Limited Data Collection Budget Derek Chen Zhou Yu Samuel R. Bowman 35 13 0 15 Oct 2021
Continual Learning on Noisy Data Streams via Self-Purified Replay C. Kim Jinseo Jeong Sang-chul Moon Gunhee Kim CLL 40 39 0 14 Oct 2021
The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks R. Entezari Hanie Sedghi O. Saukh Behnam Neyshabur MoMe 39 217 0 12 Oct 2021
Implicit Bias of Linear Equivariant Networks Hannah Lawrence Kristian Georgiev A. Dienes B. Kiani AI4CE 40 14 0 12 Oct 2021
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks Shuai Zhang Meng Wang Sijia Liu Pin-Yu Chen Jinjun Xiong UQCV MLT 31 13 0 12 Oct 2021
Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations Jiayao Zhang Hua Wang Weijie J. Su 35 7 0 11 Oct 2021
Tighter Sparse Approximation Bounds for ReLU Neural Networks Carles Domingo-Enrich Youssef Mroueh 99 4 0 07 Oct 2021
Robustness and Reliability When Training With Noisy Labels Amanda Olmin Fredrik Lindsten OOD NoLa 24 14 0 07 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 37 22 0 07 Oct 2021
On Margin Maximization in Linear and ReLU Networks Gal Vardi Ohad Shamir Nathan Srebro 52 28 0 06 Oct 2021
Influence-Balanced Loss for Imbalanced Visual Classification Seulki Park Jongin Lim Younghan Jeon J. Choi CVBM 90 133 0 06 Oct 2021
Spectral Bias in Practice: The Role of Function Frequency in Generalization Sara Fridovich-Keil Raphael Gontijo-Lopes Rebecca Roelofs 41 28 0 06 Oct 2021
On the Impact of Stable Ranks in Deep Nets B. Georgiev L. Franken Mayukh Mukherjee Georgios Arvanitidis 21 3 0 05 Oct 2021
Trustworthy AI: From Principles to Practices Bo-wen Li Peng Qi Bo Liu Shuai Di Jingen Liu Jiquan Pei Jinfeng Yi Bowen Zhou 119 356 0 04 Oct 2021
Discriminative Attribution from Counterfactuals N. Eckstein A. S. Bates G. Jefferis Jan Funke FAtt CML 27 1 0 28 Sep 2021
Classification and Adversarial examples in an Overparameterized Linear Model: A Signal Processing Perspective Adhyyan Narang Vidya Muthukumar A. Sahai SILM AAML 36 1 0 27 Sep 2021
Deep Exploration for Recommendation Systems Zheqing Zhu Benjamin Van Roy 32 11 0 26 Sep 2021
Training Dynamic based data filtering may not work for NLP datasets Arka Talukdar Monika Dagar Prachi Gupta Varun G. Menon NoLa 48 3 0 19 Sep 2021
Reinforcement Learning on Encrypted Data Alberto Jesu Victor-Alexandru Darvariu Alessandro Staffolani R. Montanari Mirco Musolesi OffRL 21 1 0 16 Sep 2021
No True State-of-the-Art? OOD Detection Methods are Inconsistent across Datasets Fahim Tajwar Ananya Kumar Sang Michael Xie Percy Liang OODD 22 21 0 12 Sep 2021
Feature Selection on Thermal-stress Dataset Xuyang Shen J. Plested Tom Gedeon 160 0 0 08 Sep 2021
A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning Yehuda Dar Vidya Muthukumar Richard G. Baraniuk 34 71 0 06 Sep 2021
Dash: Semi-Supervised Learning with Dynamic Thresholding Yi Tian Xu Lei Shang Jinxing Ye Qi Qian Yu-Feng Li Baigui Sun Hao Li R. L. Jin 47 218 0 01 Sep 2021
Feature Importance in a Deep Learning Climate Emulator Wei-ping Xu Xihaier Luo Yihui Ren Ji Hwan Park Shinjae Yoo B. Nadiga FAtt AI4TS 39 3 0 27 Aug 2021
Multi-domain semantic segmentation with overlapping labels Petra Bevandić Marin Orsic Ivan Grubišić Josip Saric Sinisa Segvic 33 13 0 25 Aug 2021
NGC: A Unified Framework for Learning with Open-World Noisy Data Zhi-Fan Wu Tong Wei Jianwen Jiang Chaojie Mao Mingqian Tang Yu-Feng Li 11 80 0 25 Aug 2021
Towards Efficient and Data Agnostic Image Classification Training Pipeline for Embedded Systems K. Prokofiev V. Sovrasov 3DH 19 2 0 16 Aug 2021
Cooperative Learning for Noisy Supervision Hao Wu Jiangchao Yao Ya Zhang Yanfeng Wang NoLa 14 2 0 11 Aug 2021
Unified Regularity Measures for Sample-wise Learning and Generalization Chi Zhang Xiaoning Ma Yu Liu Le Wang Yuanqi Su Yuehu Liu 39 1 0 09 Aug 2021
Learning with Noisy Labels via Sparse Regularization Xiong Zhou Xianming Liu Chenyang Wang Deming Zhai Junjun Jiang Xiangyang Ji NoLa 34 51 0 31 Jul 2021
Simple, Fast, and Flexible Framework for Matrix Completion with Infinite Width Neural Networks Adityanarayanan Radhakrishnan George Stefanakis M. Belkin Caroline Uhler 30 25 0 31 Jul 2021
Generalizing Gaze Estimation with Outlier-guided Collaborative Adaptation Yunfei Liu Ruicong Liu Haofei Wang Feng Lu OOD 21 54 0 29 Jul 2021
Characterizing the Generalization Error of Gibbs Algorithm with Symmetrized KL information Gholamali Aminian Yuheng Bu Laura Toni M. Rodrigues G. Wornell 30 4 0 28 Jul 2021
Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization Chiyuan Zhang M. Raghu Jon M. Kleinberg Samy Bengio OOD 32 30 0 27 Jul 2021
Rethinking Hard-Parameter Sharing in Multi-Domain Learning Lijun Zhang Qizheng Yang Xiao Liu Hui Guan OOD 31 14 0 23 Jul 2021
Memorization in Deep Neural Networks: Does the Loss Function matter? Deep Patel P. Sastry TDI 27 8 0 21 Jul 2021
kNet: A Deep kNN Network To Handle Label Noise Itzik Mizrahi S. Avidan NoLa 21 0 0 20 Jul 2021