Input margins can predict generalization too

29 August 2023

Coenraad Mouton

Marthinus W. Theunissen

Marelie Hattingh Davel

Papers citing "Input margins can predict generalization too"

26 / 26 papers shown

Title
The Missing Margin: How Sample Corruption Affects Distance to the Boundary in ANNs Marthinus W. Theunissen Coenraad Mouton Marelie Hattingh Davel 45 1 0 14 Feb 2023
PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization Sanae Lotfi Marc Finzi Sanyam Kapoor Andres Potapczynski Micah Goldblum A. Wilson BDL MLT AI4CE 58 61 0 24 Nov 2022
On Predicting Generalization using GANs Yi Zhang Arushi Gupta Nikunj Saunshi Sanjeev Arora AI4CE 153 6 0 28 Nov 2021
Predicting Deep Neural Network Generalization with Perturbation Response Curves Yair Schiff Brian Quanz Payel Das Pin-Yu Chen AAML 22 14 0 09 Jun 2021
Measuring Generalization with Optimal Transport Ching-Yao Chuang Youssef Mroueh Kristjan Greenewald Antonio Torralba Stefanie Jegelka OT 69 27 0 07 Jun 2021
Robustness to Augmentations as a Generalization metric Sumukh K Aithal D. Kashyap Natarajan Subramanyam OOD 29 18 0 16 Jan 2021
NeurIPS 2020 Competition: Predicting Generalization in Deep Learning Yiding Jiang Pierre Foret Scott Yak Daniel M. Roy H. Mobahi Gintare Karolina Dziugaite Samy Bengio Suriya Gunasekar Isabelle M Guyon Behnam Neyshabur Google Research OOD 62 55 0 14 Dec 2020
$k$ -Variance: A Clustered Notion of Variance Justin Solomon Kristjan Greenewald H. Nagaraja 43 9 0 13 Dec 2020
Representation Based Complexity Measures for Predicting Generalization in Deep Learning Parth Natekar Manik Sharma 40 36 0 04 Dec 2020
Boundary thickness and robustness in learning models Yaoqing Yang Rekha Khanna Yaodong Yu A. Gholami Kurt Keutzer Joseph E. Gonzalez Kannan Ramchandran Michael W. Mahoney OOD 56 41 0 09 Jul 2020
Fantastic Generalization Measures and Where to Find Them Yiding Jiang Behnam Neyshabur H. Mobahi Dilip Krishnan Samy Bengio AI4CE 139 607 0 04 Dec 2019
Adversarial Training Can Hurt Generalization Aditi Raghunathan Sang Michael Xie Fanny Yang John C. Duchi Percy Liang 82 243 0 14 Jun 2019
Disentangling Adversarial Robustness and Generalization David Stutz Matthias Hein Bernt Schiele AAML OOD 267 281 0 03 Dec 2018
Predicting the Generalization Gap in Deep Networks with Margin Distributions Yiding Jiang Dilip Krishnan H. Mobahi Samy Bengio UQCV 93 199 0 28 Sep 2018
Is Robustness the Cost of Accuracy? -- A Comprehensive Study on the Robustness of 18 Deep Image Classification Models D. Su Huan Zhang Hongge Chen Jinfeng Yi Pin-Yu Chen Yupeng Gao VLM 130 391 0 05 Aug 2018
Robustness May Be at Odds with Accuracy Dimitris Tsipras Shibani Santurkar Logan Engstrom Alexander Turner Aleksander Madry AAML 104 1,781 0 30 May 2018
Large Margin Deep Networks for Classification Gamaleldin F. Elsayed Dilip Krishnan H. Mobahi Kevin Regan Samy Bengio MQ 56 284 0 15 Mar 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 86 642 0 14 Feb 2018
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 280 9,764 0 25 Oct 2017
Generalization in Deep Learning Kenji Kawaguchi L. Kaelbling Yoshua Bengio ODL 91 460 0 16 Oct 2017
Spectrally-normalized margin bounds for neural networks Peter L. Bartlett Dylan J. Foster Matus Telgarsky ODL 207 1,220 0 26 Jun 2017
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 310 12,069 0 19 Jun 2017
Towards Evaluating the Robustness of Neural Networks Nicholas Carlini D. Wagner OOD AAML 266 8,555 0 16 Aug 2016
Robust Large Margin Deep Neural Networks Jure Sokolić Raja Giryes Guillermo Sapiro M. Rodrigues 72 309 0 26 May 2016
DeepFool: a simple and accurate method to fool deep neural networks Seyed-Mohsen Moosavi-Dezfooli Alhussein Fawzi P. Frossard AAML 151 4,897 0 14 Nov 2015
Learning with a Strong Adversary Ruitong Huang Bing Xu Dale Schuurmans Csaba Szepesvári AAML 79 358 0 10 Nov 2015