Bounding generalization error with input compression: An empirical study with infinite-width networks

19 July 2022

Papers citing "Bounding generalization error with input compression: An empirical study with infinite-width networks"

40 / 40 papers shown

Title
Generalization Through The Lens Of Leave-One-Out Error Gregor Bachmann Thomas Hofmann Aurelien Lucchi 106 7 0 07 Mar 2022
Information Flow in Deep Neural Networks Ravid Shwartz-Ziv 24 21 0 10 Feb 2022
A Note on "Assessing Generalization of SGD via Disagreement" Andreas Kirsch Y. Gal FedML UQCV 36 16 0 03 Feb 2022
Assessing Generalization of SGD via Disagreement Yiding Jiang Vaishnavh Nagarajan Christina Baek J. Zico Kolter 84 112 0 25 Jun 2021
The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization Mufan Li Mihai Nica Daniel M. Roy 72 34 0 07 Jun 2021
Out-of-Distribution Generalization in Kernel Regression Abdulkadir Canatar Blake Bordelon Cengiz Pehlevan OODD OOD 41 13 0 04 Jun 2021
RATT: Leveraging Unlabeled Data to Guarantee Generalization Saurabh Garg Sivaraman Balakrishnan J. Zico Kolter Zachary Chase Lipton 52 30 0 01 May 2021
Finite Versus Infinite Neural Networks: an Empirical Study Jaehoon Lee S. Schoenholz Jeffrey Pennington Ben Adlam Lechao Xiao Roman Novak Jascha Narain Sohl-Dickstein 63 213 0 31 Jul 2020
Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networks Abdulkadir Canatar Blake Bordelon Cengiz Pehlevan 82 187 0 23 Jun 2020
Improving Generalization by Controlling Label-Noise Information in Neural Network Weights Hrayr Harutyunyan Kyle Reing Greg Ver Steeg Aram Galstyan NoLa 30 55 0 19 Feb 2020
Training Normalizing Flows with the Information Bottleneck for Competitive Generative Classification Lynton Ardizzone Radek Mackowiak Ullrich Kothe Carsten Rother UQCV 45 4 0 17 Jan 2020
Neural Tangents: Fast and Easy Infinite Neural Networks in Python Roman Novak Lechao Xiao Jiri Hron Jaehoon Lee Alexander A. Alemi Jascha Narain Sohl-Dickstein S. Schoenholz 64 228 0 05 Dec 2019
Deep Double Descent: Where Bigger Models and More Data Hurt Preetum Nakkiran Gal Kaplun Yamini Bansal Tristan Yang Boaz Barak Ilya Sutskever 119 935 0 04 Dec 2019
Fantastic Generalization Measures and Where to Find Them Yiding Jiang Behnam Neyshabur H. Mobahi Dilip Krishnan Samy Bengio AI4CE 107 606 0 04 Dec 2019
Information in Infinite Ensembles of Infinitely-Wide Neural Networks Ravid Shwartz-Ziv Alexander A. Alemi 48 22 0 20 Nov 2019
On Variational Bounds of Mutual Information Ben Poole Sherjil Ozair Aaron van den Oord Alexander A. Alemi George Tucker SSL 90 806 0 16 May 2019
Adaptive Estimators Show Information Compression in Deep Neural Networks Ivan Chelombiev Conor J. Houghton Cian O’Donnell 56 35 0 24 Feb 2019
Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent Jaehoon Lee Lechao Xiao S. Schoenholz Yasaman Bahri Roman Novak Jascha Narain Sohl-Dickstein Jeffrey Pennington 178 1,097 0 18 Feb 2019
On Evaluating Adversarial Robustness Nicholas Carlini Anish Athalye Nicolas Papernot Wieland Brendel Jonas Rauber Dimitris Tsipras Ian Goodfellow Aleksander Madry Alexey Kurakin ELM AAML 79 900 0 18 Feb 2019
Adversarial Examples Are a Natural Consequence of Test Error in Noise Nic Ford Justin Gilmer Nicholas Carlini E. D. Cubuk AAML 81 319 0 29 Jan 2019
Reconciling modern machine learning practice and the bias-variance trade-off M. Belkin Daniel J. Hsu Siyuan Ma Soumik Mandal 195 1,638 0 28 Dec 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 280 10,253 0 10 Jul 2018
Robustness May Be at Odds with Accuracy Dimitris Tsipras Shibani Santurkar Logan Engstrom Alexander Turner Aleksander Madry AAML 93 1,776 0 30 May 2018
Entropy and mutual information in models of deep neural networks Marylou Gabrié Andre Manoel Clément Luneau Jean Barbier N. Macris Florent Krzakala Lenka Zdeborová 61 180 0 24 May 2018
Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach Wenda Zhou Victor Veitch Morgane Austern Ryan P. Adams Peter Orbanz 73 213 0 16 Apr 2018
i-RevNet: Deep Invertible Networks J. Jacobsen A. Smeulders Edouard Oyallon 83 333 0 20 Feb 2018
To understand deep learning we need to understand kernel learning M. Belkin Siyuan Ma Soumik Mandal 55 418 0 05 Feb 2018
Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples Anish Athalye Nicholas Carlini D. Wagner AAML 185 3,180 0 01 Feb 2018
Wild Patterns: Ten Years After the Rise of Adversarial Machine Learning Battista Biggio Fabio Roli AAML 94 1,407 0 08 Dec 2017
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification P. Helber B. Bischke Andreas Dengel Damian Borth 125 1,806 0 31 Aug 2017
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 242 8,856 0 25 Aug 2017
Emergence of Invariance and Disentanglement in Deep Representations Alessandro Achille Stefano Soatto OOD DRL 88 476 0 05 Jun 2017
Information-theoretic analysis of generalization capability of learning algorithms Aolin Xu Maxim Raginsky 139 445 0 22 May 2017
Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data Gintare Karolina Dziugaite Daniel M. Roy 103 812 0 31 Mar 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 310 4,623 0 10 Nov 2016
Robustness of classifiers: from adversarial to random noise Alhussein Fawzi Seyed-Mohsen Moosavi-Dezfooli P. Frossard AAML 61 374 0 31 Aug 2016
The deterministic information bottleneck D. Strouse D. Schwab 35 135 0 01 Apr 2016
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 265 587 0 27 Feb 2015
Explaining and Harnessing Adversarial Examples Ian Goodfellow Jonathon Shlens Christian Szegedy AAML GAN 229 19,017 0 20 Dec 2014
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 235 14,893 1 21 Dec 2013