Non-vacuous Generalization Bounds for Deep Neural Networks without any modification to the trained models

10 March 2025

Papers citing "Non-vacuous Generalization Bounds for Deep Neural Networks without any modification to the trained models"

16 / 16 papers shown

Title
Slicing Mutual Information Generalization Bounds for Neural Networks Kimia Nadjahi Kristjan Greenewald Rickard Brüel-Gabrielsson Justin Solomon 76 4 0 06 Jun 2024
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.4K 14,313 0 15 Mar 2023
Tighter PAC-Bayes Generalisation Bounds by Leveraging Example Difficulty Felix Biggs Benjamin Guedj 65 7 0 20 Oct 2022
Generalisation under gradient descent via deterministic PAC-Bayes Eugenio Clerico Tyler Farghly George Deligiannidis Benjamin Guedj Arnaud Doucet 70 4 0 06 Sep 2022
Rate-Distortion Theoretic Generalization Bounds for Stochastic Learning Algorithms Romain Chor A. Gohari Gaël Richard Umut Simsekli 70 24 0 04 Mar 2022
A General Framework for the Practical Disintegration of PAC-Bayesian Bounds Paul Viallard Pascal Germain Amaury Habrard Emilie Morvant UQCV 80 15 0 17 Feb 2021
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 622 18,036 0 19 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 755 41,932 0 28 May 2020
Reconciling modern machine learning practice and the bias-variance trade-off M. Belkin Daniel J. Hsu Siyuan Ma Soumik Mandal 227 1,647 0 28 Dec 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 84 640 0 14 Feb 2018
Size-Independent Sample Complexity of Neural Networks Noah Golowich Alexander Rakhlin Ohad Shamir 151 547 0 18 Dec 2017
A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks Behnam Neyshabur Srinadh Bhojanapalli Nathan Srebro 80 606 0 29 Jul 2017
Spectrally-normalized margin bounds for neural networks Peter L. Bartlett Dylan J. Foster Matus Telgarsky ODL 202 1,217 0 26 Jun 2017
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 304 12,063 0 19 Jun 2017
Information-theoretic analysis of generalization capability of learning algorithms Aolin Xu Maxim Raginsky 166 446 0 22 May 2017
Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data Gintare Karolina Dziugaite Daniel M. Roy 106 813 0 31 Mar 2017