Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach

16 April 2018

Papers citing "Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach"

50 / 155 papers shown

Title
Split-kl and PAC-Bayes-split-kl Inequalities for Ternary Random Variables Yi-Shan Wu Yevgeny Seldin 16 12 0 01 Jun 2022
Generalization Bounds for Gradient Methods via Discrete and Continuous Prior Jun Yu Li Xu Luo Jian Li 27 4 0 27 May 2022
Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models Clara Na Sanket Vaibhav Mehta Emma Strubell 64 19 0 25 May 2022
Higher-Order Generalization Bounds: Learning Deep Probabilistic Programs via PAC-Bayes Objectives J. Warrell M. Gerstein GP 19 1 0 30 Mar 2022
On the Generalization Mystery in Deep Learning S. Chatterjee Piotr Zielinski OOD 20 33 0 18 Mar 2022
Approximability and Generalisation A. J. Turner Ata Kabán 33 0 0 15 Mar 2022
Adversarial robustness of sparse local Lipschitz predictors Ramchandran Muthukumar Jeremias Sulam AAML 32 13 0 26 Feb 2022
Bayesian Model Selection, the Marginal Likelihood, and Generalization Sanae Lotfi Pavel Izmailov Gregory W. Benton Micah Goldblum A. Wilson UQCV BDL 52 56 0 23 Feb 2022
From Optimization Dynamics to Generalization Bounds via Łojasiewicz Gradient Inequality Fusheng Liu Haizhao Yang Soufiane Hayou Qianxiao Li AI4CE 18 2 0 22 Feb 2022
On change of measure inequalities for $f$ -divergences Antoine Picard-Weibel Benjamin Guedj 27 13 0 11 Feb 2022
Controlling Multiple Errors Simultaneously with a PAC-Bayes Bound Reuben Adams John Shawe-Taylor Benjamin Guedj 22 2 0 11 Feb 2022
Deep Networks on Toroids: Removing Symmetries Reveals the Structure of Flat Regions in the Landscape Geometry Fabrizio Pittorino Antonio Ferraro Gabriele Perugini Christoph Feinauer Carlo Baldassi R. Zecchina 204 24 0 07 Feb 2022
Demystify Optimization and Generalization of Over-parameterized PAC-Bayesian Learning Wei Huang Chunrui Liu Yilan Chen Tianyu Liu R. Xu BDL MLT 19 2 0 04 Feb 2022
Non-Vacuous Generalisation Bounds for Shallow Neural Networks Felix Biggs Benjamin Guedj BDL 30 26 0 03 Feb 2022
Fortuitous Forgetting in Connectionist Networks Hattie Zhou Ankit Vani Hugo Larochelle Aaron Courville CLL 16 42 0 01 Feb 2022
Leveraging Unlabeled Data to Predict Out-of-Distribution Performance Saurabh Garg Sivaraman Balakrishnan Zachary Chase Lipton Behnam Neyshabur Hanie Sedghi OODD OOD 47 125 0 11 Jan 2022
Generalization Error Bounds on Deep Learning with Markov Datasets Lan V. Truong 29 8 0 23 Dec 2021
Risk bounds for aggregated shallow neural networks using Gaussian prior L. Tinsi A. Dalalyan BDL 20 7 0 21 Dec 2021
PACMAN: PAC-style bounds accounting for the Mismatch between Accuracy and Negative log-loss Matías Vera L. Rey Vega Pablo Piantanida 23 0 0 10 Dec 2021
On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons Fangshuo Liao Anastasios Kyrillidis 41 16 0 05 Dec 2021
Improved Regularization and Robustness for Fine-tuning in Neural Networks Dongyue Li Hongyang R. Zhang NoLa 55 54 0 08 Nov 2021
PAC-Bayesian Learning of Aggregated Binary Activated Neural Networks with Probabilities over Representations Louis Fortier-Dubois Gaël Letarte Benjamin Leblanc Franccois Laviolette Pascal Germain UQCV 17 0 0 28 Oct 2021
Does the Data Induce Capacity Control in Deep Learning? Rubing Yang Jialin Mao Pratik Chaudhari 33 15 0 27 Oct 2021
Optimizing Information-theoretical Generalization Bounds via Anisotropic Noise in SGLD Bohan Wang Huishuai Zhang Jieyu Zhang Qi Meng Wei Chen Tie-Yan Liu 6 1 0 26 Oct 2021
Conditionally Gaussian PAC-Bayes Eugenio Clerico George Deligiannidis Arnaud Doucet 37 10 0 22 Oct 2021
User-friendly introduction to PAC-Bayes bounds Pierre Alquier FedML 60 196 0 21 Oct 2021
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks Shuai Zhang Meng Wang Sijia Liu Pin-Yu Chen Jinjun Xiong UQCV MLT 31 13 0 12 Oct 2021
On Margins and Derandomisation in PAC-Bayes Felix Biggs Benjamin Guedj 28 20 0 08 Jul 2021
Subgroup Generalization and Fairness of Graph Neural Networks Jiaqi Ma Junwei Deng Qiaozhu Mei 24 80 0 29 Jun 2021
Wide stochastic networks: Gaussian limit and PAC-Bayesian training Eugenio Clerico George Deligiannidis Arnaud Doucet 25 11 0 17 Jun 2021
PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate bounds that handle general VC classes Peter Grünwald Thomas Steinke Lydia Zakynthinou 28 29 0 17 Jun 2021
Compression Implies Generalization Allan Grønlund M. Hogsgaard Lior Kamma Kasper Green Larsen MLT AI4CE 9 0 0 15 Jun 2021
Towards Understanding Generalization via Decomposing Excess Risk Dynamics Jiaye Teng Jianhao Ma Yang Yuan 29 4 0 11 Jun 2021
The Randomness of Input Data Spaces is an A Priori Predictor for Generalization Martin Briesch Dominik Sobania Franz Rothlauf UQCV 27 1 0 08 Jun 2021
How Tight Can PAC-Bayes be in the Small Data Regime? Andrew Y. K. Foong W. Bruinsma David R. Burt Richard Turner 19 20 0 07 Jun 2021
A Probabilistic Approach to Neural Network Pruning Xin-Yao Qian Diego Klabjan 29 16 0 20 May 2021
Uniform Convergence, Adversarial Spheres and a Simple Remedy Gregor Bachmann Seyed-Mohsen Moosavi-Dezfooli Thomas Hofmann AAML 9 8 0 07 May 2021
A Theoretical-Empirical Approach to Estimating Sample Complexity of DNNs Devansh Bisla Apoorva Nandini Saridena A. Choromańska 28 8 0 05 May 2021
RATT: Leveraging Unlabeled Data to Guarantee Generalization Saurabh Garg Sivaraman Balakrishnan J. Zico Kolter Zachary Chase Lipton 28 30 0 01 May 2021
Robustness to Pruning Predicts Generalization in Deep Neural Networks Lorenz Kuhn Clare Lyle Aidan Gomez Jonas Rothfuss Y. Gal 38 14 0 10 Mar 2021
Scaling Up Exact Neural Network Compression by ReLU Stability Thiago Serra Xin Yu Abhinav Kumar Srikumar Ramalingam 16 24 0 15 Feb 2021
Neural Network Compression for Noisy Storage Devices Berivan Isik Kristy Choi Xin-Yang Zheng Tsachy Weissman Stefano Ermon H. P. Wong Armin Alaghi 28 13 0 15 Feb 2021
Generalization Bounds for Meta-Learning via PAC-Bayes and Uniform Stability Alec Farid Anirudha Majumdar 27 34 0 12 Feb 2021
Dimension Free Generalization Bounds for Non Linear Metric Learning Mark Kozdoba Shie Mannor 6 0 0 07 Feb 2021
PAC-Bayes Bounds for Meta-learning with Data-Dependent Prior Tianyu Liu Jie Lu Zheng Yan Guangquan Zhang 16 12 0 07 Feb 2021
Notes on Deep Learning Theory Eugene Golikov VLM AI4CE 11 2 0 10 Dec 2020
Semantically Robust Unpaired Image Translation for Data with Unmatched Semantics Statistics Zhiwei Jia Bodi Yuan Kangkang Wang Hong Wu David Clifford Zhiqiang Yuan Hao Su VLM 44 21 0 09 Dec 2020
Generalization bounds for deep learning Guillermo Valle Pérez A. Louis BDL 13 44 0 07 Dec 2020
Risk-Monotonicity in Statistical Learning Zakaria Mhammedi 30 7 0 28 Nov 2020
Fast-Rate Loss Bounds via Conditional Information Measures with Applications to Neural Networks Fredrik Hellström G. Durisi 51 2 0 22 Oct 2020