Generalization Bounds via Information Density and Conditional Information Density

16 May 2020

Papers citing "Generalization Bounds via Information Density and Conditional Information Density"

44 / 44 papers shown

Title
Generalization Error of the Tilted Empirical Risk Gholamali Aminian Amir R. Asadi Tian Li Ahmad Beirami G. Reinert Samuel N. Cohen 21 1 0 28 Sep 2024
An Information-Theoretic Framework for Out-of-Distribution Generalization Wenliang Liu Guanding Yu Lele Wang Renjie Liao 35 2 0 29 Mar 2024
A note on generalization bounds for losses with finite moments Borja Rodríguez Gálvez Omar Rivasplata Ragnar Thobaben Mikael Skoglund 26 0 0 25 Mar 2024
Leveraging PAC-Bayes Theory and Gibbs Distributions for Generalization Bounds with Complexity Measures Paul Viallard Rémi Emonet Amaury Habrard Emilie Morvant Valentina Zantedeschi 36 3 0 19 Feb 2024
PAC-Bayes-Chernoff bounds for unbounded losses Ioar Casado Luis A. Ortega A. Masegosa Aritz Pérez Martínez 24 6 0 02 Jan 2024
Generalization Analysis of Machine Learning Algorithms via the Worst-Case Data-Generating Probability Measure Xinying Zou S. Perlaza I. Esnaola Eitan Altman 22 16 0 19 Dec 2023
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 57 1 0 08 Nov 2023
Comparing Comparators in Generalization Bounds Fredrik Hellström Benjamin Guedj 23 4 0 16 Oct 2023
More PAC-Bayes bounds: From bounded losses, to losses with general tail behaviors, to anytime validity Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund 26 9 0 21 Jun 2023
Online-to-PAC Conversions: Generalization Bounds via Regret Analysis Gábor Lugosi Gergely Neu 23 11 0 31 May 2023
How Does Information Bottleneck Help Deep Learning? Kenji Kawaguchi Zhun Deng Xu Ji Jiaoyang Huang 46 53 0 30 May 2023
A unified framework for information-theoretic generalization bounds Y.-C. Chu Maxim Raginsky 17 14 0 18 May 2023
Exactly Tight Information-Theoretic Generalization Error Bound for the Quadratic Gaussian Problem Ruida Zhou C. Tian Tie Liu 36 3 0 01 May 2023
Generalization Error Bounds for Noisy, Iterative Algorithms via Maximal Leakage Ibrahim Issa A. Esposito Michael C. Gastpar 11 2 0 28 Feb 2023
Tighter Information-Theoretic Generalization Bounds from Supersamples Ziqiao Wang Yongyi Mao 21 17 0 05 Feb 2023
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States Ziqiao Wang Yongyi Mao 21 10 0 19 Nov 2022
Evaluated CMI Bounds for Meta Learning: Tightness and Expressiveness Fredrik Hellström G. Durisi 16 13 0 12 Oct 2022
A New Family of Generalization Bounds Using Samplewise Evaluated CMI Fredrik Hellström G. Durisi 32 22 0 12 Oct 2022
f-divergences and their applications in lossy compression and bounding generalization error Saeed Masiha A. Gohari Mohammad Hossein Yassaee 11 12 0 21 Jun 2022
Formal limitations of sample-wise information-theoretic generalization bounds Hrayr Harutyunyan Greg Ver Steeg Aram Galstyan 19 2 0 13 May 2022
Rate-Distortion Theoretic Generalization Bounds for Stochastic Learning Algorithms Milad Sefidgaran A. Gohari Gaël Richard Umut Simsekli 15 22 0 04 Mar 2022
Chained Generalisation Bounds Eugenio Clerico Amitis Shidani George Deligiannidis Arnaud Doucet AI4CE FedML 17 13 0 02 Mar 2022
Single Trajectory Nonparametric Learning of Nonlinear Dynamics Ingvar M. Ziemann H. Sandberg Nikolai Matni 16 22 0 16 Feb 2022
Information-Theoretic Analysis of Minimax Excess Risk Hassan Hafez-Kolahi Behrad Moniri S. Kasaei 17 4 0 15 Feb 2022
Generalization Bounds via Convex Analysis Gábor Lugosi Gergely Neu 13 29 0 10 Feb 2022
Stability Based Generalization Bounds for Exponential Family Langevin Dynamics A. Banerjee Tiancong Chen Xinyan Li Yingxue Zhou 23 8 0 09 Jan 2022
Towards a Unified Information-Theoretic Framework for Generalization Mahdi Haghifam Gintare Karolina Dziugaite Shay Moran Daniel M. Roy 17 34 0 09 Nov 2021
User-friendly introduction to PAC-Bayes bounds Pierre Alquier FedML 48 196 0 21 Oct 2021
PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate bounds that handle general VC classes Peter Grünwald Thomas Steinke Lydia Zakynthinou 21 29 0 17 Jun 2021
Information Complexity and Generalization Bounds P. Banerjee Guido Montúfar 13 14 0 04 May 2021
Generalization Bounds for Noisy Iterative Algorithms Using Properties of Additive Noise Channels Hao Wang Rui Gao Flavio du Pin Calmon 17 15 0 05 Feb 2021
Information-Theoretic Bounds on the Moments of the Generalization Error of Learning Algorithms Gholamali Aminian Laura Toni M. Rodrigues 62 16 0 03 Feb 2021
Tighter expected generalization error bounds via Wasserstein distance Borja Rodríguez Gálvez Germán Bassi Ragnar Thobaben Mikael Skoglund 13 45 0 22 Jan 2021
An Information-Theoretic Analysis of the Impact of Task Similarity on Meta-Learning Sharu Theresa Jose Osvaldo Simeone 14 11 0 21 Jan 2021
Recent advances in deep learning theory Fengxiang He Dacheng Tao AI4CE 13 50 0 20 Dec 2020
Transfer Meta-Learning: Information-Theoretic Bounds and Information Meta-Risk Minimization Sharu Theresa Jose Osvaldo Simeone G. Durisi 21 17 0 04 Nov 2020
Fast-Rate Loss Bounds via Conditional Information Measures with Applications to Neural Networks Fredrik Hellström G. Durisi 43 2 0 22 Oct 2020
On Random Subset Generalization Error Bounds and the Stochastic Gradient Langevin Dynamics Algorithm Borja Rodríguez Gálvez Germán Bassi Ragnar Thobaben Mikael Skoglund 13 32 0 21 Oct 2020
Conditional Mutual Information-Based Generalization Bound for Meta Learning A. Rezazadeh Sharu Theresa Jose G. Durisi Osvaldo Simeone 11 1 0 21 Oct 2020
Information-Theoretic Bounds on Transfer Generalization Gap Based on Jensen-Shannon Divergence Sharu Theresa Jose Osvaldo Simeone 46 16 0 13 Oct 2020
Upper Bounds on the Generalization Error of Private Algorithms for Discrete Data Borja Rodríguez Gálvez Germán Bassi Mikael Skoglund 11 4 0 12 May 2020
Reasoning About Generalization via Conditional Mutual Information Thomas Steinke Lydia Zakynthinou 13 159 0 24 Jan 2020
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 110 146 0 06 Nov 2019
Pac-Bayesian Supervised Classification: The Thermodynamics of Statistical Learning O. Catoni 148 453 0 03 Dec 2007