Tightening Mutual Information Based Bounds on Generalization Error

15 January 2019

Papers citing "Tightening Mutual Information Based Bounds on Generalization Error"

46 / 46 papers shown

Title
Generalization Bounds for Quantum Learning via Rényi Divergences Naqueeb Ahmad Warsi Ayanava Dasgupta Masahito Hayashi 17 0 0 16 May 2025
Generalization Guarantees for Multi-View Representation Learning and Application to Regularization via Gaussian Product Mixture Prior Romain Chor Abdellatif Zaidi Piotr Krasnowski 49 0 0 25 Apr 2025
Generalization in Federated Learning: A Conditional Mutual Information Framework Ziqiao Wang Cheng Long Yongyi Mao FedML 54 1 0 06 Mar 2025
Generalization Guarantees for Representation Learning via Data-Dependent Gaussian Mixture Priors Romain Chor Milad Sefidgaran Piotr Krasnowski 93 1 0 21 Feb 2025
Understanding the Generalization Error of Markov algorithms through Poissonization Benjamin Dupuis Maxime Haddouche George Deligiannidis Umut Simsekli 49 0 0 11 Feb 2025
Understanding the Capabilities and Limitations of Weak-to-Strong Generalization Wei Yao Wenkai Yang Zihan Wang Yankai Lin Yong Liu ELM 107 1 0 03 Feb 2025
Information-Theoretic Generalization Bounds for Deep Neural Networks Haiyun He Christina Lee Yu 38 5 0 04 Apr 2024
Leveraging PAC-Bayes Theory and Gibbs Distributions for Generalization Bounds with Complexity Measures Paul Viallard Rémi Emonet Amaury Habrard Emilie Morvant Valentina Zantedeschi 39 3 0 19 Feb 2024
Generalization Analysis of Machine Learning Algorithms via the Worst-Case Data-Generating Probability Measure Xinying Zou S. Perlaza I. Esnaola Eitan Altman 29 16 0 19 Dec 2023
Adaptive Differentially Quantized Subspace Perturbation (ADQSP): A Unified Framework for Privacy-Preserving Distributed Average Consensus Qiongxiu Li Jaron Skovsted Gundersen Milan Lopuhaä-Zwakenberg Richard Heusdens 23 11 0 13 Dec 2023
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 62 1 0 08 Nov 2023
More PAC-Bayes bounds: From bounded losses, to losses with general tail behaviors, to anytime validity Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund 28 9 0 21 Jun 2023
On the Generalization of Diffusion Model Mingyang Yi Jiacheng Sun Zhenguo Li 30 18 0 24 May 2023
Information Theoretic Lower Bounds for Information Theoretic Upper Bounds Roi Livni 21 14 0 09 Feb 2023
Tighter Information-Theoretic Generalization Bounds from Supersamples Ziqiao Wang Yongyi Mao 32 17 0 05 Feb 2023
Feasibility and Transferability of Transfer Learning: A Mathematical Framework Haoyang Cao Haotian Gu Xin Guo M. Rosenbaum 36 2 0 27 Jan 2023
An Entropy-Based Model for Hierarchical Learning Amir-Reza Asadi 41 1 0 30 Dec 2022
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States Ziqiao Wang Yongyi Mao 30 10 0 19 Nov 2022
Over-the-Air Split Machine Learning in Wireless MIMO Networks YuZhi Yang Zhaoyang Zhang Yuqing Tian Zhaohui Yang Chongwen Huang C. Zhong Kai‐Kit Wong 26 23 0 07 Oct 2022
Information-Theoretic Analysis of Unsupervised Domain Adaptation Ziqiao Wang Yongyi Mao 38 12 0 03 Oct 2022
On Leave-One-Out Conditional Mutual Information For Generalization Mohamad Rida Rammal Alessandro Achille Aditya Golatkar Suhas Diggavi Stefano Soatto VLM 33 5 0 01 Jul 2022
Understanding Generalization via Leave-One-Out Conditional Mutual Information Mahdi Haghifam Shay Moran Daniel M. Roy Gintare Karolina Dziugaite 28 14 0 29 Jun 2022
Finite Littlestone Dimension Implies Finite Information Complexity Aditya Pradeep Ido Nachum Michael C. Gastpar 24 7 0 27 Jun 2022
A General framework for PAC-Bayes Bounds for Meta-Learning A. Rezazadeh AI4CE 26 4 0 11 Jun 2022
Fast Rate Generalization Error Bounds: Variations on a Theme Xuetong Wu J. Manton U. Aickelin Jingge Zhu 30 7 0 06 May 2022
Rate-Distortion Theoretic Generalization Bounds for Stochastic Learning Algorithms Romain Chor A. Gohari Gaël Richard Umut Simsekli 25 23 0 04 Mar 2022
Tighter Expected Generalization Error Bounds via Convexity of Information Measures Gholamali Aminian Yuheng Bu G. Wornell Miguel R. D. Rodrigues 11 22 0 24 Feb 2022
An Information-theoretical Approach to Semi-supervised Learning under Covariate-shift Gholamali Aminian Mahed Abroshan Mohammad Mahdi Khalili Laura Toni M. Rodrigues OOD 31 27 0 24 Feb 2022
Information-Theoretic Analysis of Minimax Excess Risk Hassan Hafez-Kolahi Behrad Moniri S. Kasaei 17 4 0 15 Feb 2022
From Generalisation Error to Transportation-cost Inequalities and Back A. Esposito Michael C. Gastpar 34 7 0 08 Feb 2022
Stability Based Generalization Bounds for Exponential Family Langevin Dynamics A. Banerjee Tiancong Chen Xinyan Li Yingxue Zhou 34 8 0 09 Jan 2022
Towards a Unified Information-Theoretic Framework for Generalization Mahdi Haghifam Gintare Karolina Dziugaite Shay Moran Daniel M. Roy 27 34 0 09 Nov 2021
User-friendly introduction to PAC-Bayes bounds Pierre Alquier FedML 64 197 0 21 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 37 22 0 07 Oct 2021
Information-Theoretic Characterization of the Generalization Error for Iterative Semi-Supervised Learning Haiyun He Hanshu Yan Vincent Y. F. Tan 34 11 0 03 Oct 2021
Generalization Bounds For Meta-Learning: An Information-Theoretic Analysis Qi Chen Changjian Shui M. Marchand 40 43 0 29 Sep 2021
Characterizing the Generalization Error of Gibbs Algorithm with Symmetrized KL information Gholamali Aminian Yuheng Bu Laura Toni M. Rodrigues G. Wornell 30 4 0 28 Jul 2021
Individually Conditional Individual Mutual Information Bound on Generalization Error Ruida Zhou C. Tian Tie Liu 13 31 0 17 Dec 2020
Transfer Meta-Learning: Information-Theoretic Bounds and Information Meta-Risk Minimization Sharu Theresa Jose Osvaldo Simeone G. Durisi 24 17 0 04 Nov 2020
Jensen-Shannon Information Based Characterization of the Generalization Error of Learning Algorithms Gholamali Aminian Laura Toni M. Rodrigues 14 29 0 23 Oct 2020
On Random Subset Generalization Error Bounds and the Stochastic Gradient Langevin Dynamics Algorithm Borja Rodríguez Gálvez Germán Bassi Ragnar Thobaben Mikael Skoglund 31 32 0 21 Oct 2020
Generalization Bounds via Information Density and Conditional Information Density Fredrik Hellström G. Durisi 27 65 0 16 May 2020
Sharpened Generalization Bounds based on Conditional Mutual Information and an Application to Noisy, Iterative Algorithms Mahdi Haghifam Jeffrey Negrea Ashish Khisti Daniel M. Roy Gintare Karolina Dziugaite 34 105 0 27 Apr 2020
Reasoning About Generalization via Conditional Mutual Information Thomas Steinke Lydia Zakynthinou 23 159 0 24 Jan 2020
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 115 147 0 06 Nov 2019
Chaining Meets Chain Rule: Multilevel Entropic Regularization and Training of Neural Nets Amir-Reza Asadi Emmanuel Abbe BDL AI4CE 36 13 0 26 Jun 2019