Reasoning About Generalization via Conditional Mutual Information

24 January 2020

Papers citing "Reasoning About Generalization via Conditional Mutual Information"

41 / 41 papers shown

Title
Generalization Guarantees for Multi-View Representation Learning and Application to Regularization via Gaussian Product Mixture Prior Milad Sefidgaran Abdellatif Zaidi Piotr Krasnowski 44 0 0 25 Apr 2025
A Causal Adjustment Module for Debiasing Scene Graph Generation Li Liu Shuzhou Sun Shuaifeng Zhi Fan Shi Zhen Liu J. Heikkilä Yongxiang Liu CML 57 2 0 22 Mar 2025
Generalization in Federated Learning: A Conditional Mutual Information Framework Ziqiao Wang Cheng Long Yongyi Mao FedML 52 0 0 06 Mar 2025
Generalization Guarantees for Representation Learning via Data-Dependent Gaussian Mixture Priors Milad Sefidgaran A. Zaidi Piotr Krasnowski 91 1 0 21 Feb 2025
Theoretical Insights into Fine-Tuning Attention Mechanism: Generalization and Optimization Xinhao Yao Hongjin Qian Xiaolin Hu Gengze Xu Wei Liu Jian Luan B. Wang Y. Liu 48 0 0 03 Oct 2024
Information-Theoretic Generalization Bounds for Deep Neural Networks Haiyun He Christina Lee Yu 35 4 0 04 Apr 2024
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 57 1 0 08 Nov 2023
Generalization Guarantees via Algorithm-dependent Rademacher Complexity Sarah Sachs T. Erven Liam Hodgkinson Rajiv Khanna Umut Simsekli 21 3 0 04 Jul 2023
More PAC-Bayes bounds: From bounded losses, to losses with general tail behaviors, to anytime validity Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund 26 9 0 21 Jun 2023
Semantic Communication of Learnable Concepts Francesco Pase S. Kobus Deniz Gunduz M. Zorzi 19 3 0 14 May 2023
Stability is Stable: Connections between Replicability, Privacy, and Adaptive Generalization Mark Bun Marco Gaboardi Max Hopkins R. Impagliazzo Rex Lei T. Pitassi Satchit Sivakumar Jessica Sorrell 28 29 0 22 Mar 2023
Generalization Bounds with Data-dependent Fractal Dimensions Benjamin Dupuis George Deligiannidis Umut cSimcsekli AI4CE 33 12 0 06 Feb 2023
Tighter Information-Theoretic Generalization Bounds from Supersamples Ziqiao Wang Yongyi Mao 29 17 0 05 Feb 2023
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States Ziqiao Wang Yongyi Mao 27 10 0 19 Nov 2022
Information-Theoretic Analysis of Unsupervised Domain Adaptation Ziqiao Wang Yongyi Mao 38 11 0 03 Oct 2022
On Leave-One-Out Conditional Mutual Information For Generalization Mohamad Rida Rammal Alessandro Achille Aditya Golatkar Suhas Diggavi Stefano Soatto VLM 28 5 0 01 Jul 2022
Understanding Generalization via Leave-One-Out Conditional Mutual Information Mahdi Haghifam Shay Moran Daniel M. Roy Gintare Karolina Dziugaite 20 14 0 29 Jun 2022
Benefits of Additive Noise in Composing Classes with Bounded Capacity A. F. Pour H. Ashtiani 24 3 0 14 Jun 2022
Fast Rate Generalization Error Bounds: Variations on a Theme Xuetong Wu J. Manton U. Aickelin Jingge Zhu 22 7 0 06 May 2022
An Information-theoretical Approach to Semi-supervised Learning under Covariate-shift Gholamali Aminian Mahed Abroshan Mohammad Mahdi Khalili Laura Toni M. Rodrigues OOD 18 27 0 24 Feb 2022
Information-Theoretic Analysis of Minimax Excess Risk Hassan Hafez-Kolahi Behrad Moniri S. Kasaei 17 4 0 15 Feb 2022
From Generalisation Error to Transportation-cost Inequalities and Back A. Esposito Michael C. Gastpar 16 7 0 08 Feb 2022
Stability Based Generalization Bounds for Exponential Family Langevin Dynamics A. Banerjee Tiancong Chen Xinyan Li Yingxue Zhou 28 8 0 09 Jan 2022
Towards a Unified Information-Theoretic Framework for Generalization Mahdi Haghifam Gintare Karolina Dziugaite Shay Moran Daniel M. Roy 19 34 0 09 Nov 2021
Information-Theoretic Bayes Risk Lower Bounds for Realizable Models M. Nokleby Ahmad Beirami 57 1 0 08 Nov 2021
User-friendly introduction to PAC-Bayes bounds Pierre Alquier FedML 57 196 0 21 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 37 22 0 07 Oct 2021
Information-Theoretic Characterization of the Generalization Error for Iterative Semi-Supervised Learning Haiyun He Hanshu Yan Vincent Y. F. Tan 31 11 0 03 Oct 2021
Characterizing the Generalization Error of Gibbs Algorithm with Symmetrized KL information Gholamali Aminian Yuheng Bu Laura Toni M. Rodrigues G. Wornell 24 4 0 28 Jul 2021
Attack Transferability Characterization for Adversarially Robust Multi-label Classification Zhuo Yang Yufei Han Xiangliang Zhang AAML 21 4 0 29 Jun 2021
PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate bounds that handle general VC classes Peter Grünwald Thomas Steinke Lydia Zakynthinou 26 29 0 17 Jun 2021
Invariant Information Bottleneck for Domain Generalization Bo-wen Li Yifei Shen Yezhen Wang Wenzhen Zhu Colorado Reed Jun Zhang Dongsheng Li Kurt Keutzer Han Zhao OOD 32 105 0 11 Jun 2021
Minimum Excess Risk in Bayesian Learning Aolin Xu Maxim Raginsky 31 37 0 29 Dec 2020
Individually Conditional Individual Mutual Information Bound on Generalization Error Ruida Zhou C. Tian Tie Liu 13 31 0 17 Dec 2020
Transfer Meta-Learning: Information-Theoretic Bounds and Information Meta-Risk Minimization Sharu Theresa Jose Osvaldo Simeone G. Durisi 21 17 0 04 Nov 2020
On Random Subset Generalization Error Bounds and the Stochastic Gradient Langevin Dynamics Algorithm Borja Rodríguez Gálvez Germán Bassi Ragnar Thobaben Mikael Skoglund 15 32 0 21 Oct 2020
For self-supervised learning, Rationality implies generalization, provably Yamini Bansal Gal Kaplun Boaz Barak OOD SSL 58 22 0 16 Oct 2020
Generalization Bounds via Information Density and Conditional Information Density Fredrik Hellström G. Durisi 24 65 0 16 May 2020
Sharpened Generalization Bounds based on Conditional Mutual Information and an Application to Noisy, Iterative Algorithms Mahdi Haghifam Jeffrey Negrea Ashish Khisti Daniel M. Roy Gintare Karolina Dziugaite 26 105 0 27 Apr 2020
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 110 147 0 06 Nov 2019
Testing Conditional Independence in Supervised Learning Algorithms David S. Watson Marvin N. Wright CML 29 52 0 28 Jan 2019