Towards a Unified Information-Theoretic Framework for Generalization

9 November 2021

Mahdi Haghifam

Gintare Karolina Dziugaite

Shay Moran

Daniel M. Roy

ArXiv PDF HTML

Papers citing "Towards a Unified Information-Theoretic Framework for Generalization"

24 / 24 papers shown

Title
Generalization Guarantees for Multi-View Representation Learning and Application to Regularization via Gaussian Product Mixture Prior Milad Sefidgaran Abdellatif Zaidi Piotr Krasnowski 46 0 0 25 Apr 2025
Generalization Guarantees for Representation Learning via Data-Dependent Gaussian Mixture Priors Milad Sefidgaran A. Zaidi Piotr Krasnowski 91 1 0 21 Feb 2025
Mathematical Formalism for Memory Compression in Selective State Space Models Siddhanth Bhat 28 1 0 04 Oct 2024
Information Complexity of Stochastic Convex Optimization: Applications to Generalization and Memorization Idan Attias Gintare Karolina Dziugaite Mahdi Haghifam Roi Livni Daniel M. Roy 30 6 0 14 Feb 2024
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 62 1 0 08 Nov 2023
Sample-Conditioned Hypothesis Stability Sharpens Information-Theoretic Generalization Bounds Ziqiao Wang Yongyi Mao 37 5 0 31 Oct 2023
Two Phases of Scaling Laws for Nearest Neighbor Classifiers Pengkun Yang Junzhe Zhang 26 0 0 16 Aug 2023
Local Risk Bounds for Statistical Aggregation Jaouad Mourtada Tomas Vavskevivcius Nikita Zhivotovskiy 27 1 0 29 Jun 2023
More PAC-Bayes bounds: From bounded losses, to losses with general tail behaviors, to anytime validity Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund 28 9 0 21 Jun 2023
Online-to-PAC Conversions: Generalization Bounds via Regret Analysis Gábor Lugosi Gergely Neu 35 11 0 31 May 2023
A unified framework for information-theoretic generalization bounds Y.-C. Chu Maxim Raginsky 30 14 0 18 May 2023
Mathematical Challenges in Deep Learning V. Nia Guojun Zhang I. Kobyzev Michael R. Metel Xinlin Li ... S. Hemati M. Asgharian Linglong Kong Wulong Liu Boxing Chen AI4CE VLM 37 1 0 24 Mar 2023
Bayes meets Bernstein at the Meta Level: an Analysis of Fast Rates in Meta-Learning with PAC-Bayes Charles Riou Pierre Alquier Badr-Eddine Chérief-Abdellatif 43 8 0 23 Feb 2023
Tighter Information-Theoretic Generalization Bounds from Supersamples Ziqiao Wang Yongyi Mao 32 17 0 05 Feb 2023
Limitations of Information-Theoretic Generalization Bounds for Gradient Descent Methods in Stochastic Convex Optimization Mahdi Haghifam Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund Daniel M. Roy Gintare Karolina Dziugaite 31 17 0 27 Dec 2022
Data Models for Dataset Drift Controls in Machine Learning With Optical Images Luis Oala Marco Aversa Gabriel Nobis Kurt Willis Yoan Neuenschwander ... E. Pomarico Wojciech Samek Roderick Murray-Smith Christoph Clausen B. Sanguinetti 28 5 0 04 Nov 2022
A New Family of Generalization Bounds Using Samplewise Evaluated CMI Fredrik Hellström G. Durisi 43 23 0 12 Oct 2022
Understanding Generalization via Leave-One-Out Conditional Mutual Information Mahdi Haghifam Shay Moran Daniel M. Roy Gintare Karolina Dziugaite 28 14 0 29 Jun 2022
Max-Margin Works while Large Margin Fails: Generalization without Uniform Convergence Margalit Glasgow Colin Wei Mary Wootters Tengyu Ma 38 5 0 16 Jun 2022
Rate-Distortion Theoretic Bounds on Generalization Error for Distributed Learning Milad Sefidgaran Romain Chor A. Zaidi FedML 37 15 0 06 Jun 2022
Rate-Distortion Theoretic Generalization Bounds for Stochastic Learning Algorithms Milad Sefidgaran A. Gohari Gaël Richard Umut Simsekli 25 23 0 04 Mar 2022
Black-Box Generalization: Stability of Zeroth-Order Learning Konstantinos E. Nikolakakis Farzin Haddadpour Dionysios S. Kalogerias Amin Karbasi MLT 24 2 0 14 Feb 2022
Generalization Bounds via Convex Analysis Gábor Lugosi Gergely Neu 21 29 0 10 Feb 2022
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 113 147 0 06 Nov 2019