Information-theoretic analysis of generalization capability of learning algorithms

22 May 2017

Papers citing "Information-theoretic analysis of generalization capability of learning algorithms"

22 / 22 papers shown

Title
Temperature is All You Need for Generalization in Langevin Dynamics and other Markov Processes I. Harel Yonathan Wolanowsky Gal Vardi Nathan Srebro Daniel Soudry AI4CE 32 0 0 25 May 2025
An Analytical Characterization of Sloppiness in Neural Networks: Insights from Linear Models Jialin Mao Itay Griniasty Yan Sun Mark K. Transtrum James P. Sethna Pratik Chaudhari 71 0 0 13 May 2025
Generalization Guarantees for Representation Learning via Data-Dependent Gaussian Mixture Priors Romain Chor Milad Sefidgaran Piotr Krasnowski 163 2 0 21 Feb 2025
InfoBridge: Mutual Information estimation via Bridge Matching Sergei Kholkin Ivan Butakov Evgeny Burnaev Nikita Gushchin Alexander Korotin DiffM FedML 89 0 0 03 Feb 2025
Understanding Model Ensemble in Transferable Adversarial Attack Wei Yao Zeliang Zhang Huayi Tang Yong Liu 53 3 0 09 Oct 2024
Towards a Theoretical Understanding of Synthetic Data in LLM Post-Training: A Reverse-Bottleneck Perspective Zeyu Gan Yong Liu SyDa 55 2 0 02 Oct 2024
Differentially Private Block-wise Gradient Shuffle for Deep Learning Zilong Zhang FedML 57 0 0 31 Jul 2024
Information-theoretic Generalization Analysis for Expected Calibration Error Futoshi Futami Masahiro Fujisawa UQCV CML 94 3 0 24 May 2024
Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Sets Benjamin Dupuis Paul Viallard George Deligiannidis Umut Simsekli 74 3 0 26 Apr 2024
Information-Theoretic Generalization Bounds for Deep Neural Networks Haiyun He Christina Lee Yu 75 5 0 04 Apr 2024
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 83 1 0 08 Nov 2023
Large Language Models at Work in China's Labor Market Qin Chen Jinfeng Ge Huaqing Xie Xingcheng Xu Yanqing Yang 64 1 0 17 Aug 2023
Global Convergence Rate of Deep Equilibrium Models with General Activations Lan V. Truong 53 2 0 11 Feb 2023
Learning Against Distributional Uncertainty: On the Trade-off Between Robustness and Specificity Shixiong Wang Haowei Wang Xinke Li Jean Honorio OOD 75 1 0 31 Jan 2023
Generalisation under gradient descent via deterministic PAC-Bayes Eugenio Clerico Tyler Farghly George Deligiannidis Benjamin Guedj Arnaud Doucet 50 4 0 06 Sep 2022
On Rademacher Complexity-based Generalization Bounds for Deep Learning Lan V. Truong MLT 55 13 0 08 Aug 2022
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 250 4,612 0 10 Nov 2016
On-Average KL-Privacy and its equivalence to Generalization for Max-Entropy Mechanisms Yu Wang Jing Lei S. Fienberg 34 48 0 08 May 2016
A Minimax Theory for Adaptive Data Analysis Yu Wang Jing Lei S. Fienberg 103 18 0 13 Feb 2016
Algorithmic Stability for Adaptive Data Analysis Raef Bassily Kobbi Nissim Adam D. Smith Thomas Steinke Uri Stemmer Jonathan R. Ullman 68 267 0 08 Nov 2015
Generalization in Adaptive Data Analysis and Holdout Reuse Cynthia Dwork Vitaly Feldman Moritz Hardt T. Pitassi Omer Reingold Aaron Roth 43 229 0 08 Jun 2015
Preserving Statistical Validity in Adaptive Data Analysis Cynthia Dwork Vitaly Feldman Moritz Hardt T. Pitassi Omer Reingold Aaron Roth 44 375 0 10 Nov 2014