v1v2 (latest)

Information-theoretic analysis of generalization capability of learning algorithms

22 May 2017

Papers citing "Information-theoretic analysis of generalization capability of learning algorithms"

22 / 22 papers shown

Title
Temperature is All You Need for Generalization in Langevin Dynamics and other Markov Processes I. Harel Yonathan Wolanowsky Gal Vardi Nathan Srebro Daniel Soudry AI4CE 62 0 0 25 May 2025
An Analytical Characterization of Sloppiness in Neural Networks: Insights from Linear Models Jialin Mao Itay Griniasty Yan Sun Mark K. Transtrum James P. Sethna Pratik Chaudhari 101 0 0 13 May 2025
Generalization Guarantees for Representation Learning via Data-Dependent Gaussian Mixture Priors Romain Chor Milad Sefidgaran Piotr Krasnowski 264 2 0 21 Feb 2025
InfoBridge: Mutual Information estimation via Bridge Matching Sergei Kholkin Ivan Butakov Evgeny Burnaev Nikita Gushchin Alexander Korotin DiffM FedML 109 0 0 03 Feb 2025
Understanding Model Ensemble in Transferable Adversarial Attack Wei Yao Zeliang Zhang Huayi Tang Yong Liu 96 3 0 09 Oct 2024
Towards a Theoretical Understanding of Synthetic Data in LLM Post-Training: A Reverse-Bottleneck Perspective Zeyu Gan Yong Liu SyDa 97 6 0 02 Oct 2024
Differentially Private Block-wise Gradient Shuffle for Deep Learning Zilong Zhang FedML 82 0 0 31 Jul 2024
Information-theoretic Generalization Analysis for Expected Calibration Error Futoshi Futami Masahiro Fujisawa UQCV CML 170 4 0 24 May 2024
Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Sets Benjamin Dupuis Paul Viallard George Deligiannidis Umut Simsekli 122 5 0 26 Apr 2024
Information-Theoretic Generalization Bounds for Deep Neural Networks Haiyun He Christina Lee Yu 88 6 0 04 Apr 2024
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 117 0 0 08 Nov 2023
Large Language Models at Work in China's Labor Market Qin Chen Jinfeng Ge Huaqing Xie Xingcheng Xu Yanqing Yang 101 1 0 17 Aug 2023
Global Convergence Rate of Deep Equilibrium Models with General Activations Lan V. Truong 99 2 0 11 Feb 2023
Learning Against Distributional Uncertainty: On the Trade-off Between Robustness and Specificity Shixiong Wang Haowei Wang Xinke Li Jean Honorio OOD 102 2 0 31 Jan 2023
Generalisation under gradient descent via deterministic PAC-Bayes Eugenio Clerico Tyler Farghly George Deligiannidis Benjamin Guedj Arnaud Doucet 97 4 0 06 Sep 2022
On Rademacher Complexity-based Generalization Bounds for Deep Learning Lan V. Truong MLT 91 13 0 08 Aug 2022
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 348 4,635 0 10 Nov 2016
On-Average KL-Privacy and its equivalence to Generalization for Max-Entropy Mechanisms Yu Wang Jing Lei S. Fienberg 51 48 0 08 May 2016
A Minimax Theory for Adaptive Data Analysis Yu Wang Jing Lei S. Fienberg 174 18 0 13 Feb 2016
Algorithmic Stability for Adaptive Data Analysis Raef Bassily Kobbi Nissim Adam D. Smith Thomas Steinke Uri Stemmer Jonathan R. Ullman 104 268 0 08 Nov 2015
Generalization in Adaptive Data Analysis and Holdout Reuse Cynthia Dwork Vitaly Feldman Moritz Hardt T. Pitassi Omer Reingold Aaron Roth 81 231 0 08 Jun 2015
Preserving Statistical Validity in Adaptive Data Analysis Cynthia Dwork Vitaly Feldman Moritz Hardt T. Pitassi Omer Reingold Aaron Roth 97 376 0 10 Nov 2014