v1v2 (latest)

Generalization in Federated Learning: A Conditional Mutual Information Framework

6 March 2025

Papers citing "Generalization in Federated Learning: A Conditional Mutual Information Framework"

37 / 37 papers shown

Title
Heterogeneity Matters even More in Distributed Learning: Study from Generalization Perspective Masoud Kavian Romain Chor Milad Sefidgaran Abdellatif Zaidi FedML 93 1 0 03 Mar 2025
A Unified Analysis of Federated Learning with Arbitrary Client Participation Shiqiang Wang Mingyue Ji FedML 112 58 0 31 Dec 2024
Non-IID data in Federated Learning: A Survey with Taxonomy, Metrics, Methods, Frameworks and Future Directions Daniel Gutiérrez David Solans Mikko A. Heikkilä A. Vitaletti Nicolas Kourtellis Aris Anagnostopoulos I. Chatzigiannakis OOD 147 0 0 19 Nov 2024
Generalization Bounds via Conditional $f$ -Information Ziqiao Wang Yongyi Mao FedML 121 1 0 30 Oct 2024
Improved Generalization Bounds for Communication Efficient Federated Learning Peyman Gholami H. Seferoglu FedML AI4CE 53 6 0 17 Apr 2024
Sample-Conditioned Hypothesis Stability Sharpens Information-Theoretic Generalization Bounds Ziqiao Wang Yongyi Mao 70 7 0 31 Oct 2023
Comparing Comparators in Generalization Bounds Fredrik Hellström Benjamin Guedj 57 4 0 16 Oct 2023
Stochastic Controlled Averaging for Federated Learning with Communication Compression Xinmeng Huang Ping Li Xiaoyun Li 96 209 0 16 Aug 2023
Lessons from Generalization Error Analysis of Federated Learning: You May Communicate Less Often! Romain Chor Abdellatif Zaidi Milad Sefidgaran Yijun Wan FedML 57 7 0 09 Jun 2023
Understanding Generalization of Federated Learning via Stability: Heterogeneity Matters Zhenyu Sun Xiaochun Niu Ermin Wei FedML MLT 53 22 0 06 Jun 2023
More Communication Does Not Result in Smaller Generalization Error in Federated Learning Abdellatif Zaidi Romain Chor Milad Sefidgaran FedML AI4CE 63 10 0 24 Apr 2023
Tighter Information-Theoretic Generalization Bounds from Supersamples Ziqiao Wang Yongyi Mao 79 19 0 05 Feb 2023
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States Ziqiao Wang Yongyi Mao 71 12 0 19 Nov 2022
Evaluated CMI Bounds for Meta Learning: Tightness and Expressiveness Fredrik Hellström G. Durisi 61 13 0 12 Oct 2022
A New Family of Generalization Bounds Using Samplewise Evaluated CMI Fredrik Hellström G. Durisi 83 26 0 12 Oct 2022
Information-Theoretic Analysis of Unsupervised Domain Adaptation Ziqiao Wang Yongyi Mao 88 11 0 03 Oct 2022
Rate-Distortion Theoretic Bounds on Generalization Error for Distributed Learning Romain Chor Abdellatif Zaidi Milad Sefidgaran FedML 74 15 0 06 Jun 2022
What Do We Mean by Generalization in Federated Learning? Honglin Yuan Warren Morningstar Lin Ning K. Singhal OOD FedML 65 75 0 27 Oct 2021
Minibatch vs Local SGD with Shuffling: Tight Convergence Bounds and Beyond Chulhee Yun Shashank Rajput S. Sra FedML 61 42 0 20 Oct 2021
Information-theoretic generalization bounds for black-box learning algorithms Hrayr Harutyunyan Maxim Raginsky Greg Ver Steeg Aram Galstyan 106 44 0 04 Oct 2021
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients A. Mitra Rayana H. Jaafar George J. Pappas Hamed Hassani FedML 101 160 0 14 Feb 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 670 41,430 0 22 Oct 2020
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization Jianyu Wang Qinghua Liu Hao Liang Gauri Joshi H. Vincent Poor MoMe FedML 68 1,345 0 15 Jul 2020
Information-Theoretic Bounds on the Generalization Error and Privacy Leakage in Federated Learning Semih Yagli Alex Dytso H. Vincent Poor FedML 51 33 0 05 May 2020
Sharpened Generalization Bounds based on Conditional Mutual Information and an Application to Noisy, Iterative Algorithms Mahdi Haghifam Jeffrey Negrea Ashish Khisti Daniel M. Roy Gintare Karolina Dziugaite 163 107 0 27 Apr 2020
Adaptive Federated Optimization Sashank J. Reddi Zachary B. Charles Manzil Zaheer Zachary Garrett Keith Rush Jakub Konecný Sanjiv Kumar H. B. McMahan FedML 179 1,452 0 29 Feb 2020
Reasoning About Generalization via Conditional Mutual Information Thomas Steinke Lydia Zakynthinou 150 166 0 24 Jan 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 259 6,276 0 10 Dec 2019
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 172 153 0 06 Nov 2019
Agnostic Federated Learning M. Mohri Gary Sivek A. Suresh FedML 136 937 0 01 Feb 2019
Tightening Mutual Information Based Bounds on Generalization Error Yuheng Bu Shaofeng Zou Venugopal V. Veeravalli 58 177 0 15 Jan 2019
Federated Optimization in Heterogeneous Networks Tian Li Anit Kumar Sahu Manzil Zaheer Maziar Sanjabi Ameet Talwalkar Virginia Smith FedML 180 5,220 0 14 Dec 2018
Information-theoretic analysis of generalization capability of learning algorithms Aolin Xu Maxim Raginsky 176 447 0 22 May 2017
Differential Privacy as a Mutual Information Constraint P. Cuff Lanqing Yu 41 204 0 12 Aug 2016
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 406 17,559 0 17 Feb 2016
How much does your data exploration overfit? Controlling bias via information usage D. Russo James Zou 52 192 0 16 Nov 2015
The Composition Theorem for Differential Privacy Peter Kairouz Sewoong Oh Pramod Viswanath 123 683 0 04 Nov 2013