Stochastic Controlled Averaging for Federated Learning with Communication Compression

16 August 2023

Papers citing "Stochastic Controlled Averaging for Federated Learning with Communication Compression"

50 / 57 papers shown

Title
Trial and Trust: Addressing Byzantine Attacks with Comprehensive Defense Strategy Gleb Molodtsov Daniil Medyakov Sergey Skorik Nikolas Khachaturov Shahane Tigranyan Vladimir Aletov A. Avetisyan Martin Takáč Aleksandr Beznosikov AAML 35 0 0 12 May 2025
Hubs and Spokes Learning: Efficient and Scalable Collaborative Machine Learning Atul Sharma Kavindu Herath Saurabh Bagchi Chaoyue Liu Somali Chaterji FedML 42 0 0 29 Apr 2025
Convergence Analysis of Asynchronous Federated Learning with Gradient Compression for Non-Convex Optimization Diying Yang Yingwei Hou Danyang Xiao Weigang Wu FedML 39 0 0 28 Apr 2025
Generalization in Federated Learning: A Conditional Mutual Information Framework Ziqiao Wang Cheng Long Yongyi Mao FedML 52 0 0 06 Mar 2025
Provably Near-Optimal Federated Ensemble Distillation with Negligible Overhead Won-Jun Jang Hyeon-Seo Park Si-Hyeon Lee FedML 178 0 0 10 Feb 2025
Revisiting LocalSGD and SCAFFOLD: Improved Rates and Missing Analysis Ruichen Luo Sebastian U Stich Samuel Horváth Martin Takáč 38 0 0 08 Jan 2025
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 38 0 0 25 Oct 2024
Buffer-based Gradient Projection for Continual Federated Learning Shenghong Dai Jy-yong Sohn Yicong Chen S. Alam Ravikumar Balakrishnan Suman Banerjee N. Himayat Kangwook Lee FedML 75 2 0 03 Sep 2024
A New Theoretical Perspective on Data Heterogeneity in Federated Optimization Jiayi Wang Shiqiang Wang Rong-Rong Chen Mingyue Ji FedML 30 1 0 22 Jul 2024
Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization Zhe Li Bicheng Ying Zidong Liu Haibo Yang Haibo Yang FedML 59 3 0 24 May 2024
Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors Chun-Yin Huang Kartik Srinivas Xin Zhang Xiaoxiao Li DD 58 6 0 19 May 2024
Distributed Event-Based Learning via ADMM Güner Dilsad Er Sebastian Trimpe Michael Muehlebach FedML 44 2 0 17 May 2024
LoCoDL: Communication-Efficient Distributed Learning with Local Training and Compression Laurent Condat A. Maranjyan Peter Richtárik 39 3 0 07 Mar 2024
Flashback: Understanding and Mitigating Forgetting in Federated Learning Mohammed Aljahdali A. Abdelmoniem Marco Canini Samuel Horváth 31 2 0 08 Feb 2024
FBChain: A Blockchain-based Federated Learning Model with Efficiency and Secure Communication Yang Li Chunhe Xia Wei Liu 35 0 0 21 Nov 2023
Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregation Tomàs Ortega Hamid Jafarkhani FedML 28 6 0 01 Aug 2023
Privacy-Preserving Graph Machine Learning from Data to Computation: A Survey Dongqi Fu Wenxuan Bao Ross Maciejewski Hanghang Tong Jingrui He 33 9 0 10 Jul 2023
Personalized Federated Learning via Amortized Bayesian Meta-Learning Shiyu Liu Shaogao Lv Dun Zeng Zenglin Xu Hongya Wang Yue Yu FedML 28 3 0 05 Jul 2023
Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates Siqi Zhang S. Choudhury Sebastian U. Stich Nicolas Loizou FedML 19 3 0 08 Jun 2023
Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape Yan Sun Li Shen Shi-Yong Chen Liang Ding Dacheng Tao FedML 34 33 0 19 May 2023
Differentially Private Attention Computation Yeqi Gao Zhao-quan Song Xin Yang 47 19 0 08 May 2023
Federated Ensemble-Directed Offline Reinforcement Learning Desik Rengarajan N. Ragothaman D. Kalathil S. Shakkottai OffRL 26 1 0 04 May 2023
FedML Parrot: A Scalable Federated Learning System via Heterogeneity-aware Scheduling on Sequential and Hierarchical Training Zhenheng Tang X. Chu Ryan Yide Ran Sunwoo Lee S. Shi Yonggang Zhang Yuxin Wang Alex Liang A. Avestimehr Chaoyang He FedML 15 10 0 03 Mar 2023
DoCoFL: Downlink Compression for Cross-Device Federated Learning Ron Dorfman S. Vargaftik Y. Ben-Itzhak Kfir Y. Levy FedML 24 18 0 01 Feb 2023
Federated Automatic Differentiation Keith Rush Zachary B. Charles Zachary Garrett FedML 34 1 0 18 Jan 2023
Graph Federated Learning with Hidden Representation Sharing Shuang Wu Mingxuan Zhang Yuantong Li Carl Yang Pan Li FedML 24 1 0 23 Dec 2022
GlueFL: Reconciling Client Sampling and Model Masking for Bandwidth Efficient Federated Learning Shiqi He Qifan Yan Feijie Wu Lanjun Wang Mathias Lécuyer Ivan Beschastnikh FedML 42 7 0 03 Dec 2022
Fast Adaptive Federated Bilevel Optimization Feihu Huang FedML 20 7 0 02 Nov 2022
FeDXL: Provable Federated Learning for Deep X-Risk Optimization Zhishuai Guo R. L. Jin Jiebo Luo Tianbao Yang FedML 47 8 0 26 Oct 2022
PersA-FL: Personalized Asynchronous Federated Learning Taha Toghani Soomin Lee César A. Uribe FedML 34 6 0 03 Oct 2022
NET-FLEET: Achieving Linear Convergence Speedup for Fully Decentralized Federated Learning with Heterogeneous Data Xin Zhang Minghong Fang Zhuqing Liu Haibo Yang Jia-Wei Liu Zhengyuan Zhu FedML 20 14 0 17 Aug 2022
Accelerated Federated Learning with Decoupled Adaptive Optimization Jiayin Jin Jiaxiang Ren Yang Zhou Lingjuan Lyu Ji Liu Dejing Dou AI4CE FedML 19 51 0 14 Jul 2022
Towards the Practical Utility of Federated Learning in the Medical Domain Seongjun Yang Hyeonji Hwang Daeyoung Kim Radhika Dua Jong-Yeup Kim Eunho Yang E. Choi FedML OOD 18 16 0 07 Jul 2022
Global Convergence of Federated Learning for Mixed Regression Lili Su Jiaming Xu Pengkun Yang FedML 25 7 0 15 Jun 2022
Deep Leakage from Model in Federated Learning Zihao Zhao Mengen Luo Wenbo Ding FedML 18 14 0 10 Jun 2022
FedAvg with Fine Tuning: Local Updates Lead to Representation Learning Liam Collins Hamed Hassani Aryan Mokhtari Sanjay Shakkottai FedML 29 75 0 27 May 2022
Communication-Efficient Adaptive Federated Learning Yujia Wang Lu Lin Jinghui Chen FedML 24 70 0 05 May 2022
On the Convergence of Momentum-Based Algorithms for Federated Bilevel Optimization Problems Hongchang Gao FedML 25 1 0 28 Apr 2022
Architecture Agnostic Federated Learning for Neural Networks Disha Makhija Xing Han Nhat Ho Joydeep Ghosh FedML 21 40 0 15 Feb 2022
Communication Efficient Federated Learning for Generalized Linear Bandits Chuanhao Li Hongning Wang FedML 25 13 0 02 Feb 2022
On the Convergence of Heterogeneous Federated Learning with Arbitrary Adaptive Online Model Pruning Hanhan Zhou Tian-Shing Lan Guru Venkataramani Wenbo Ding FedML 24 6 0 27 Jan 2022
On Convergence of Federated Averaging Langevin Dynamics Wei Deng Qian Zhang Yi Ma Zhao-quan Song Guang Lin FedML 27 16 0 09 Dec 2021
Differentially Private Federated Learning on Heterogeneous Data Maxence Noble A. Bellet Aymeric Dieuleveut FedML 11 102 0 17 Nov 2021
EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback Ilyas Fatkhullin Igor Sokolov Eduard A. Gorbunov Zhize Li Peter Richtárik 46 44 0 07 Oct 2021
FedKD: Communication Efficient Federated Learning via Knowledge Distillation Chuhan Wu Fangzhao Wu Lingjuan Lyu Yongfeng Huang Xing Xie FedML 27 373 0 30 Aug 2021
The Effect of Training Parameters and Mechanisms on Decentralized Federated Learning based on MNIST Dataset Zhuofan Zhang Mi Zhou K. Niu C. Abdallah FedML 44 1 0 07 Aug 2021
Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacy Xinwei Zhang Xiangyi Chen Min-Fong Hong Zhiwei Steven Wu Jinfeng Yi FedML 22 91 0 25 Jun 2021
Federated Learning with Buffered Asynchronous Aggregation John Nguyen Kshitiz Malik Hongyuan Zhan Ashkan Yousefpour Michael G. Rabbat Mani Malek Dzmitry Huba FedML 33 288 0 11 Jun 2021
Vertical Federated Learning without Revealing Intersection Membership Jiankai Sun Xin Yang Yuanshun Yao Aonan Zhang Weihao Gao Junyuan Xie Chong-Jun Wang FedML 23 37 0 10 Jun 2021
From Distributed Machine Learning to Federated Learning: A Survey Ji Liu Jizhou Huang Yang Zhou Xuhong Li Shilei Ji Haoyi Xiong Dejing Dou FedML OOD 51 243 0 29 Apr 2021