On the Convergence of FedAvg on Non-IID Data

4 July 2019

Xiang Li

Kaixuan Huang

Wenhao Yang

Papers citing "On the Convergence of FedAvg on Non-IID Data"

50 / 1,086 papers shown

Title
Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data Dezhong Yao Wanning Pan Yutong Dai Yao Wan Xiaofeng Ding Hai Jin Zheng Xu Lichao Sun FedML 28 49 0 30 Jun 2021
A Non-parametric View of FedAvg and FedProx: Beyond Stationary Points Lili Su Jiaming Xu Pengkun Yang FedML 14 13 0 29 Jun 2021
AdaptCL: Efficient Collaborative Learning with Dynamic and Adaptive Pruning Guangmeng Zhou Ke Xu Qi Li Yang Liu Yi Zhao 24 8 0 27 Jun 2021
Federated Noisy Client Learning Huazhu Fu Li Li Bo Han Chengzhong Xu Ling Shao FedML 28 26 0 24 Jun 2021
Enabling Long-Term Cooperation in Cross-Silo Federated Learning: A Repeated Game Perspective Ning Zhang Qian Ma Xu Chen FedML 24 50 0 22 Jun 2021
FLRA: A Reference Architecture for Federated Learning Systems Sin Kit Lo Qinghua Lu Hye-Young Paik Liming Zhu FedML AI4CE 47 24 0 22 Jun 2021
Compositional federated learning: Applications in distributionally robust averaging and meta learning Feihu Huang Junyi Li FedML 22 15 0 21 Jun 2021
FedCM: Federated Learning with Client-level Momentum Jing Xu Sen Wang Liwei Wang Andrew Chi-Chih Yao FedML 30 94 0 21 Jun 2021
Federated Robustness Propagation: Sharing Robustness in Heterogeneous Federated Learning Junyuan Hong Haotao Wang Zhangyang Wang Jiayu Zhou FedML 34 16 0 18 Jun 2021
Local AdaGrad-Type Algorithm for Stochastic Convex-Concave Optimization Luofeng Liao Li Shen Jia Duan Mladen Kolar Dacheng Tao 27 4 0 18 Jun 2021
Towards Heterogeneous Clients with Elastic Federated Learning Zichen Ma Yu Lu Zihan Lu Wenye Li Jinfeng Yi Shuguang Cui FedML 19 3 0 17 Jun 2021
Quantized Federated Learning under Transmission Delay and Outage Constraints Yanmeng Wang Yanqing Xu Qingjiang Shi Tsung-Hui Chang 10 84 0 17 Jun 2021
Robust Training in High Dimensions via Block Coordinate Geometric Median Descent Anish Acharya Abolfazl Hashemi Prateek Jain Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu 20 33 0 16 Jun 2021
CRFL: Certifiably Robust Federated Learning against Backdoor Attacks Chulin Xie Minghao Chen Pin-Yu Chen Bo-wen Li FedML 36 164 0 15 Jun 2021
CFedAvg: Achieving Efficient Communication and Fast Convergence in Non-IID Federated Learning Haibo Yang Jia Liu Elizabeth S. Bentley FedML 21 17 0 14 Jun 2021
Heterogeneous Federated Learning using Dynamic Model Pruning and Adaptive Gradient Sixing Yu P. Nguyen Ali Anwar Ali Jannesari 31 12 0 13 Jun 2021
Federated Learning with Buffered Asynchronous Aggregation John Nguyen Kshitiz Malik Hongyuan Zhan Ashkan Yousefpour Michael G. Rabbat Mani Malek Dzmitry Huba FedML 33 288 0 11 Jun 2021
Efficient and Less Centralized Federated Learning Li Chou Zichang Liu Zhuang Wang Anshumali Shrivastava FedML 19 17 0 11 Jun 2021
No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Data Mi Luo Fei Chen Dapeng Hu Yifan Zhang Jian Liang Jiashi Feng FedML 45 328 0 09 Jun 2021
Memory-Based Optimization Methods for Model-Agnostic Meta-Learning and Personalized Federated Learning Bokun Wang Zhuoning Yuan Yiming Ying Tianbao Yang FedML 56 9 0 09 Jun 2021
Fast Federated Learning in the Presence of Arbitrary Device Unavailability Xinran Gu Kaixuan Huang Jingzhao Zhang Longbo Huang FedML 35 95 0 08 Jun 2021
Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning Jinhyun So Ramy E. Ali Başak Güler Jiantao Jiao Salman Avestimehr FedML 39 77 0 07 Jun 2021
Preservation of the Global Knowledge by Not-True Distillation in Federated Learning Gihun Lee Minchan Jeong Yongjin Shin Sangmin Bae Se-Young Yun FedML 27 115 0 06 Jun 2021
FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning S. K. Shyn Donghee Kim Kwangsu Kim FedML 12 22 0 04 Jun 2021
Federated Neural Collaborative Filtering V. Perifanis P. Efraimidis FedML 15 92 0 02 Jun 2021
FedHealth 2: Weighted Federated Transfer Learning via Batch Normalization for Personalized Healthcare Yiqiang Chen Wang Lu Jindong Wang Xin Qin OOD FedML 22 14 0 02 Jun 2021
Unifying Distillation with Personalization in Federated Learning Siddharth Divi Habiba Farrukh Berkay Çelik FedML 37 5 0 31 May 2021
CDMA: A Practical Cross-Device Federated Learning Algorithm for General Minimax Problems Jiahao Xie Chao Zhang Zebang Shen Weijie Liu Hui Qian FedML 23 1 0 29 May 2021
Fed-NILM: A Federated Learning-based Non-Intrusive Load Monitoring Method for Privacy-Protection Haijin Wang Caomingzhe Si Junhua Zhao Guolong Liu Fushuan Wen 13 25 0 24 May 2021
Data-Free Knowledge Distillation for Heterogeneous Federated Learning Zhuangdi Zhu Junyuan Hong Jiayu Zhou FedML 27 630 0 20 May 2021
Accelerating Gossip SGD with Periodic Global Averaging Yiming Chen Kun Yuan Yingya Zhang Pan Pan Yinghui Xu W. Yin 37 41 0 19 May 2021
Prototype Guided Federated Learning of Visual Feature Representations Umberto Michieli Mete Ozay FedML 19 37 0 19 May 2021
DID-eFed: Facilitating Federated Learning as a Service with Decentralized Identities Jiahui Geng Neel Kanwal M. Jaatun Chunming Rong 27 19 0 18 May 2021
Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD Kun Yuan Sulaiman A. Alghunaim Xinmeng Huang 31 32 0 17 May 2021
Node Selection Toward Faster Convergence for Federated Learning on Non-IID Data Hongda Wu Ping Wang FedML 29 135 0 14 May 2021
Clustered Sampling: Low-Variance and Improved Representativity for Clients Selection in Federated Learning Yann Fraboni Richard Vidal Laetitia Kameni Marco Lorenzi FedML 15 184 0 12 May 2021
FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Convergence Analysis Baihe Huang Xiaoxiao Li Zhao Song Xin Yang FedML 31 16 0 11 May 2021
Slashing Communication Traffic in Federated Learning by Transmitting Clustered Model Updates Laizhong Cui Xiaoxin Su Yipeng Zhou Yi Pan FedML 38 36 0 10 May 2021
A Hybrid Architecture for Federated and Centralized Learning Ahmet M. Elbir Sinem Coleri Anastasios K. Papazafeiropoulos P. Kourtessis Symeon Chatzinotas FedML 13 35 0 07 May 2021
Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligence Emna Baccour N. Mhaisen A. Abdellatif A. Erbad Amr M. Mohamed Mounir Hamdi Mohsen Guizani 28 86 0 04 May 2021
Convergence Analysis and System Design for Federated Learning over Wireless Networks Shuo Wan Jiaxun Lu Pingyi Fan Yunfeng Shao Chenghui Peng Khaled B. Letaief 42 54 0 30 Apr 2021
Decentralized Federated Averaging Tao Sun Dongsheng Li Bao Wang FedML 54 207 0 23 Apr 2021
A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Things Jiehan Zhou Shouhua Zhang Qinghua Lu W. Dai Min Chen Xin Liu Susanna Pirttikangas Yang Shi Weishan Zhang E. Herrera-Viedma FedML AI4CE 23 44 0 21 Apr 2021
Auto-FedAvg: Learnable Federated Averaging for Multi-Institutional Medical Image Segmentation Yingda Xia Dong Yang Wenqi Li Andriy Myronenko Daguang Xu ... Elvira Stellato G. Carrafiello A. Ierardi Alan Yuille H. Roth OOD FedML 44 46 0 20 Apr 2021
CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework Yu Zhang Moming Duan Duo Liu Li Li Ao Ren Xianzhang Chen Yujuan Tan Chengliang Wang FedML 11 36 0 16 Apr 2021
FedSAE: A Novel Self-Adaptive Federated Learning Framework in Heterogeneous Systems Li Li Moming Duan Duo Liu Yu Zhang Ao Ren Xianzhang Chen Yujuan Tan Chengliang Wang FedML 29 43 0 15 Apr 2021
BROADCAST: Reducing Both Stochastic and Compression Noise to Robustify Communication-Efficient Federated Learning He Zhu Qing Ling FedML AAML 22 11 0 14 Apr 2021
Federated Few-Shot Learning with Adversarial Learning Chenyou Fan Jianwei Huang FedML 13 29 0 01 Apr 2021
Decentralized and Model-Free Federated Learning: Consensus-Based Distillation in Function Space Akihito Taya Takayuki Nishio M. Morikura Koji Yamamoto FedML 23 20 0 01 Apr 2021
Federated Learning: A Signal Processing Perspective Tomer Gafni Nir Shlezinger Kobi Cohen Yonina C. Eldar H. Vincent Poor FedML 34 128 0 31 Mar 2021