The Non-IID Data Quagmire of Decentralized Machine Learning

1 October 2019

Papers citing "The Non-IID Data Quagmire of Decentralized Machine Learning"

50 / 291 papers shown

Title
Accelerated Federated Learning with Decoupled Adaptive Optimization Jiayin Jin Jiaxiang Ren Yang Zhou Lingjuan Lyu Ji Liu Dejing Dou AI4CE FedML 32 52 0 14 Jul 2022
Multi-Level Branched Regularization for Federated Learning Jinkyu Kim Geeho Kim Bohyung Han FedML 29 53 0 14 Jul 2022
TCT: Convexifying Federated Learning using Bootstrapped Neural Tangent Kernels Yaodong Yu Alexander Wei Sai Praneeth Karimireddy Yi-An Ma Michael I. Jordan FedML 29 30 0 13 Jul 2022
StatMix: Data augmentation method that relies on image statistics in federated learning Dominik Lewy Jacek Mańdziuk M. Ganzha M. Paprzycki FedML 50 9 0 08 Jul 2022
Tackling Data Heterogeneity: A New Unified Framework for Decentralized SGD with Sample-induced Topology Yan Huang Ying Sun Zehan Zhu Changzhi Yan Jinming Xu FedML 40 15 0 08 Jul 2022
Towards the Practical Utility of Federated Learning in the Medical Domain Seongjun Yang Hyeonji Hwang Daeyoung Kim Radhika Dua Jong-Yeup Kim Eunho Yang Edward Choi FedML OOD 34 16 0 07 Jul 2022
An Empirical Study of Personalized Federated Learning Koji Matsuda Yuya Sasaki Chuan Xiao Makoto Onizuka OOD FedML 32 6 0 27 Jun 2022
FedorAS: Federated Architecture Search under system heterogeneity Łukasz Dudziak Stefanos Laskaridis Javier Fernandez-Marques FedML 46 7 0 22 Jun 2022
Mitigating Data Heterogeneity in Federated Learning with Data Augmentation George Giapitzakis Guojun Zhang Xi Chen Yaoliang Yu FedML 24 30 0 20 Jun 2022
Pisces: Efficient Federated Learning via Guided Asynchronous Training Zhifeng Jiang Wei Wang Baochun Li Yue Liu FedML 32 24 0 18 Jun 2022
Federated learning with incremental clustering for heterogeneous data F. E. Castellon Aurélien Mayoue Jacques-Henri Sublemontier Cédric Gouy-Pailler FedML 29 8 0 17 Jun 2022
Gradient Obfuscation Gives a False Sense of Security in Federated Learning Kai Yue Richeng Jin Chau-Wai Wong D. Baron H. Dai FedML 55 46 0 08 Jun 2022
FedNST: Federated Noisy Student Training for Automatic Speech Recognition Haaris Mehmood A. Dobrowolska Karthikeyan P. Saravanan Mete Ozay 26 7 0 06 Jun 2022
DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training Rong Dai Li Shen Fengxiang He Xinmei Tian Dacheng Tao FedML 35 112 0 01 Jun 2022
CalFAT: Calibrated Federated Adversarial Training with Label Skewness Chen Chen Yuchen Liu Xingjun Ma Lingjuan Lyu FedML 167 32 0 30 May 2022
Federated Semi-Supervised Learning with Prototypical Networks Woojun Kim Keondo Park Kihyuk Sohn Raphael Shu Hyung-Sin Kim FedML 40 11 0 27 May 2022
A Fair Federated Learning Framework With Reinforcement Learning Yaqi Sun Shijing Si Jianzong Wang Yuhan Dong Z. Zhu Jing Xiao FedML 53 7 0 26 May 2022
Orchestra: Unsupervised Federated Learning via Globally Consistent Clustering Ekdeep Singh Lubana Chi Ian Tang F. Kawsar Robert P. Dick Akhil Mathur FedML 40 52 0 23 May 2022
Semi-Decentralized Federated Learning with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 51 32 0 23 May 2022
Test-Time Robust Personalization for Federated Learning Liang Jiang Tao R. Lin FedML OOD TTA 85 44 0 22 May 2022
Label-Efficient Self-Supervised Federated Learning for Tackling Data Heterogeneity in Medical Imaging Rui Yan Liangqiong Qu Qingyue Wei Shih-Cheng Huang Liyue Shen D. Rubin Lei Xing Yuyin Zhou FedML 82 90 0 17 May 2022
Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints Mónica Ribero H. Vikalo G. Veciana FedML 29 44 0 13 May 2022
Layer-wised Model Aggregation for Personalized Federated Learning Xiaosong Ma Jie Zhang Song Guo Wenchao Xu FedML 38 171 0 09 May 2022
Online Model Compression for Federated Learning with Large Models Tien-Ju Yang Yonghui Xiao Giovanni Motta F. Beaufays Rajiv Mathews Mingqing Chen FedML MQ 51 8 0 06 May 2022
FedShuffle: Recipes for Better Use of Local Work in Federated Learning Samuel Horváth Maziar Sanjabi Lin Xiao Peter Richtárik Michael G. Rabbat FedML 38 21 0 27 Apr 2022
Federated Geometric Monte Carlo Clustering to Counter Non-IID Datasets Federico Lucchetti Jérémie Decouchant Maria Fernandes L. Chen Marcus Volp FedML 24 0 0 23 Apr 2022
A Closer Look at Personalization in Federated Image Classification Changxing Jing Yan Huang Yihong Zhuang Liyan Sun Yue Huang Zhenlong Xiao Xinghao Ding 52 1 0 22 Apr 2022
IOP-FL: Inside-Outside Personalization for Federated Medical Image Segmentation Meirui Jiang Hongzheng Yang Chen Cheng Qianming Dou 65 32 0 16 Apr 2022
Data-heterogeneity-aware Mixing for Decentralized Learning Yatin Dandi Anastasia Koloskova Martin Jaggi Sebastian U. Stich 43 18 0 13 Apr 2022
Refined Convergence and Topology Learning for Decentralized SGD with Heterogeneous Data B. L. Bars A. Bellet Marc Tommasi Erick Lavoie Anne-Marie Kermarrec FedML 39 25 0 09 Apr 2022
Federated Learning with Partial Model Personalization Krishna Pillutla Kshitiz Malik Abdel-rahman Mohamed Michael G. Rabbat Maziar Sanjabi Lin Xiao FedML 52 157 0 08 Apr 2022
FedCos: A Scene-adaptive Federated Optimization Enhancement for Performance Improvement Hao Zhang Tingting Wu Siyao Cheng Jie Liu FedML 45 11 0 07 Apr 2022
Federated Learning with Position-Aware Neurons Xin-Chun Li Yi-Chu Xu Shaoming Song Bingshuai Li Yinchuan Li Yunfeng Shao De-Chuan Zhan FedML 43 33 0 28 Mar 2022
Sparse Federated Learning with Hierarchical Personalized Models Xiaofeng Liu Qing Wang Yunfeng Shao Yinchuan Li FedML 60 11 0 25 Mar 2022
Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with Momentum Kirby Banman Liam Peet-Paré N. Hegde Alona Fyshe Martha White 34 0 0 22 Mar 2022
Improving Generalization in Federated Learning by Seeking Flat Minima Debora Caldarola Barbara Caputo Marco Ciccone FedML 47 110 0 22 Mar 2022
Closing the Generalization Gap of Cross-silo Federated Medical Image Segmentation An Xu Wenqi Li Pengfei Guo Dong Yang H. Roth Ali Hatamizadeh Can Zhao Daguang Xu Heng-Chiao Huang Ziyue Xu FedML 40 52 0 18 Mar 2022
Efficient Image Representation Learning with Federated Sampled Softmax Sagar M. Waghmare Qi Huizhong Chen Mikhail Sirotenko Tomer Meron FedML 19 2 0 09 Mar 2022
Robust Federated Learning with Connectivity Failures: A Semi-Decentralized Framework with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 65 8 0 24 Feb 2022
FLAME: Federated Learning Across Multi-device Environments Hyunsung Cho Akhil Mathur F. Kawsar 21 21 0 17 Feb 2022
Asynchronous Parallel Incremental Block-Coordinate Descent for Decentralized Machine Learning Hao Chen Yu Ye Ming Xiao Mikael Skoglund 49 3 0 07 Feb 2022
Proportional Fairness in Federated Learning Guojun Zhang Saber Malekmohammadi Xi Chen Yaoliang Yu FedML 35 24 0 03 Feb 2022
FedSpace: An Efficient Federated Learning Framework at Satellites and Ground Stations Jinhyun So Kevin Hsieh Behnaz Arzani Shadi Noghabi Salman Avestimehr Ranveer Chandra FedML 28 60 0 02 Feb 2022
Faster Convergence of Local SGD for Over-Parameterized Models Tiancheng Qin S. Rasoul Etesami César A. Uribe FedML 49 6 0 30 Jan 2022
Achieving Personalized Federated Learning with Sparse Local Models Tiansheng Huang Shiwei Liu Li Shen Fengxiang He Weiwei Lin Dacheng Tao FedML 43 43 0 27 Jan 2022
Stochastic Coded Federated Learning with Convergence and Privacy Guarantees Yuchang Sun Jiawei Shao Songze Li Yuyi Mao Jun Zhang FedML 45 17 0 25 Jan 2022
Communication-Efficient Federated Learning with Accelerated Client Gradient Geeho Kim Jinkyu Kim Bohyung Han FedML 45 11 0 10 Jan 2022
Optimizing the Communication-Accuracy Trade-off in Federated Learning with Rate-Distortion Theory Nicole Mitchell Johannes Ballé Zachary B. Charles Jakub Konecný FedML 27 21 0 07 Jan 2022
FedLGA: Towards System-Heterogeneity of Federated Learning via Local Gradient Approximation Xingyu Li Zhe Qu Bo Tang Zhuo Lu FedML 38 26 0 22 Dec 2021
HarmoFL: Harmonizing Local and Global Drifts in Federated Learning on Heterogeneous Medical Images Meirui Jiang Zirui Wang Qi Dou FedML 54 124 0 20 Dec 2021