The Non-IID Data Quagmire of Decentralized Machine Learning

1 October 2019

Papers citing "The Non-IID Data Quagmire of Decentralized Machine Learning"

50 / 291 papers shown

Title
Semi-Decentralized Federated Edge Learning with Data and Device Heterogeneity Yuchang Sun Jiawei Shao Yuyi Mao Jessie Hui Wang Jun Zhang FedML 29 31 0 20 Dec 2021
The Impact of Data Distribution on Fairness and Robustness in Federated Learning Mustafa Safa Ozdayi Murat Kantarcioglu FedML OOD 24 4 0 29 Nov 2021
SPATL: Salient Parameter Aggregation and Transfer Learning for Heterogeneous Clients in Federated Learning Sixing Yu P. Nguyen Waqwoya Abebe Wei Qian Ali Anwar Ali Jannesari FedML 59 20 0 29 Nov 2021
FedDropoutAvg: Generalizable federated learning for histopathology image classification G. N. Gunesli M. Bilal S. Raza Nasir M. Rajpoot FedML OOD 34 20 0 25 Nov 2021
A Novel Optimized Asynchronous Federated Learning Framework Zhicheng Zhou Hailong Chen Kunhua Li Fei Hu Bingjie Yan ... Xuyan Wei Bernie Liu Xiulai Li Fuwen Chen Yongjie Sui FedML 33 5 0 18 Nov 2021
Low Precision Decentralized Distributed Training over IID and non-IID Data Sai Aparna Aketi Sangamesh Kodge Kaushik Roy MQ 24 9 0 17 Nov 2021
DQRE-SCnet: A novel hybrid approach for selecting users in Federated Learning with Deep-Q-Reinforcement Learning based on Spectral Clustering Mohsen Ahmadi Ali Taghavirashidizadeh D. Javaheri Armin Masoumian Saeid Jafarzadeh Ghoushchi Y. Pourasad FedML 40 61 0 07 Nov 2021
Implicit Model Specialization through DAG-based Decentralized Federated Learning Jossekin Beilharz Bjarne Pfitzner R. Schmid Paul Geppert Bernd Arnrich A. Polze FedML OOD 19 14 0 01 Nov 2021
What Do We Mean by Generalization in Federated Learning? Honglin Yuan Warren Morningstar Lin Ning K. Singhal OOD FedML 46 72 0 27 Oct 2021
Federated Learning over Wireless IoT Networks with Optimized Communication and Resources Student Member Ieee Hao Chen Shaocheng Huang Deyou Zhang Ming Xiao Fellow Ieee Mikael Skoglund L. F. I. H. Vincent Poor 53 94 0 22 Oct 2021
UniFed: A Unified Framework for Federated Learning on Non-IID Image Features Meirui Jiang Xiaoxiao Li Xiaofei Zhang Michael Kamp Qianming Dou FedML OOD 51 0 0 19 Oct 2021
Adapt to Adaptation: Learning Personalization for Cross-Silo Federated Learning Jun Luo Shandong Wu OOD MQ 68 75 0 15 Oct 2021
Evaluation of Hyperparameter-Optimization Approaches in an Industrial Federated Learning System Stephan Holly Thomas Hiessl Safoura Rezapour Lakani Daniel Schall C. Heitzinger J. Kemnitz FedML 65 17 0 15 Oct 2021
Partial Variable Training for Efficient On-Device Federated Learning Tien-Ju Yang Dhruv Guliani F. Beaufays Giovanni Motta FedML 27 25 0 11 Oct 2021
ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive Training Hui-Po Wang Sebastian U. Stich Yang He Mario Fritz FedML AI4CE 41 48 0 11 Oct 2021
Exploring Heterogeneous Characteristics of Layers in ASR Models for More Efficient Training Lillian Zhou Dhruv Guliani Andreas Kabel Giovanni Motta F. Beaufays 37 1 0 08 Oct 2021
Enabling On-Device Training of Speech Recognition Models with Federated Dropout Dhruv Guliani Lillian Zhou Changwan Ryu Tien-Ju Yang Harry Zhang Yong Xiao F. Beaufays Giovanni Motta FedML 33 16 0 07 Oct 2021
Efficient and Private Federated Learning with Partially Trainable Networks Hakim Sidahmed Zheng Xu Ankush Garg Yuan Cao Mingqing Chen FedML 68 13 0 06 Oct 2021
Federated Ensemble Model-based Reinforcement Learning in Edge Computing Jin Wang Jia Hu Jed Mills Geyong Min Ming Xia FedML 30 20 0 12 Sep 2021
Dubhe: Towards Data Unbiasedness with Homomorphic Encryption in Federated Learning Client Selection Shulai Zhang Zirui Li Quan Chen Wenli Zheng Jingwen Leng Minyi Guo FedML 59 32 0 08 Sep 2021
SemiFed: Semi-supervised Federated Learning with Consistency and Pseudo-Labeling Haowen Lin Jian Lou Li Xiong Cyrus Shahabi FedML 29 56 0 21 Aug 2021
Learning Federated Representations and Recommendations with Limited Negatives Lin Ning K. Singhal Ellie X. Zhou Sushant Prakash FedML 32 14 0 18 Aug 2021
FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learning Nam Hyeon-Woo Moon Ye-Bin Tae-Hyun Oh FedML 21 117 0 13 Aug 2021
Federated Learning Meets Natural Language Processing: A Survey Ming Liu Stella Ho Mengqi Wang Longxiang Gao Yuan Jin Heng Zhang FedML 30 67 0 27 Jul 2021
Aggregate or Not? Exploring Where to Privatize in DNN Based Federated Learning Under Different Non-IID Scenes Xin-Chun Li Le Gan De-Chuan Zhan Yunfeng Shao Bingshuai Li Shaoming Song OOD 30 9 0 26 Jul 2021
FedLab: A Flexible Federated Learning Framework Dun Zeng Siqi Liang Xiangjing Hu Hui Wang Zenglin Xu FedML 20 107 0 24 Jul 2021
An Experimental Study of Data Heterogeneity in Federated Learning Methods for Medical Imaging Liangqiong Qu N. Balachandar D. Rubin 34 24 0 18 Jul 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 189 413 0 14 Jul 2021
SplitAVG: A heterogeneity-aware federated deep learning method for medical imaging Miao Zhang Liangqiong Qu Praveer Singh Jayashree Kalpathy-Cramer D. Rubin OOD FedML 34 62 0 06 Jul 2021
FedMix: Approximation of Mixup under Mean Augmented Federated Learning Tehrim Yoon Sumin Shin Sung Ju Hwang Eunho Yang FedML 38 166 0 01 Jul 2021
Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data Dezhong Yao Wanning Pan Yutong Dai Yao Wan Xiaofeng Ding Hai Jin Zheng Xu Lichao Sun FedML 30 50 0 30 Jun 2021
Handling Data Heterogeneity with Generative Replay in Collaborative Learning for Medical Imaging Liangqiong Qu N. Balachandar Miao Zhang D. Rubin MedIm 22 19 0 24 Jun 2021
Personalized Federated Learning with Contextualized Generalization Xueyang Tang Song Guo Jingcai Guo FedML 23 38 0 24 Jun 2021
FedCM: Federated Learning with Client-level Momentum Jing Xu Sen Wang Liwei Wang Andrew Chi-Chih Yao FedML 42 95 0 21 Jun 2021
On Large-Cohort Training for Federated Learning Zachary B. Charles Zachary Garrett Zhouyuan Huo Sergei Shmulyian Virginia Smith FedML 23 113 0 15 Jun 2021
Heterogeneous Federated Learning using Dynamic Model Pruning and Adaptive Gradient Sixing Yu P. Nguyen Ali Anwar Ali Jannesari 37 12 0 13 Jun 2021
Stochastic Alternating Direction Method of Multipliers for Byzantine-Robust Distributed Learning Feng-Shih Lin Weiyu Li Qing Ling FedML 28 6 0 13 Jun 2021
Federated Learning with Buffered Asynchronous Aggregation John Nguyen Kshitiz Malik Hongyuan Zhan Ashkan Yousefpour Michael G. Rabbat Mani Malek Dzmitry Huba FedML 43 291 0 11 Jun 2021
Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning Liangqiong Qu Yuyin Zhou Paul Pu Liang Yingda Xia Feifei Wang Ehsan Adeli L. Fei-Fei D. Rubin FedML AI4CE 24 176 0 10 Jun 2021
Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning Ekdeep Singh Lubana Robert P. Dick Hidenori Tanaka 38 35 0 10 Jun 2021
No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Data Mi Luo Fei Chen Dapeng Hu Yifan Zhang Jian Liang Jiashi Feng FedML 50 329 0 09 Jun 2021
SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training Enmao Diao Jie Ding Vahid Tarokh FedML 30 73 0 02 Jun 2021
Federated Learning for Short-term Residential Load Forecasting Christopher Briggs Zhong Fan Péter András 17 51 0 27 May 2021
Federated Learning With Highly Imbalanced Audio Data Marc C. Green Mark D. Plumbley FedML 40 3 0 18 May 2021
Semi-Decentralized Federated Edge Learning for Fast Convergence on Non-IID Data Yuchang Sun Jiawei Shao Yuyi Mao Jessie Hui Wang Jun Zhang FedML 67 39 0 26 Apr 2021
Federated Learning of User Verification Models Without Sharing Embeddings H. Hosseini Hyunsin Park Sungrack Yun Christos Louizos Joseph B. Soriaga Max Welling FedML 30 23 0 18 Apr 2021
D-Cliques: Compensating for Data Heterogeneity with Topology in Decentralized Federated Learning A. Bellet Anne-Marie Kermarrec Erick Lavoie FedML 47 21 0 15 Apr 2021
Distributed Learning Systems with First-order Methods Ji Liu Ce Zhang 16 44 0 12 Apr 2021
Demystifying the Effects of Non-Independence in Federated Learning Stefan Arnold Dilara Yesilbas FedML 34 4 0 20 Mar 2021
Private Cross-Silo Federated Learning for Extracting Vaccine Adverse Event Mentions Pallika H. Kanani Virendra J. Marathe Daniel W. Peterson R. Harpaz Steve Bright FedML 23 9 0 12 Mar 2021