The Non-IID Data Quagmire of Decentralized Machine Learning

1 October 2019

Papers citing "The Non-IID Data Quagmire of Decentralized Machine Learning"

50 / 291 papers shown

Title
Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape Yan Sun Li Shen Shi-Yong Chen Liang Ding Dacheng Tao FedML 42 33 0 19 May 2023
Understanding and Improving Model Averaging in Federated Learning on Heterogeneous Data Tailin Zhou Zehong Lin Jinchao Zhang Danny H. K. Tsang MoMe FedML 55 12 0 13 May 2023
Global Update Tracking: A Decentralized Learning Algorithm for Heterogeneous Data Sai Aparna Aketi Abolfazl Hashemi Kaushik Roy FedML 43 12 0 08 May 2023
MrTF: Model Refinery for Transductive Federated Learning Xin-Chun Li Yang Yang De-Chuan Zhan 38 3 0 07 May 2023
Can Fair Federated Learning reduce the need for Personalisation? Ferhat Ozgur Catak Pedro Gusmão S. Sarp FedML 20 1 0 04 May 2023
Decentralized Learning Made Easy with DecentralizePy Akash Dhasade Anne-Marie Kermarrec Rafael Pires Rishi Sharma Milos Vujasinovic 19 15 0 17 Apr 2023
FedTrip: A Resource-Efficient Federated Learning Method with Triplet Regularization Xujing Li Min Liu Sheng Sun Yuwei Wang Hui Jiang Xue Jiang 26 4 0 12 Apr 2023
Preemptively Pruning Clever-Hans Strategies in Deep Neural Networks Lorenz Linhardt Klaus-Robert Muller G. Montavon AAML 40 7 0 12 Apr 2023
Re-Weighted Softmax Cross-Entropy to Control Forgetting in Federated Learning G. Legate Lucas Caccia Eugene Belilovsky FedML 43 11 0 11 Apr 2023
Homogenizing Non-IID datasets via In-Distribution Knowledge Distillation for Decentralized Learning Deepak Ravikumar Gobinda Saha Sai Aparna Aketi Kaushik Roy 26 2 0 09 Apr 2023
DPP-based Client Selection for Federated Learning with Non-IID Data Yuxuan Zhang Chao Xu Howard H. Yang Xijun Wang Tony Q.S. Quek FedML 62 5 0 30 Mar 2023
CoDeC: Communication-Efficient Decentralized Continual Learning Sakshi Choudhary Sai Aparna Aketi Gobinda Saha Kaushik Roy CLL 60 3 0 27 Mar 2023
Prototype Helps Federated Learning: Towards Faster Convergence Yu Qiao Seong-Bae Park Sun Moo Kang Choong Seon Hong FedML 27 11 0 22 Mar 2023
Making Batch Normalization Great in Federated Deep Learning Shitian Zhao Hong-You Chen Wei-Lun Chao FedML 50 10 0 12 Mar 2023
Stochastic Clustered Federated Learning Dun Zeng Xiangjing Hu Shiyu Liu Yue Yu Qifan Wang Zenglin Xu FedML 52 13 0 02 Mar 2023
A Unified Momentum-based Paradigm of Decentralized SGD for Non-Convex Models and Heterogeneous Data Haizhou Du Chengdong Ni 22 1 0 01 Mar 2023
Decentralized Learning Made Practical with Client Sampling M. Vos Akash Dhasade Anne-Marie Kermarrec Erick Lavoie J. Pouwelse Rishi Sharma 34 1 0 27 Feb 2023
A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacy Yifei Zhang Dun Zeng Jinglong Luo Zenglin Xu Irwin King FedML 90 48 0 21 Feb 2023
FedSpeed: Larger Local Interval, Less Communication Round, and Higher Generalization Accuracy Yan Sun Li Shen Tiansheng Huang Liang Ding Dacheng Tao FedML 41 51 0 21 Feb 2023
CADIS: Handling Cluster-skewed Non-IID Data in Federated Learning with Clustered Aggregation and Knowledge DIStilled Regularization Nang Hung Nguyen Duc Long Nguyen Trong Bang Nguyen T. Nguyen H. Pham Truong Thao Nguyen Phi Le Nguyen FedML 43 8 0 21 Feb 2023
FedABC: Targeting Fair Competition in Personalized Federated Learning Dui Wang Li Shen Yong Luo Han Hu Kehua Su Yonggang Wen Dacheng Tao FedML 43 9 0 15 Feb 2023
Reliable Federated Disentangling Network for Non-IID Domain Feature Ming Wang Kai-An Yu Chun-Mei Feng Yiming Qian K. Zou Lianyu Wang Rick Siow Mong Goh Yong-Jin Liu Huazhu Fu OOD 45 1 0 30 Jan 2023
Federated Sufficient Dimension Reduction Through High-Dimensional Sparse Sliced Inverse Regression Wenquan Cui Yue Zhao Jianjun Xu Haoyang Cheng FedML 16 1 0 23 Jan 2023
Federated Automatic Differentiation Keith Rush Zachary B. Charles Zachary Garrett FedML 47 1 0 18 Jan 2023
Why Batch Normalization Damage Federated Learning on Non-IID Data? Yanmeng Wang Qingjiang Shi Tsung-Hui Chang FedML 23 33 0 08 Jan 2023
Decentralized Gradient Tracking with Local Steps Yue Liu Tao R. Lin Anastasia Koloskova Sebastian U. Stich 48 38 0 03 Jan 2023
Knowledge-Aware Federated Active Learning with Non-IID Data Yu Cao Ye-ling Shi Baosheng Yu Jingya Wang Dacheng Tao FedML 33 17 0 24 Nov 2022
Exploiting Personalized Invariance for Better Out-of-distribution Generalization in Federated Learning Xueyang Tang Song Guo Jie Zhang FedML OODD OOD 62 3 0 21 Nov 2022
FedFA: Federated Learning with Feature Anchors to Align Features and Classifiers for Heterogeneous Data Tailin Zhou Jun Zhang Danny H. K. Tsang FedML 36 57 0 17 Nov 2022
Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challenges Enrique Tomás Martínez Beltrán Mario Quiles Pérez Pedro Miguel Sánchez Sánchez Sergio López Bernal Gérome Bovet M. Pérez Gregorio Martínez Pérez Alberto Huertas Celdrán FedML 45 228 0 15 Nov 2022
Stochastic Coded Federated Learning: Theoretical Analysis and Incentive Mechanism Design Yuchang Sun Jiawei Shao Yuyi Mao Songze Li Jun Zhang FedML 46 8 0 08 Nov 2022
Does Learning from Decentralized Non-IID Unlabeled Data Benefit from Self Supervision? Lirui Wang Kai Zhang Yunzhu Li Yonglong Tian Russ Tedrake 39 16 0 20 Oct 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 21 70 0 14 Oct 2022
Aergia: Leveraging Heterogeneity in Federated Learning Systems Bart Cox L. Chen Jérémie Decouchant FedML 46 11 0 12 Oct 2022
FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settings Jean Ogier du Terrail Samy Ayed Edwige Cyffers Felix Grimberg Chaoyang He ... Sai Praneeth Karimireddy Marco Lorenzi Giovanni Neglia Marc Tommasi M. Andreux FedML 58 145 0 10 Oct 2022
Rethinking Normalization Methods in Federated Learning Zhixu Du Jingwei Sun Ang Li Pin-Yu Chen Jianyi Zhang H. Li Yiran Chen FedML 34 29 0 07 Oct 2022
DReS-FL: Dropout-Resilient Secure Federated Learning for Non-IID Clients via Secret Data Sharing Jiawei Shao Yuchang Sun Songze Li Jun Zhang OOD 49 38 0 06 Oct 2022
ISFL: Federated Learning for Non-i.i.d. Data with Local Importance Sampling Zheqi Zhu Yuchen Shi Pingyi Fan Chenghui Peng Khaled B. Letaief FedML 48 8 0 05 Oct 2022
Federated Training of Dual Encoding Models on Small Non-IID Client Datasets Raviteja Vemulapalli Warren Morningstar Philip Mansfield Hubert Eichner K. Singhal Arash Afkanpour Bradley Green FedML 71 2 0 30 Sep 2022
Kernel Normalized Convolutional Networks for Privacy-Preserving Machine Learning Reza Nasirigerdeh Javad Torkzadehmahani Daniel Rueckert Georgios Kaissis 22 1 0 30 Sep 2022
Momentum Tracking: Momentum Acceleration for Decentralized Deep Learning on Heterogeneous Data Yuki Takezawa Hang Bao Kenta Niwa Ryoma Sato Makoto Yamada 39 19 0 30 Sep 2022
Neighborhood Gradient Clustering: An Efficient Decentralized Learning Method for Non-IID Data Distributions Sai Aparna Aketi Sangamesh Kodge Kaushik Roy 30 4 0 28 Sep 2022
Federated Pruning: Improving Neural Network Efficiency with Federated Learning Rongmei Lin Yonghui Xiao Tien-Ju Yang Ding Zhao Li Xiong Giovanni Motta Franccoise Beaufays FedML 44 12 0 14 Sep 2022
Cocktail Party Attack: Breaking Aggregation-Based Privacy in Federated Learning using Independent Component Analysis Sanjay Kariyappa Chuan Guo Kiwan Maeng Wenjie Xiong G. E. Suh Moinuddin K. Qureshi Hsien-Hsin S. Lee FedML 31 29 0 12 Sep 2022
Non-IID Quantum Federated Learning with One-shot Communication Complexity Haimeng Zhao FedML 20 17 0 02 Sep 2022
Fed-FSNet: Mitigating Non-I.I.D. Federated Learning via Fuzzy Synthesizing Network Jingcai Guo Song Guo Jie Zhang Ziming Liu FedML 42 15 0 21 Aug 2022
Efficient Transmission and Reconstruction of Dependent Data Streams via Edge Sampling Joel Wolfrath A. Chandra 15 3 0 12 Aug 2022
FedDRL: Deep Reinforcement Learning-based Adaptive Aggregation for Non-IID Data in Federated Learning Nang Hung Nguyen Phi Le Nguyen D. Nguyen Trung Thanh Nguyen Thuy-Dung Nguyen H. Pham Truong Thao Nguyen FedML 69 24 0 04 Aug 2022
FedVARP: Tackling the Variance Due to Partial Client Participation in Federated Learning Divyansh Jhunjhunwala Pranay Sharma Aushim Nagarkatti Gauri Joshi FedML 52 59 0 28 Jul 2022
Handling Data Heterogeneity in Federated Learning via Knowledge Distillation and Fusion Xu Zhou Xinyu Lei Cong Yang Yichun Shi Xiao Zhang Jin-Yang Shi FedML 38 0 0 23 Jul 2022