The Non-IID Data Quagmire of Decentralized Machine Learning

1 October 2019

Papers citing "The Non-IID Data Quagmire of Decentralized Machine Learning"

50 / 291 papers shown

Title
FedGCS: A Generative Framework for Efficient Client Selection in Federated Learning via Gradient-based Optimization Zhiyuan Ning Chunlin Tian Meng Xiao Wei Fan Pengyang Wang Li Li P. Wang Yuanchun Zhou 39 7 0 10 May 2024
Fast Decentralized Gradient Tracking for Federated Minimax Optimization with Local Updates Chris Junchi Li 52 0 0 07 May 2024
A Mutual Information Perspective on Federated Contrastive Learning Christos Louizos M. Reisser Denis Korzhenkov SSL FedML 58 2 0 03 May 2024
Robust Decentralized Learning with Local Updates and Gradient Tracking Sajjad Ghiasvand Amirhossein Reisizadeh Mahnoosh Alizadeh Ramtin Pedarsani 47 3 0 02 May 2024
A Universal Metric of Dataset Similarity for Cross-silo Federated Learning Ahmed Elhussein Gamze Gursoy FedML OOD 49 2 0 29 Apr 2024
Apodotiko: Enabling Efficient Serverless Federated Learning in Heterogeneous Environments Mohak Chadha Alexander Jensen Jianfeng Gu Osama Abboud Michael Gerndt 61 0 0 22 Apr 2024
Beyond Noise: Privacy-Preserving Decentralized Learning with Virtual Nodes Sayan Biswas Mathieu Even Anne-Marie Kermarrec Laurent Massoulie Rafael Pires Rishi Sharma M. Vos 59 3 0 15 Apr 2024
MAPL: Model Agnostic Peer-to-peer Learning Sayak Mukherjee Andrea Simonetto Hadi Jamali Rad 64 0 0 28 Mar 2024
Smart Information Exchange for Unsupervised Federated Learning via Reinforcement Learning Seohyun Lee Anindya Bijoy Das Satyavrat Wagle Christopher G. Brinton FedML 35 0 0 15 Feb 2024
Training Heterogeneous Client Models using Knowledge Distillation in Serverless Federated Learning Mohak Chadha Pulkit Khera Jianfeng Gu Osama Abboud Michael Gerndt FedML 38 4 0 11 Feb 2024
Relaxed Contrastive Learning for Federated Learning Seonguk Seo Jinkyu Kim Geeho Kim Bohyung Han FedML 67 8 0 10 Jan 2024
FedNS: A Fast Sketching Newton-Type Algorithm for Federated Learning Jian Li Yong Liu Wei Wang Haoran Wu Weiping Wang FedML 61 2 0 05 Jan 2024
DCFL: Non-IID awareness Data Condensation aided Federated Learning Shaohan Sha YaFeng Sun FedML DD 53 0 0 21 Dec 2023
DePRL: Achieving Linear Convergence Speedup in Personalized Decentralized Learning with Shared Representations Guojun Xiong Gang Yan Shiqiang Wang Jian Li 58 6 0 17 Dec 2023
Feature Norm Regularized Federated Learning: Transforming Skewed Distributions into Global Insights Ke Hu Weidong Qiu Peng Tang 75 0 0 12 Dec 2023
Point Transformer with Federated Learning for Predicting Breast Cancer HER2 Status from Hematoxylin and Eosin-Stained Whole Slide Images Baowei Li Zhenyu Liu Lizhi Shao Bensheng Qiu Hong Bu Jie Tian OOD MedIm 42 6 0 11 Dec 2023
Communication-Efficient Heterogeneous Federated Learning with Generalized Heavy-Ball Momentum Riccardo Zaccone Carlo Masone Marco Ciccone FedML 58 2 0 30 Nov 2023
CDMPP: A Device-Model Agnostic Framework for Latency Prediction of Tensor Programs Hanpeng Hu Junwei Su Juntao Zhao Size Zheng Yibo Zhu Yanghua Peng Chuan Wu 42 1 0 16 Nov 2023
Leveraging Foundation Models to Improve Lightweight Clients in Federated Learning Xidong Wu Wan-Yi Lin Devin Willmott Filipe Condessa Yufei Huang Zhenzhen Li Madan Ravi Ganesh FedML 52 4 0 14 Nov 2023
Compressed and Sparse Models for Non-Convex Decentralized Learning Andrew Campbell Hang Liu Leah Woldemariam Anna Scaglione 33 0 0 09 Nov 2023
Holistic Transfer: Towards Non-Disruptive Fine-Tuning with Partial Target Data Cheng-Hao Tu Hong-You Chen Zheda Mai Shitian Zhao Vardaan Pahuja Tanya Berger-Wolf Song Gao Charles V. Stewart Yu-Chuan Su Wei-Lun Chao CLL 46 4 0 02 Nov 2023
EcoLearn: Optimizing the Carbon Footprint of Federated Learning Talha Mehboob Noman Bashir Jesus Omana Iglesias Michael Zink David Irwin 43 0 0 27 Oct 2023
Cross-feature Contrastive Loss for Decentralized Deep Learning on Heterogeneous Data Sai Aparna Aketi Kaushik Roy FedML 51 2 0 24 Oct 2023
Handling Data Heterogeneity via Architectural Design for Federated Visual Recognition Sara Pieri Jose Renato Restom Samuel Horvath Hisham Cholakkal FedML 32 8 0 23 Oct 2023
FedConv: Enhancing Convolutional Neural Networks for Handling Data Heterogeneity in Federated Learning Peiran Xu Zeyu Wang Jieru Mei Liangqiong Qu Alan Yuille Cihang Xie Yuyin Zhou FedML 35 1 0 06 Oct 2023
Epidemic Learning: Boosting Decentralized Learning with Randomized Communication M. Vos Sadegh Farhadkhani R. Guerraoui Anne-Marie Kermarrec Rafael Pires Rishi Sharma 40 15 0 03 Oct 2023
Window-based Model Averaging Improves Generalization in Heterogeneous Federated Learning Debora Caldarola Barbara Caputo Marco Ciccone FedML 23 7 0 02 Oct 2023
Robot Fleet Learning via Policy Merging Lirui Wang Kaiqing Zhang Allan Zhou Max Simchowitz Russ Tedrake 72 4 0 02 Oct 2023
Deep Model Fusion: A Survey Weishi Li Yong Peng Miao Zhang Liang Ding Han Hu Li Shen FedML MoMe 46 54 0 27 Sep 2023
Mitigating Group Bias in Federated Learning for Heterogeneous Devices Khotso Selialia Yasra Chandio Fatima M. Anwar FedML 45 2 0 13 Sep 2023
Heterogeneous Decentralized Machine Unlearning with Seed Model Distillation Guanhua Ye Tong Chen Quoc Viet Hung Nguyen Hongzhi Yin MU 48 5 0 25 Aug 2023
GradientCoin: A Peer-to-Peer Decentralized Large Language Models Yeqi Gao Zhao Song Junze Yin 41 18 0 21 Aug 2023
Understanding the Role of Layer Normalization in Label-Skewed Federated Learning Guojun Zhang Mahdi Beitollahi Alex Bie Xi Chen FedML MLT AI4CE 27 1 0 18 Aug 2023
Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregation Tomàs Ortega Hamid Jafarkhani FedML 49 6 0 01 Aug 2023
Efficient Federated Learning via Local Adaptive Amended Optimizer with Linear Speedup Yan Sun Li Shen Hao Sun Liang Ding Dacheng Tao FedML 29 17 0 30 Jul 2023
A Practical Recipe for Federated Learning Under Statistical Heterogeneity Experimental Design Mahdi Morafah Weijia Wang Bill Lin FedML 40 8 0 28 Jul 2023
Scaff-PD: Communication Efficient Fair and Robust Federated Learning Yaodong Yu Sai Praneeth Karimireddy Yi-An Ma Michael I. Jordan FedML 57 4 0 25 Jul 2023
FedBug: A Bottom-Up Gradual Unfreezing Framework for Federated Learning Chia-Hsiang Kao Yu-Chiang Frank Wang FedML 54 1 0 19 Jul 2023
FedCME: Client Matching and Classifier Exchanging to Handle Data Heterogeneity in Federated Learning Junjun Nie Danyang Xiao Lei Yang Weigang Wu FedML 43 0 0 17 Jul 2023
NIPD: A Federated Learning Person Detection Benchmark Based on Real-World Non-IID Data Kangning Yin Zhen Ding Zhi-hua Dong Dongsheng Chen Jie Fu Xinhui Ji Guangqiang Yin Zhiguo Wang 25 3 0 28 Jun 2023
Towards Sybil Resilience in Decentralized Learning Thomas Werthenbach J. Pouwelse AAML 35 2 0 26 Jun 2023
FedSelect: Customized Selection of Parameters for Fine-Tuning during Personalized Federated Learning Rishub Tamirisa John Won Chengjun Lu Ron Arel Andy Zhou FedML 43 3 0 23 Jun 2023
Structured Cooperative Learning with Graphical Model Priors Shuang-Yang Li Dinesh Manocha Xinmei Tian Dacheng Tao 49 0 0 16 Jun 2023
Straggler-Resilient Decentralized Learning via Adaptive Asynchronous Updates Guojun Xiong Gang Yan Shiqiang Wang Jian Li 34 3 0 11 Jun 2023
FedWon: Triumphing Multi-domain Federated Learning Without Normalization Weiming Zhuang Lingjuan Lyu 32 9 0 09 Jun 2023
Understanding How Consistency Works in Federated Learning via Stage-wise Relaxed Initialization Yan Sun Li Shen Dacheng Tao FedML 38 14 0 09 Jun 2023
Get More for Less in Decentralized Learning Systems Akash Dhasade Anne-Marie Kermarrec Rafael Pires Rishi Sharma Milos Vujasinovic Jeffrey Wigger 39 7 0 07 Jun 2023
Federated Conformal Predictors for Distributed Uncertainty Quantification Charles Lu Yaodong Yu Sai Praneeth Karimireddy Michael I. Jordan Ramesh Raskar FedML 50 23 0 27 May 2023
Detecting Dataset Drift and Non-IID Sampling via k-Nearest Neighbors Jesse Cummings Elías Snorrason Jonas W. Mueller 17 1 0 25 May 2023
Towards More Suitable Personalization in Federated Learning via Decentralized Partial Model Training Yi Shi Yingqi Liu Yan Sun Zihao Lin Li Shen Xueqian Wang Dacheng Tao FedML 59 10 0 24 May 2023