Cross-Gradient Aggregation for Decentralized Learning from Non-IID data

Cross-Gradient Aggregation for Decentralized Learning from Non-IID data

2 March 2021

Yasaman Esfandiari

Aditya Balu

Papers citing "Cross-Gradient Aggregation for Decentralized Learning from Non-IID data"

10 / 10 papers shown

Title
PDSL: Privacy-Preserved Decentralized Stochastic Learning with Heterogeneous Data Distribution Lina Wang Yunsheng Yuan Chunxiao Wang Feng Li FedML 43 0 0 31 Mar 2025
SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data Sakshi Choudhary Sai Aparna Aketi Kaushik Roy FedML 45 0 0 22 May 2024
DIMAT: Decentralized Iterative Merging-And-Training for Deep Learning Models Nastaran Saadati Minh Pham Nasla Saleem Joshua R. Waite Aditya Balu Zhanhong Jiang Chinmay Hegde Soumik Sarkar MoMe 47 1 0 11 Apr 2024
Averaging Rate Scheduler for Decentralized Learning on Heterogeneous Data Sai Aparna Aketi Sakshi Choudhary Kaushik Roy 32 1 0 05 Mar 2024
Structured Cooperative Learning with Graphical Model Priors Shuang-Yang Li Dinesh Manocha Xinmei Tian Dacheng Tao 38 0 0 16 Jun 2023
Homogenizing Non-IID datasets via In-Distribution Knowledge Distillation for Decentralized Learning Deepak Ravikumar Gobinda Saha Sai Aparna Aketi Kaushik Roy 21 1 0 09 Apr 2023
CoDeC: Communication-Efficient Decentralized Continual Learning Sakshi Choudhary Sai Aparna Aketi Gobinda Saha Kaushik Roy CLL 50 3 0 27 Mar 2023
Domain-invariant Feature Exploration for Domain Generalization Wang Lu Jindong Wang Haoliang Li Yiqiang Chen Xing Xie OOD 30 70 0 25 Jul 2022
D-Cliques: Compensating for Data Heterogeneity with Topology in Decentralized Federated Learning A. Bellet Anne-Marie Kermarrec Erick Lavoie FedML 28 21 0 15 Apr 2021
Optimal Distributed Online Prediction using Mini-Batches O. Dekel Ran Gilad-Bachrach Ohad Shamir Lin Xiao 179 683 0 07 Dec 2010