Decentralized gradient methods: does topology matter?

Decentralized gradient methods: does topology matter?

28 February 2020

Giovanni Neglia

Papers citing "Decentralized gradient methods: does topology matter?"

16 / 16 papers shown

Title
Communication Optimization for Decentralized Learning atop Bandwidth-limited Edge Networks Tingyang Sun Tuan Nguyen Ting He 40 0 0 16 Apr 2025
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 38 0 0 25 Oct 2024
Faster Convergence with Less Communication: Broadcast-Based Subgraph Sampling for Decentralized Learning over Wireless Networks Daniel Pérez Herrera Zheng Chen Erik G. Larsson 26 1 0 24 Jan 2024
Homogenizing Non-IID datasets via In-Distribution Knowledge Distillation for Decentralized Learning Deepak Ravikumar Gobinda Saha Sai Aparna Aketi Kaushik Roy 21 2 0 09 Apr 2023
Beyond spectral gap (extended): The role of the topology in decentralized learning Thijs Vogels Hadrien Hendrikx Martin Jaggi 29 3 0 05 Jan 2023
Addressing Data Heterogeneity in Decentralized Learning via Topological Pre-processing Waqwoya Abebe Ali Jannesari 25 0 0 16 Dec 2022
Straggler-Resilient Differentially-Private Decentralized Learning Yauhen Yakimenka Chung-Wei Weng Hsuan-Yin Lin E. Rosnes J. Kliewer 29 6 0 06 Dec 2022
Aggregation in the Mirror Space (AIMS): Fast, Accurate Distributed Machine Learning in Military Settings Ryan Yang Haizhou Du Andre Wibisono Patrick Baker 13 1 0 28 Oct 2022
Beyond spectral gap: The role of the topology in decentralized learning Thijs Vogels Hadrien Hendrikx Martin Jaggi FedML 11 27 0 07 Jun 2022
Data-heterogeneity-aware Mixing for Decentralized Learning Yatin Dandi Anastasia Koloskova Martin Jaggi Sebastian U. Stich 38 18 0 13 Apr 2022
Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications Khaled B. Letaief Yuanming Shi Jianmin Lu Jianhua Lu 43 417 0 24 Nov 2021
Federated Multi-Task Learning under a Mixture of Distributions Othmane Marfoq Giovanni Neglia A. Bellet Laetitia Kameni Richard Vidal FedML 40 269 0 23 Aug 2021
D-Cliques: Compensating for Data Heterogeneity with Topology in Decentralized Federated Learning A. Bellet Anne-Marie Kermarrec Erick Lavoie FedML 28 21 0 15 Apr 2021
Consensus Control for Decentralized Deep Learning Lingjing Kong Tao R. Lin Anastasia Koloskova Martin Jaggi Sebastian U. Stich 19 76 0 09 Feb 2021
Privacy Amplification by Decentralization Edwige Cyffers A. Bellet FedML 44 39 0 09 Dec 2020
Throughput-Optimal Topology Design for Cross-Silo Federated Learning Othmane Marfoq Chuan Xu Giovanni Neglia Richard Vidal FedML 67 85 0 23 Oct 2020