Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication

1 February 2019

Papers citing "Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication"

50 / 96 papers shown

Title
Source Anonymity for Private Random Walk Decentralized Learning Maximilian Egger Svenja Lage Rawad Bitar Antonia Wachter-Zeh 36 0 0 11 May 2025
Hubs and Spokes Learning: Efficient and Scalable Collaborative Machine Learning Atul Sharma Kavindu Herath Saurabh Bagchi Chaoyue Liu Somali Chaterji FedML 42 0 0 29 Apr 2025
Accelerated Distributed Optimization with Compression and Error Feedback Yuan Gao Anton Rodomanov Jeremy Rack Sebastian U. Stich 51 0 0 11 Mar 2025
Scalable Decentralized Learning with Teleportation Yuki Takezawa Sebastian U. Stich 64 1 0 25 Jan 2025
Communication-efficient Vertical Federated Learning via Compressed Error Feedback Pedro Valdeira João Xavier Cláudia Soares Yuejie Chi FedML 45 4 0 20 Jun 2024
SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data Sakshi Choudhary Sai Aparna Aketi Kaushik Roy FedML 45 0 0 22 May 2024
Flattened one-bit stochastic gradient descent: compressed distributed optimization with controlled variance A. Stollenwerk Laurent Jacques FedML 23 0 0 17 May 2024
Scale-Robust Timely Asynchronous Decentralized Learning Purbesh Mitra S. Ulukus 22 1 0 30 Apr 2024
Generalized Policy Learning for Smart Grids: FL TRPO Approach Yunxiang Li Nicolas Mauricio Cuadrado Samuel Horváth Martin Takáč 30 0 0 27 Mar 2024
Gradient Coding in Decentralized Learning for Evading Stragglers Chengxi Li Mikael Skoglund 37 1 0 06 Feb 2024
Faster Convergence with Less Communication: Broadcast-Based Subgraph Sampling for Decentralized Learning over Wireless Networks Daniel Pérez Herrera Zheng Chen Erik G. Larsson 18 1 0 24 Jan 2024
Compressed and Sparse Models for Non-Convex Decentralized Learning Andrew Campbell Hang Liu Leah Woldemariam Anna Scaglione 20 0 0 09 Nov 2023
Communication Compression for Byzantine Robust Learning: New Efficient Algorithms and Improved Rates Ahmad Rammal Kaja Gruntkowska Nikita Fedin Eduard A. Gorbunov Peter Richtárik 45 5 0 15 Oct 2023
Convergence Analysis of Decentralized ASGD Mauro Dalle Lucca Tosi Martin Theobald 29 2 0 07 Sep 2023
Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregation Tomàs Ortega Hamid Jafarkhani FedML 30 6 0 01 Aug 2023
Get More for Less in Decentralized Learning Systems Akash Dhasade Anne-Marie Kermarrec Rafael Pires Rishi Sharma Milos Vujasinovic Jeffrey Wigger 26 7 0 07 Jun 2023
Beyond Exponential Graph: Communication-Efficient Topologies for Decentralized Learning via Finite-time Convergence Yuki Takezawa Ryoma Sato Han Bao Kenta Niwa M. Yamada 31 9 0 19 May 2023
Convergence and Privacy of Decentralized Nonconvex Optimization with Gradient Clipping and Communication Compression Boyue Li Yuejie Chi 21 12 0 17 May 2023
Decentralized Learning Made Practical with Client Sampling M. Vos Akash Dhasade Anne-Marie Kermarrec Erick Lavoie J. Pouwelse Rishi Sharma 29 1 0 27 Feb 2023
Quantized Low-Rank Multivariate Regression with Random Dithering Junren Chen Yueqi Wang Michael Kwok-Po Ng 27 4 0 22 Feb 2023
Gossiped and Quantized Online Multi-Kernel Learning Tomàs Ortega Hamid Jafarkhani 32 5 0 24 Jan 2023
CEDAS: A Compressed Decentralized Stochastic Gradient Method with Improved Convergence Kun-Yen Huang Shin-Yi Pu 35 9 0 14 Jan 2023
Decentralized Nonconvex Optimization with Guaranteed Privacy and Accuracy Yongqiang Wang Tamer Basar 21 21 0 14 Dec 2022
An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization Le‐Yu Chen Haishan Ye Luo Luo 65 5 0 05 Dec 2022
Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challenges Enrique Tomás Martínez Beltrán Mario Quiles Pérez Pedro Miguel Sánchez Sánchez Sergio López Bernal Gérome Bovet M. Pérez Gregorio Martínez Pérez Alberto Huertas Celdrán FedML 35 222 0 15 Nov 2022
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming Parvin Nazari Ahmad Mousavi Davoud Ataee Tarzanagh George Michailidis 28 4 0 08 Nov 2022
Secure Distributed Optimization Under Gradient Attacks Shuhua Yu S. Kar 32 13 0 28 Oct 2022
Double Averaging and Gradient Projection: Convergence Guarantees for Decentralized Constrained Optimization Firooz Shahriari-Mehr Ashkan Panahi 17 1 0 06 Oct 2022
Quantization for decentralized learning under subspace constraints Roula Nassif Stefan Vlaski Marco Carpentiero Vincenzo Matta Marc Antonini Ali H. Sayed 30 29 0 16 Sep 2022
The END: Estimation Network Design for games under partial-decision information M. Bianchi Sergio Grammatico 16 4 0 24 Aug 2022
Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees Jue Wang Binhang Yuan Luka Rimanic Yongjun He Tri Dao Beidi Chen Christopher Ré Ce Zhang AI4CE 24 11 0 02 Jun 2022
Decentralized Training of Foundation Models in Heterogeneous Environments Binhang Yuan Yongjun He Jared Davis Tianyi Zhang Tri Dao Beidi Chen Percy Liang Christopher Ré Ce Zhang 30 90 0 02 Jun 2022
Communication-Efficient Distributionally Robust Decentralized Learning Matteo Zecchin Marios Kountouris David Gesbert 22 9 0 31 May 2022
Confederated Learning: Federated Learning with Decentralized Edge Servers Bin Wang Jun Fang Hongbin Li Xiaojun Yuan Qing Ling FedML 26 23 0 30 May 2022
Efficient-Adam: Communication-Efficient Distributed Adam Congliang Chen Li Shen Wei Liu Zhi-Quan Luo 34 19 0 28 May 2022
Decentralized Stochastic Optimization with Inherent Privacy Protection Yongqiang Wang H. Vincent Poor 24 37 0 08 May 2022
BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression Haoyu Zhao Boyue Li Zhize Li Peter Richtárik Yuejie Chi 29 48 0 31 Jan 2022
Decentralized Multi-Task Stochastic Optimization With Compressed Communications Navjot Singh Xuanyu Cao Suhas Diggavi Tamer Basar 18 9 0 23 Dec 2021
Personalized On-Device E-health Analytics with Decentralized Block Coordinate Descent Guanhua Ye Hongzhi Yin Tong Chen Miao Xu Quoc Viet Hung Nguyen Jiangning Song 41 9 0 17 Dec 2021
On Convergence of Federated Averaging Langevin Dynamics Wei Deng Qian Zhang Yi Ma Zhao Song Guang Lin FedML 30 16 0 09 Dec 2021
Distributed Adaptive Learning Under Communication Constraints Marco Carpentiero Vincenzo Matta Ali H. Sayed 29 17 0 03 Dec 2021
p2pGNN: A Decentralized Graph Neural Network for Node Classification in Peer-to-Peer Networks Emmanouil Krasanakis Symeon Papadopoulos I. Kompatsiaris GNN 14 7 0 29 Nov 2021
Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications Khaled B. Letaief Yuanming Shi Jianmin Lu Jianhua Lu 43 416 0 24 Nov 2021
BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning Bicheng Ying Kun Yuan Hanbin Hu Yiming Chen W. Yin FedML 39 27 0 08 Nov 2021
DFL: High-Performance Blockchain-Based Federated Learning Yongding Tian Zhuoran Guo Jiaxuan Zhang Zaid Al-Ars OOD FedML 29 10 0 28 Oct 2021
Exponential Graph is Provably Efficient for Decentralized Deep Training Bicheng Ying Kun Yuan Yiming Chen Hanbin Hu Pan Pan W. Yin FedML 39 83 0 26 Oct 2021
A Unified and Refined Convergence Analysis for Non-Convex Decentralized Learning Sulaiman A. Alghunaim Kun Yuan 25 57 0 19 Oct 2021
Scalable Average Consensus with Compressed Communications Taha Toghani César A. Uribe 22 7 0 14 Sep 2021
On the Convergence of Decentralized Adaptive Gradient Methods Xiangyi Chen Belhal Karimi Weijie Zhao Ping Li 23 21 0 07 Sep 2021
Decentralized Composite Optimization with Compression Yao Li Xiaorui Liu Jiliang Tang Ming Yan Kun Yuan 24 9 0 10 Aug 2021