An Exact Quantized Decentralized Gradient Descent Algorithm

29 June 2018

Amirhossein Reisizadeh

Papers citing "An Exact Quantized Decentralized Gradient Descent Algorithm"

26 / 26 papers shown

Title
Decentralized Low-Rank Fine-Tuning of Large Language Models Sajjad Ghiasvand Mahnoosh Alizadeh Ramtin Pedarsani ALM 71 0 0 26 Jan 2025
Differential error feedback for communication-efficient decentralized learning Roula Nassif Stefan Vlaski Marco Carpentiero Vincenzo Matta Ali H. Sayed 36 0 0 26 Jun 2024
Adaptive Consensus: A network pruning approach for decentralized optimization S. Shah A. Berahas Raghu Bollapragada 27 2 0 06 Sep 2023
Federated TD Learning over Finite-Rate Erasure Channels: Linear Speedup under Markovian Sampling Nicolò Dal Fabbro A. Mitra George J. Pappas FedML 35 12 0 14 May 2023
On the Convergence of Decentralized Federated Learning Under Imperfect Information Sharing Vishnu Pandi Chellapandi Antesh Upadhyay Abolfazl Hashemi Stanislaw H. .Zak FedML 32 31 0 19 Mar 2023
Distributed Optimization Methods for Multi-Robot Systems: Part II -- A Survey O. Shorinwa Trevor Halsted Javier Yu Mac Schwager 26 19 0 26 Jan 2023
Non-Coherent Over-the-Air Decentralized Gradient Descent Nicolò Michelusi 34 6 0 19 Nov 2022
Quantization for decentralized learning under subspace constraints Roula Nassif Stefan Vlaski Marco Carpentiero Vincenzo Matta Marc Antonini Ali H. Sayed 30 29 0 16 Sep 2022
Distributed Learning With Sparsified Gradient Differences Yicheng Chen Rick S. Blum Martin Takáč Brian M. Sadler 31 15 0 05 Feb 2022
BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression Haoyu Zhao Boyue Li Zhize Li Peter Richtárik Yuejie Chi 34 49 0 31 Jan 2022
Decentralized Multi-Task Stochastic Optimization With Compressed Communications Navjot Singh Xuanyu Cao Suhas Diggavi Tamer Basar 20 9 0 23 Dec 2021
Convergence Rates of Two-Time-Scale Gradient Descent-Ascent Dynamics for Solving Nonconvex Min-Max Problems Thinh T. Doan 22 15 0 17 Dec 2021
Communication-Efficient Distributed SGD with Compressed Sensing Yujie Tang V. Ramanathan Junshan Zhang Na Li FedML 28 8 0 15 Dec 2021
Distributed Adaptive Learning Under Communication Constraints Marco Carpentiero Vincenzo Matta Ali H. Sayed 29 17 0 03 Dec 2021
Decentralized Composite Optimization with Compression Yao Li Xiaorui Liu Jiliang Tang Ming Yan Kun Yuan 27 9 0 10 Aug 2021
Innovation Compression for Communication-efficient Distributed Optimization with Linear Convergence Jiaqi Zhang Keyou You Lihua Xie 24 32 0 14 May 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 37 33 0 04 Mar 2021
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients A. Mitra Rayana H. Jaafar George J. Pappas Hamed Hassani FedML 55 157 0 14 Feb 2021
Design and Analysis of Uplink and Downlink Communications for Federated Learning Sihui Zheng Cong Shen Xiang Chen 41 141 0 07 Dec 2020
A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! D. Kovalev Anastasia Koloskova Martin Jaggi Peter Richtárik Sebastian U. Stich 31 73 0 03 Nov 2020
FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous Tiers Zheng Chai Yujing Chen Ali Anwar Liang Zhao Yue Cheng Huzefa Rangwala FedML 26 122 0 12 Oct 2020
A Robust Gradient Tracking Method for Distributed Optimization over Directed Networks Shi Pu 29 38 0 31 Mar 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 41 493 0 23 Mar 2020
Gradient tracking and variance reduction for decentralized optimization and machine learning Ran Xin S. Kar U. Khan 19 10 0 13 Feb 2020
Q-GADMM: Quantized Group ADMM for Communication Efficient Decentralized Machine Learning Anis Elgabli Jihong Park Amrit Singh Bedi Chaouki Ben Issaid M. Bennis Vaneet Aggarwal 24 67 0 23 Oct 2019
Robust and Communication-Efficient Collaborative Learning Amirhossein Reisizadeh Hossein Taheri Aryan Mokhtari Hamed Hassani Ramtin Pedarsani 33 89 0 24 Jul 2019