Smoothness Matrices Beat Smoothness Constants: Better Communication Compression Techniques for Distributed Optimization

14 February 2021

Papers citing "Smoothness Matrices Beat Smoothness Constants: Better Communication Compression Techniques for Distributed Optimization"

5 / 5 papers shown

Title
GradSkip: Communication-Accelerated Local Gradient Methods with Better Computational Complexity Artavazd Maranjyan M. Safaryan Peter Richtárik 34 13 0 28 Oct 2022
Communication Acceleration of Local Gradient Methods via an Accelerated Primal-Dual Algorithm with Inexact Prox Abdurakhmon Sadiev D. Kovalev Peter Richtárik 35 20 0 08 Jul 2022
Federated Optimization Algorithms with Random Reshuffling and Gradient Compression Abdurakhmon Sadiev Grigory Malinovsky Eduard A. Gorbunov Igor Sokolov Ahmed Khaled Konstantin Burlachenko Peter Richtárik FedML 18 21 0 14 Jun 2022
Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees Jue Wang Binhang Yuan Luka Rimanic Yongjun He Tri Dao Beidi Chen Christopher Ré Ce Zhang AI4CE 31 11 0 02 Jun 2022
Linearly Converging Error Compensated SGD Eduard A. Gorbunov D. Kovalev Dmitry Makarenko Peter Richtárik 163 78 0 23 Oct 2020