NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization

28 April 2021

Ali Ramezani-Kebrya

Dan Alistarh

Papers citing "NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization"

5 / 5 papers shown

Title
Distributed Extra-gradient with Optimal Complexity and Communication Guarantees Ali Ramezani-Kebrya Kimon Antonakopoulos Igor Krawczuk Justin Deschenaux V. Cevher 36 2 0 17 Aug 2023
DoCoFL: Downlink Compression for Cross-Device Federated Learning Ron Dorfman S. Vargaftik Y. Ben-Itzhak Kfir Y. Levy FedML 24 18 0 01 Feb 2023
L-GreCo: Layerwise-Adaptive Gradient Compression for Efficient and Accurate Deep Learning Mohammadreza Alimohammadi I. Markov Elias Frantar Dan Alistarh 30 5 0 31 Oct 2022
Large-Scale Deep Learning Optimizations: A Comprehensive Survey Xiaoxin He Fuzhao Xue Xiaozhe Ren Yang You 27 14 0 01 Nov 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 35 31 0 04 Mar 2021