NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization

28 April 2021

Dan Alistarh

Papers citing "NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization"

3 / 3 papers shown

Title
Distributed Extra-gradient with Optimal Complexity and Communication Guarantees Ali Ramezani-Kebrya Kimon Antonakopoulos Igor Krawczuk Justin Deschenaux V. Cevher 36 2 0 17 Aug 2023
Large-Scale Deep Learning Optimizations: A Comprehensive Survey Xiaoxin He Fuzhao Xue Xiaozhe Ren Yang You 24 14 0 01 Nov 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 35 31 0 04 Mar 2021