DIGEST: Fast and Communication Efficient Decentralized Learning with Local Updates

14 July 2023

Papers citing "DIGEST: Fast and Communication Efficient Decentralized Learning with Local Updates"

16 / 16 papers shown

Title
Locally Asynchronous Stochastic Gradient Descent for Decentralised Deep Learning Tomer Avidor Nadav Tal-Israel 18 2 0 24 Mar 2022
Communication-efficient SGD: From Local SGD to One-Shot Averaging Artin Spiridonoff Alexander Olshevsky I. Paschalidis FedML 74 20 0 09 Jun 2021
Private Weighted Random Walk Stochastic Gradient Descent Ghadir Ayache S. E. Rouayheb FedML 34 19 0 03 Sep 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 83 506 0 23 Mar 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 245 6,252 0 10 Dec 2019
Unified Optimal Analysis of the (Stochastic) Gradient Method Sebastian U. Stich 54 113 0 09 Jul 2019
Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication Anastasia Koloskova Sebastian U. Stich Martin Jaggi FedML 79 510 0 01 Feb 2019
Stochastic Gradient Push for Distributed Deep Learning Mahmoud Assran Nicolas Loizou Nicolas Ballas Michael G. Rabbat 76 346 0 27 Nov 2018
On Markov Chain Gradient Descent Tao Sun Yuejiao Sun W. Yin BDL 44 102 0 12 Sep 2018
Don't Use Large Mini-Batches, Use Local SGD Tao R. Lin Sebastian U. Stich Kumar Kshitij Patel Martin Jaggi 117 432 0 22 Aug 2018
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 170 1,063 0 24 May 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 57 197 0 03 Mar 2018
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 406 17,468 0 17 Feb 2016
Federated Optimization:Distributed Optimization Beyond the Datacenter Jakub Konecný H. B. McMahan Daniel Ramage FedML 115 738 0 11 Nov 2015
Internet of Things (IoT): A Vision, Architectural Elements, and Future Directions J. Gubbi Rajkumar Buyya S. Marusic M. Palaniswami 121 10,908 0 01 Jul 2012
Diffusion Adaptation Strategies for Distributed Optimization and Learning over Networks Jianshu Chen Ali H. Sayed 96 654 0 31 Oct 2011