Multi-Level Local SGD for Heterogeneous Hierarchical Networks

27 July 2020

Papers citing "Multi-Level Local SGD for Heterogeneous Hierarchical Networks"

18 / 18 papers shown

Title
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 63 499 0 23 Mar 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 268 42,038 0 03 Dec 2019
Hierarchical Federated Learning Across Heterogeneous Cellular Networks Mehdi Salehi Heydar Abad Emre Ozfatura Deniz Gunduz Ozgur Ercetin FedML 116 309 0 05 Sep 2019
On the Convergence of FedAvg on Non-IID Data Xiang Li Kaixuan Huang Wenhao Yang Shusen Wang Zhihua Zhang FedML 125 2,311 0 04 Jul 2019
MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling Jianyu Wang Anit Kumar Sahu Zhouyi Yang Gauri Joshi S. Kar 48 162 0 23 May 2019
Client-Edge-Cloud Hierarchical Federated Learning Lumin Liu Jun Zhang S. H. Song Khaled B. Letaief FedML 59 736 0 16 May 2019
A Distributed Hierarchical SGD Algorithm with Sparse Global Reduction Fan Zhou Guojing Cong 38 8 0 12 Mar 2019
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms Jianyu Wang Gauri Joshi 101 348 0 22 Aug 2018
Don't Use Large Mini-Batches, Use Local SGD Tao R. Lin Sebastian U. Stich Kumar Kshitij Patel Martin Jaggi 104 432 0 22 Aug 2018
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 152 1,056 0 24 May 2018
Adaptive Federated Learning in Resource Constrained Edge Computing Systems Shiqiang Wang Tiffany Tuor Theodoros Salonidis K. Leung C. Makaya T. He Kevin S. Chan 200 1,698 0 14 Apr 2018
Asynchronous Decentralized Parallel Stochastic Gradient Descent Xiangru Lian Wei Zhang Ce Zhang Ji Liu ODL 39 500 0 18 Oct 2017
How to scale distributed deep learning? Peter H. Jin Qiaochu Yuan F. Iandola Kurt Keutzer 3DH 46 136 0 14 Nov 2016
Parallel SGD: When does averaging help? Jian Zhang Christopher De Sa Ioannis Mitliagkas Christopher Ré MoMe FedML 70 109 0 23 Jun 2016
Optimization Methods for Large-Scale Machine Learning Léon Bottou Frank E. Curtis J. Nocedal 173 3,198 0 15 Jun 2016
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 234 17,328 0 17 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.4K 192,638 0 10 Dec 2015
SparkNet: Training Deep Networks in Spark Philipp Moritz Robert Nishihara Ion Stoica Michael I. Jordan 62 169 0 19 Nov 2015