v1v2 (latest)

Throughput-Optimal Topology Design for Cross-Silo Federated Learning

23 October 2020

Papers citing "Throughput-Optimal Topology Design for Cross-Silo Federated Learning"

42 / 42 papers shown

Title
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 85 514 0 23 Mar 2020
Decentralized gradient methods: does topology matter? Giovanni Neglia Chuan Xu Don Towsley G. Calbi 64 52 0 28 Feb 2020
Is Local SGD Better than Minibatch SGD? Blake E. Woodworth Kumar Kshitij Patel Sebastian U. Stich Zhen Dai Brian Bullins H. B. McMahan Ohad Shamir Nathan Srebro FedML 74 254 0 18 Feb 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 268 6,285 0 10 Dec 2019
SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum Jianyu Wang Vinayak Tantia Nicolas Ballas Michael G. Rabbat 76 201 0 01 Oct 2019
Federated Learning: Challenges, Methods, and Future Directions Tian Li Anit Kumar Sahu Ameet Talwalkar Virginia Smith FedML 132 4,540 0 21 Aug 2019
Asymptotic Network Independence in Distributed Stochastic Optimization for Machine Learning Shi Pu Alexander Olshevsky I. Paschalidis 80 43 0 28 Jun 2019
MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling Jianyu Wang Anit Kumar Sahu Zhouyi Yang Gauri Joshi S. Kar 76 163 0 23 May 2019
Incentive Design for Efficient Federated Learning in Mobile Networks: A Contract Theory Approach Jiawen Kang Zehui Xiong Dusit Niyato Han Yu Ying-Chang Liang Dong In Kim FedML 78 218 0 16 May 2019
Robust and Communication-Efficient Federated Learning from Non-IID Data Felix Sattler Simon Wiedemann K. Müller Wojciech Samek FedML 74 1,362 0 07 Mar 2019
Hop: Heterogeneity-Aware Decentralized Training Qinyi Luo Jinkun Lin Youwei Zhuo Xuehai Qian 48 52 0 04 Feb 2019
Towards Federated Learning at Scale: System Design Keith Bonawitz Hubert Eichner W. Grieskamp Dzmitry Huba A. Ingerman ... H. B. McMahan Timon Van Overveldt David Petrou Daniel Ramage Jason Roselander FedML 126 2,674 0 04 Feb 2019
Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication Anastasia Koloskova Sebastian U. Stich Martin Jaggi FedML 83 511 0 01 Feb 2019
Peer-to-peer Federated Learning on Graphs Anusha Lalitha O. Kilinc T. Javidi F. Koushanfar OOD FedML 112 186 0 31 Jan 2019
Expanding the Reach of Federated Learning by Reducing Client Resource Requirements S. Caldas Jakub Konecný H. B. McMahan Ameet Talwalkar 80 450 0 18 Dec 2018
Federated Optimization in Heterogeneous Networks Tian Li Anit Kumar Sahu Manzil Zaheer Maziar Sanjabi Ameet Talwalkar Virginia Smith FedML 190 5,220 0 14 Dec 2018
LEAF: A Benchmark for Federated Settings S. Caldas Sai Meher Karthik Duddu Peter Wu Tian Li Jakub Konecný H. B. McMahan Virginia Smith Ameet Talwalkar FedML 158 1,423 0 03 Dec 2018
Stochastic Gradient Push for Distributed Deep Learning Mahmoud Assran Nicolas Loizou Nicolas Ballas Michael G. Rabbat 91 348 0 27 Nov 2018
Federated Learning in Distributed Medical Databases: Meta-Analysis of Large-Scale Subcortical Brain Data R. SantiagoS.Silva B. Gutman E. Romero P. Thompson Andre Altmann Marco Lorenzi FedML 51 180 0 19 Oct 2018
Adaptive Communication Strategies to Achieve the Best Error-Runtime Trade-off in Local-Update SGD Jianyu Wang Gauri Joshi FedML 83 232 0 19 Oct 2018
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms Jianyu Wang Gauri Joshi 172 349 0 22 Aug 2018
Don't Use Large Mini-Batches, Use Local SGD Tao R. Lin Sebastian U. Stich Kumar Kshitij Patel Martin Jaggi 119 432 0 22 Aug 2018
ATOMO: Communication-efficient Learning via Atomic Sparsification Hongyi Wang Scott Sievert Zachary B. Charles Shengchao Liu S. Wright Dimitris Papailiopoulos 70 354 0 11 Jun 2018
Adaptive Federated Learning in Resource Constrained Edge Computing Systems Shiqiang Wang Tiffany Tuor Theodoros Salonidis K. Leung C. Makaya T. He Kevin S. Chan 254 1,716 0 14 Apr 2018
D $^2$ : Decentralized Training over Decentralized Data Hanlin Tang Xiangru Lian Ming Yan Ce Zhang Ji Liu 42 352 0 19 Mar 2018
Straggler Mitigation in Distributed Optimization Through Data Encoding C. Karakuş Yifan Sun Suhas Diggavi W. Yin 53 146 0 14 Nov 2017
Near-Optimal Straggler Mitigation for Distributed Gradient Methods Songze Li Seyed Mohammadreza Mousavi Kalan A. Avestimehr Mahdi Soltanolkotabi 64 98 0 27 Oct 2017
Asynchronous Decentralized Parallel Stochastic Gradient Descent Xiangru Lian Wei Zhang Ce Zhang Ji Liu ODL 48 500 0 18 Oct 2017
Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization A. Nedić Alexander Olshevsky Michael G. Rabbat 74 513 0 26 Sep 2017
Collaborative Deep Learning in Fixed Topology Networks Zhanhong Jiang Aditya Balu Chinmay Hegde Soumik Sarkar FedML 59 181 0 23 Jun 2017
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent Xiangru Lian Ce Zhang Huan Zhang Cho-Jui Hsieh Wei Zhang Ji Liu 50 1,235 0 25 May 2017
Optimal algorithms for smooth and strongly convex distributed optimization in networks Kevin Scaman Francis R. Bach Sébastien Bubeck Y. Lee Laurent Massoulié 79 331 0 28 Feb 2017
Membership Inference Attacks against Machine Learning Models Reza Shokri M. Stronati Congzheng Song Vitaly Shmatikov SLR MIALM MIACV 272 4,159 0 18 Oct 2016
Decentralized Collaborative Learning of Personalized Models over Networks Paul Vanhaesebrouck A. Bellet Marc Tommasi FedML 52 231 0 17 Oct 2016
Federated Optimization: Distributed Machine Learning for On-Device Intelligence Jakub Konecný H. B. McMahan Daniel Ramage Peter Richtárik FedML 145 1,906 0 08 Oct 2016
Deep Learning with Differential Privacy Martín Abadi Andy Chu Ian Goodfellow H. B. McMahan Ilya Mironov Kunal Talwar Li Zhang FedML SyDa 216 6,162 0 01 Jul 2016
Gossip Dual Averaging for Decentralized Optimization of Pairwise Functions Igor Colin A. Bellet Joseph Salmon Stephan Clémençon FedML 67 107 0 08 Jun 2016
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 408 17,593 0 17 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,426 0 10 Dec 2015
Federated Optimization:Distributed Optimization Beyond the Datacenter Jakub Konecný H. B. McMahan Daniel Ramage FedML 128 739 0 11 Nov 2015
ExtraPush for convex smooth decentralized optimization over directed networks Jinshan Zeng W. Yin 80 73 0 10 Nov 2015
On the Properties of Neural Machine Translation: Encoder-Decoder Approaches Kyunghyun Cho B. V. Merrienboer Dzmitry Bahdanau Yoshua Bengio AI4CE AIMat 259 6,786 0 03 Sep 2014