BROADCAST: Reducing Both Stochastic and Compression Noise to Robustify Communication-Efficient Federated Learning

14 April 2021

Papers citing "BROADCAST: Reducing Both Stochastic and Compression Noise to Robustify Communication-Efficient Federated Learning"

34 / 34 papers shown

Title
Decentralized Federated Learning: Balancing Communication and Computing Costs Wei Liu Li Chen Wenyi Zhang FedML 47 111 0 26 Jul 2021
Learning from History for Byzantine Robust Optimization Sai Praneeth Karimireddy Lie He Martin Jaggi FedML AAML 67 180 0 18 Dec 2020
A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! D. Kovalev Anastasia Koloskova Martin Jaggi Peter Richtárik Sebastian U. Stich 70 75 0 03 Nov 2020
Byzantine-Resilient Secure Federated Learning Jinhyun So Başak Güler A. Avestimehr FedML 52 243 0 21 Jul 2020
Communication-Efficient Robust Federated Learning Over Heterogeneous Datasets Yanjie Dong G. Giannakis Tianyi Chen Julian Cheng Md. Jahangir Hossain Victor C. M. Leung FedML 39 14 0 17 Jun 2020
Byzantine-Robust Learning on Heterogeneous Datasets via Bucketing Sai Praneeth Karimireddy Lie He Martin Jaggi FedML OOD 65 141 0 16 Jun 2020
Federated Variance-Reduced Stochastic Gradient Descent with Robustness to Byzantine Attacks Zhaoxian Wu Qing Ling Tianyi Chen G. Giannakis FedML AAML 78 183 0 29 Dec 2019
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 234 6,252 0 10 Dec 2019
Byzantine Resilient Non-Convex SVRG with Distributed Batch Gradient Computations Prashant Khanduri Saikiran Bulusu Pranay Sharma P. Varshney 51 10 0 10 Dec 2019
Communication-Efficient and Byzantine-Robust Distributed Learning with Error Feedback Avishek Ghosh R. Maity S. Kadhe A. Mazumdar Kannan Ramchandran FedML 38 27 0 21 Nov 2019
A Double Residual Compression Algorithm for Efficient Distributed Learning Xiaorui Liu Yao Li Jiliang Tang Ming Yan 51 50 0 16 Oct 2019
Communication-Efficient Distributed Learning via Lazily Aggregated Quantized Gradients Jun Sun Tianyi Chen G. Giannakis Zaiyue Yang 52 94 0 17 Sep 2019
BRIDGE: Byzantine-resilient Decentralized Gradient Descent Cheng Fang Zhixiong Yang W. Bajwa 54 98 0 21 Aug 2019
On the Convergence of FedAvg on Non-IID Data Xiang Li Kaixuan Huang Wenhao Yang Shusen Wang Zhihua Zhang FedML 138 2,333 0 04 Jul 2019
DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression Hanlin Tang Xiangru Lian Chen Yu Tong Zhang Ji Liu 43 219 0 15 May 2019
Error Feedback Fixes SignSGD and other Gradient Compression Schemes Sai Praneeth Karimireddy Quentin Rebjock Sebastian U. Stich Martin Jaggi 58 502 0 28 Jan 2019
Distributed Learning with Compressed Gradient Differences Konstantin Mishchenko Eduard A. Gorbunov Martin Takáč Peter Richtárik 93 200 0 26 Jan 2019
RSA: Byzantine-Robust Stochastic Aggregation Methods for Distributed Learning from Heterogeneous Datasets Liping Li Canran Xu Xiangnan He Yixin Cao Tat-Seng Chua FedML 109 595 0 09 Nov 2018
Sparsified SGD with Memory Sebastian U. Stich Jean-Baptiste Cordonnier Martin Jaggi 71 750 0 20 Sep 2018
Don't Use Large Mini-Batches, Use Local SGD Tao R. Lin Sebastian U. Stich Kumar Kshitij Patel Martin Jaggi 111 432 0 22 Aug 2018
The Internet of Things: Secure Distributed Inference Yuan Chen S. Kar José M. F. Moura 99 60 0 24 Jun 2018
Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization Jiaxiang Wu Weidong Huang Junzhou Huang Tong Zhang 74 236 0 21 Jun 2018
LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning Tianyi Chen G. Giannakis Tao Sun W. Yin 53 298 0 25 May 2018
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 166 1,061 0 24 May 2018
D $^2$ : Decentralized Training over Decentralized Data Hanlin Tang Xiangru Lian Ming Yan Ce Zhang Ji Liu 31 350 0 19 Mar 2018
Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates Dong Yin Yudong Chen Kannan Ramchandran Peter L. Bartlett OOD FedML 116 1,499 0 05 Mar 2018
The Hidden Vulnerability of Distributed Learning in Byzantium El-Mahdi El-Mhamdi R. Guerraoui Sébastien Rouault AAML FedML 67 748 0 22 Feb 2018
Gradient Sparsification for Communication-Efficient Distributed Optimization Jianqiao Wangni Jialei Wang Ji Liu Tong Zhang 77 525 0 26 Oct 2017
ByRDiE: Byzantine-resilient distributed coordinate descent for decentralized learning Zhixiong Yang W. Bajwa OOD 71 130 0 28 Aug 2017
TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning W. Wen Cong Xu Feng Yan Chunpeng Wu Yandan Wang Yiran Chen Hai Helen Li 140 988 0 22 May 2017
Randomized Distributed Mean Estimation: Accuracy vs Communication Jakub Konecný Peter Richtárik FedML 115 102 0 22 Nov 2016
Federated Learning: Strategies for Improving Communication Efficiency Jakub Konecný H. B. McMahan Felix X. Yu Peter Richtárik A. Suresh Dave Bacon FedML 293 4,643 0 18 Oct 2016
SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives Aaron Defazio Francis R. Bach Simon Lacoste-Julien ODL 131 1,822 0 01 Jul 2014
Stochastic Dual Coordinate Ascent Methods for Regularized Loss Minimization Shai Shalev-Shwartz Tong Zhang 181 1,033 0 10 Sep 2012