Federated Learning over Noisy Channels: Convergence Analysis and Design Examples

6 January 2021

Papers citing "Federated Learning over Noisy Channels: Convergence Analysis and Design Examples"

48 / 48 papers shown

Title
ScaleCom: Scalable Sparsified Gradient Compression for Communication-Efficient Distributed Training Chia-Yu Chen Jiamin Ni Songtao Lu Xiaodong Cui Pin-Yu Chen ... Naigang Wang Swagath Venkataramani Vijayalakshmi Srinivasan Wei Zhang K. Gopalakrishnan 51 66 0 21 Apr 2021
Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System Heterogeneity Amirhossein Reisizadeh Isidoros Tziotis Hamed Hassani Aryan Mokhtari Ramtin Pedarsani FedML 195 101 0 28 Dec 2020
Design and Analysis of Uplink and Downlink Communications for Federated Learning Sihui Zheng Cong Shen Xiang Chen 51 143 0 07 Dec 2020
Fast Convergence Algorithm for Analog Federated Learning Shuhao Xia Jingyang Zhu Yuhan Yang Yong Zhou Yuanming Shi Wei Chen FedML 37 31 0 30 Oct 2020
Over-the-Air Federated Learning from Heterogeneous Data Tomer Sery Nir Shlezinger Kobi Cohen Yonina C. Eldar FedML 43 196 0 27 Sep 2020
Convergence of Federated Learning over a Noisy Downlink M. Amiri Deniz Gunduz Sanjeev R. Kulkarni H. Vincent Poor FedML 56 75 0 25 Aug 2020
Cluster-Based Cooperative Digital Over-the-Air Aggregation for Wireless Federated Edge Learning Ruichen Jiang Sheng Zhou FedML 34 17 0 03 Aug 2020
Federated Learning With Quantized Global Model Updates M. Amiri Deniz Gunduz Sanjeev R. Kulkarni H. Vincent Poor FedML 35 131 0 18 Jun 2020
Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspective Jie Xu Heqiang Wang 39 352 0 09 Apr 2020
Convergence Time Optimization for Federated Learning over Wireless Networks Mingzhe Chen H. Vincent Poor Walid Saad Shuguang Cui 44 296 0 22 Jan 2020
One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis Guangxu Zhu Yuqing Du Deniz Gunduz Kaibin Huang 58 309 0 16 Jan 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 126 6,177 0 10 Dec 2019
Energy Efficient Federated Learning Over Wireless Communication Networks Zhaohui Yang Mingzhe Chen Walid Saad Choong Seon Hong M. Shikh-Bahaei 47 684 0 06 Nov 2019
Secure Federated Submodel Learning Chaoyue Niu Fan Wu Shaojie Tang Lifeng Hua Rongfei Jia Chengfei Lv Zhihua Wu Guihai Chen FedML 29 30 0 06 Nov 2019
Device Scheduling with Fast Convergence for Wireless Federated Learning Misha Sra C. Schmandt Z. Niu FedML 46 196 0 03 Nov 2019
Robust Federated Learning with Noisy Communication F. Ang Li Chen Senior Member Ieee Nan Zhao Senior Member Ieee Yunfei Chen Weidong Wang Feng Yu FedML 39 117 0 01 Nov 2019
Energy-Aware Analog Aggregation for Federated Learning with Redundant Data Yuxuan Sun Sheng Zhou Deniz Gündüz FedML 36 95 0 01 Nov 2019
Local SGD with Periodic Averaging: Tighter Analysis and Adaptive Synchronization Farzin Haddadpour Mohammad Mahdi Kamani M. Mahdavi V. Cadambe FedML 54 201 0 30 Oct 2019
High-Dimensional Stochastic Gradient Quantization for Communication-Efficient Edge Learning Yuqing Du Sheng Yang Kaibin Huang 128 99 0 09 Oct 2019
FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization Amirhossein Reisizadeh Aryan Mokhtari Hamed Hassani Ali Jadbabaie Ramtin Pedarsani FedML 231 767 0 28 Sep 2019
A Joint Learning and Communications Framework for Federated Learning over Wireless Networks Mingzhe Chen Zhaohui Yang Walid Saad Changchuan Yin H. Vincent Poor Shuguang Cui FedML 64 1,184 0 17 Sep 2019
Federated Learning: Challenges, Methods, and Future Directions Tian Li Anit Kumar Sahu Ameet Talwalkar Virginia Smith FedML 83 4,470 0 21 Aug 2019
Federated Learning over Wireless Fading Channels M. Amiri Deniz Gunduz 92 508 0 23 Jul 2019
Energy-Efficient Radio Resource Allocation for Federated Edge Learning Qunsong Zeng Yuqing Du K. Leung Kaibin Huang 37 226 0 13 Jul 2019
On the Convergence of FedAvg on Non-IID Data Xiang Li Kaixuan Huang Wenhao Yang Shusen Wang Zhihua Zhang FedML 125 2,311 0 04 Jul 2019
Fair Resource Allocation in Federated Learning Tian Li Maziar Sanjabi Ahmad Beirami Virginia Smith FedML 119 793 0 25 May 2019
DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression Hanlin Tang Xiangru Lian Chen Yu Tong Zhang Ji Liu 33 217 0 15 May 2019
On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization Hao Yu Rong Jin Sen Yang FedML 64 381 0 09 May 2019
SLSGD: Secure and Efficient Distributed On-device Machine Learning Cong Xie Oluwasanmi Koyejo Indranil Gupta FedML 40 14 0 16 Mar 2019
Towards Federated Learning at Scale: System Design Keith Bonawitz Hubert Eichner W. Grieskamp Dzmitry Huba A. Ingerman ... H. B. McMahan Timon Van Overveldt David Petrou Daniel Ramage Jason Roselander FedML 88 2,652 0 04 Feb 2019
Federated Learning via Over-the-Air Computation Kai Yang Tao Jiang Yuanming Shi Z. Ding FedML 60 874 0 31 Dec 2018
Broadband Analog Aggregation for Low-Latency Federated Edge Learning (Extended Version) Guangxu Zhu Yong Wang Kaibin Huang FedML 55 638 0 30 Dec 2018
Expanding the Reach of Federated Learning by Reducing Client Resource Requirements S. Caldas Jakub Konecný H. B. McMahan Ameet Talwalkar 52 449 0 18 Dec 2018
Federated Optimization in Heterogeneous Networks Tian Li Anit Kumar Sahu Manzil Zaheer Maziar Sanjabi Ameet Talwalkar Virginia Smith FedML 85 5,105 0 14 Dec 2018
LEAF: A Benchmark for Federated Settings S. Caldas Sai Meher Karthik Duddu Peter Wu Tian Li Jakub Konecný H. B. McMahan Virginia Smith Ameet Talwalkar FedML 104 1,410 0 03 Dec 2018
Protection Against Reconstruction and Its Applications in Private Federated Learning Abhishek Bhowmick John C. Duchi Julien Freudiger Gaurav Kapoor Ryan M. Rogers FedML 50 358 0 03 Dec 2018
Towards an Intelligent Edge: Wireless Communication Meets Machine Learning Guangxu Zhu Dongzhu Liu Yuqing Du Changsheng You Jun Zhang Kaibin Huang 39 506 0 02 Sep 2018
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms Jianyu Wang Gauri Joshi 101 348 0 22 Aug 2018
Double Quantization for Communication-Efficient Distributed Optimization Yue Yu Jiaxiang Wu Longbo Huang MQ 33 57 0 25 May 2018
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 152 1,056 0 24 May 2018
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge Takayuki Nishio Ryo Yonetani FedML 104 1,390 0 23 Apr 2018
Adaptive Federated Learning in Resource Constrained Edge Computing Systems Shiqiang Wang Tiffany Tuor Theodoros Salonidis K. Leung C. Makaya T. He Kevin S. Chan 200 1,698 0 14 Apr 2018
On the convergence properties of a $K$ -step averaging stochastic gradient descent algorithm for nonconvex optimization Fan Zhou Guojing Cong 115 233 0 03 Aug 2017
Federated Learning: Strategies for Improving Communication Efficiency Jakub Konecný H. B. McMahan Felix X. Yu Peter Richtárik A. Suresh Dave Bacon FedML 269 4,620 0 18 Oct 2016
QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding Dan Alistarh Demjan Grubic Jerry Li Ryota Tomioka Milan Vojnović MQ 56 425 0 07 Oct 2016
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks Tim Salimans Diederik P. Kingma ODL 143 1,933 0 25 Feb 2016
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 234 17,328 0 17 Feb 2016
Perturbed Iterate Analysis for Asynchronous Stochastic Optimization Horia Mania Xinghao Pan Dimitris Papailiopoulos Benjamin Recht Kannan Ramchandran Michael I. Jordan 79 231 0 24 Jul 2015