Federated Stochastic Gradient Descent Begets Self-Induced Momentum

Federated Stochastic Gradient Descent Begets Self-Induced Momentum

17 February 2022

Zuozhu Liu

H. Vincent Poor

ArXiv (abs)PDF HTML

Papers citing "Federated Stochastic Gradient Descent Begets Self-Induced Momentum"

9 / 9 papers shown

Title
Faster On-Device Training Using New Federated Momentum Algorithm Zhouyuan Huo Qian Yang Bin Gu Heng-Chiao Huang FedML 176 47 0 06 Feb 2020
A Joint Learning and Communications Framework for Federated Learning over Wireless Networks Mingzhe Chen Zhaohui Yang Walid Saad Changchuan Yin H. Vincent Poor Shuguang Cui FedML 76 1,189 0 17 Sep 2019
Tighter Theory for Local SGD on Identical and Heterogeneous Data Ahmed Khaled Konstantin Mishchenko Peter Richtárik 74 434 0 10 Sep 2019
The Roadmap to 6G -- AI Empowered Wireless Networks Khaled B. Letaief Wei Chen Yuanming Shi Jun Zhang Y. Zhang 56 1,365 0 26 Apr 2019
Toward Understanding the Impact of Staleness in Distributed Machine Learning Wei-Ming Dai Yi Zhou Nanqing Dong Huatian Zhang Eric Xing 60 80 0 08 Oct 2018
A Tight Convergence Analysis for Stochastic Gradient Descent with Delayed Updates Yossi Arjevani Ohad Shamir Nathan Srebro 70 63 0 26 Jun 2018
LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning Tianyi Chen G. Giannakis Tao Sun W. Yin 55 298 0 25 May 2018
Adaptive Federated Learning in Resource Constrained Edge Computing Systems Shiqiang Wang Tiffany Tuor Theodoros Salonidis K. Leung C. Makaya T. He Kevin S. Chan 254 1,709 0 14 Apr 2018
Federated Learning: Strategies for Improving Communication Efficiency Jakub Konecný H. B. McMahan Felix X. Yu Peter Richtárik A. Suresh Dave Bacon FedML 306 4,649 0 18 Oct 2016