Sharper Convergence Guarantees for Asynchronous SGD for Distributed and Federated Learning

16 June 2022

Papers citing "Sharper Convergence Guarantees for Asynchronous SGD for Distributed and Federated Learning"

21 / 21 papers shown

Title
$γ$ -FedHT: Stepsize-Aware Hard-Threshold Gradient Compression in Federated Learning Rongwei Lu Yutong Jiang Jinrui Zhang Chunyang Li Yifei Zhu Bin Chen Zhi Wang FedML 2 0 0 18 May 2025
Convergence Analysis of Asynchronous Federated Learning with Gradient Compression for Non-Convex Optimization Diying Yang Yingwei Hou Danyang Xiao Weigang Wu FedML 39 0 0 28 Apr 2025
Orthogonal Calibration for Asynchronous Federated Learning Jiayun Zhang Shuheng Li Haiyu Huang Xiaofan Yu Rajesh K. Gupta Jingbo Shang FedML 65 0 0 21 Feb 2025
Faster Stochastic Optimization with Arbitrary Delays via Asynchronous Mini-Batching Amit Attia Ofir Gaash Tomer Koren 40 0 0 14 Aug 2024
Ordered Momentum for Asynchronous SGD Chang-Wei Shi Yi-Rui Yang Wu-Jun Li ODL 59 0 0 27 Jul 2024
Asynchronous Federated Stochastic Optimization for Heterogeneous Objectives Under Arbitrary Delays Charikleia Iakovidou Kibaek Kim FedML 35 2 0 16 May 2024
Understanding Server-Assisted Federated Learning in the Presence of Incomplete Client Participation Haibo Yang Pei-Yuan Qiu Prashant Khanduri Minghong Fang Jia Liu FedML 42 1 0 04 May 2024
Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey Feng Liang Zhen Zhang Haifeng Lu Victor C. M. Leung Yanyi Guo Xiping Hu GNN 37 6 0 09 Apr 2024
Asynchronous Federated Reinforcement Learning with Policy Gradient Updates: Algorithm Design and Convergence Analysis Guangchen Lan Dong-Jun Han Abolfazl Hashemi Vaneet Aggarwal Christopher G. Brinton 124 15 0 09 Apr 2024
EchoPFL: Asynchronous Personalized Federated Learning on Mobile Devices with On-Demand Staleness Control Xiaocheng Li Si-ren Liu Zimu Zhou Bin Guo Yuan Xu Zhiwen Yu 35 0 0 29 Jan 2024
FedASMU: Efficient Asynchronous Federated Learning with Dynamic Staleness-aware Model Update Ji Liu Juncheng Jia Tianshi Che Chao Huo Jiaxiang Ren Yang Zhou H. Dai Dejing Dou 24 32 0 10 Dec 2023
Convergence Analysis of Decentralized ASGD Mauro Dalle Lucca Tosi Martin Theobald 29 2 0 07 Sep 2023
Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregation Tomàs Ortega Hamid Jafarkhani FedML 30 6 0 01 Aug 2023
Federated Gradient Matching Pursuit Halyun Jeong Deanna Needell Jing Qin FedML 37 1 0 20 Feb 2023
Efficient and Light-Weight Federated Learning via Asynchronous Distributed Dropout Chen Dun Mirian Hipolito Garcia C. Jermaine Dimitrios Dimitriadis Anastasios Kyrillidis 64 20 0 28 Oct 2022
PersA-FL: Personalized Asynchronous Federated Learning Taha Toghani Soomin Lee César A. Uribe FedML 37 6 0 03 Oct 2022
Unbounded Gradients in Federated Learning with Buffered Asynchronous Aggregation Taha Toghani César A. Uribe FedML 35 14 0 03 Oct 2022
Delay-adaptive step-sizes for asynchronous learning Xuyang Wu Sindri Magnússon Hamid Reza Feyzmahdavian M. Johansson 32 14 0 17 Feb 2022
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 255 4,796 0 24 Feb 2021
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 245 1,826 0 17 Sep 2019
Optimal Distributed Online Prediction using Mini-Batches O. Dekel Ran Gilad-Bachrach Ohad Shamir Lin Xiao 179 683 0 07 Dec 2010