Accelerated Federated Learning with Decoupled Adaptive Optimization

14 July 2022

Papers citing "Accelerated Federated Learning with Decoupled Adaptive Optimization"

50 / 56 papers shown

Title
PDSL: Privacy-Preserved Decentralized Stochastic Learning with Heterogeneous Data Distribution Lina Wang Yunsheng Yuan Chunxiao Wang Feng Li FedML 70 0 0 31 Mar 2025
Stochastic Controlled Averaging for Federated Learning with Communication Compression Xinmeng Huang Ping Li Xiaoyun Li 53 201 0 16 Aug 2023
AQUILA: Communication Efficient Federated Learning with Adaptive Quantization in Device Selection Strategy Zihao Zhao Yuzhu Mao Zhenpeng Shi Yang Liu Tian-Shing Lan Wenbo Ding Xiaoping Zhang 67 9 0 01 Aug 2023
FedDUAP: Federated Learning with Dynamic Update and Adaptive Pruning Using Shared Data on the Server Hong Zhang Ji Liu Juncheng Jia Yang Zhou H. Dai Dejing Dou FedML 30 45 0 25 Apr 2022
Acceleration of Federated Learning with Alleviated Forgetting in Local Training Chencheng Xu Zhiwei Hong Minlie Huang Tao Jiang FedML 58 46 0 05 Mar 2022
Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank? Sheikh Shams Azam Seyyedali Hosseinalipour Qiang Qiu Christopher G. Brinton FedML 75 19 0 01 Feb 2022
Improving Federated Learning Face Recognition via Privacy-Agnostic Clusters Qiang Meng Feng Zhou Hainan Ren Tianshu Feng Guochao Liu Yuanqing Lin FedML 50 38 0 29 Jan 2022
Efficient Device Scheduling with Multi-Job Federated Learning Chen Zhou Ji Liu Juncheng Jia Jingbo Zhou Yang Zhou H. Dai Dejing Dou FedML 40 40 0 11 Dec 2021
DP-REC: Private & Communication-Efficient Federated Learning Aleksei Triastcyn M. Reisser Christos Louizos FedML 28 16 0 09 Nov 2021
Bayesian Framework for Gradient Leakage Mislav Balunović Dimitar I. Dimitrov Robin Staab Martin Vechev FedML 41 41 0 08 Nov 2021
Federated Learning Based on Dynamic Regularization D. A. E. Acar Yue Zhao Ramon Matas Navarro Matthew Mattina P. Whatmough Venkatesh Saligrama FedML 47 762 0 08 Nov 2021
Towards Model Agnostic Federated Learning Using Knowledge Distillation A. Afonin Sai Praneeth Karimireddy FedML 51 45 0 28 Oct 2021
What Do We Mean by Generalization in Federated Learning? Honglin Yuan Warren Morningstar Lin Ning K. Singhal OOD FedML 53 72 0 27 Oct 2021
Robbing the Fed: Directly Obtaining Private Data in Federated Learning with Modified Models Liam H. Fowl Jonas Geiping W. Czaja Micah Goldblum Tom Goldstein FedML 106 147 0 25 Oct 2021
Minibatch vs Local SGD with Shuffling: Tight Convergence Bounds and Beyond Chulhee Yun Shashank Rajput S. Sra FedML 23 41 0 20 Oct 2021
TESSERACT: Gradient Flip Score to Secure Federated Learning Against Model Poisoning Attacks Atul Sharma Wei Chen Joshua C. Zhao Qiang Qiu Somali Chaterji S. Bagchi FedML AAML 93 5 0 19 Oct 2021
ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive Training Hui-Po Wang Sebastian U. Stich Yang He Mario Fritz FedML AI4CE 48 49 0 11 Oct 2021
Accelerating Federated Learning with a Global Biased Optimiser Jed Mills Jia Hu Geyong Min Rui Jin Siwei Zheng Jin Wang FedML AI4CE 67 9 0 20 Aug 2021
FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learning Nam Hyeon-Woo Moon Ye-Bin Tae-Hyun Oh FedML 51 120 0 13 Aug 2021
On Bridging Generic and Personalized Federated Learning for Image Classification Hong-You Chen Wei-Lun Chao FedML 64 21 0 02 Jul 2021
STEM: A Stochastic Two-Sided Momentum Algorithm Achieving Near-Optimal Sample and Communication Complexities for Federated Learning Prashant Khanduri Pranay Sharma Haibo Yang Min-Fong Hong Jia Liu K. Rajawat P. Varshney FedML 31 63 0 19 Jun 2021
Local Adaptivity in Federated Learning: Convergence and Consistency Jianyu Wang Zheng Xu Zachary Garrett Zachary B. Charles Luyang Liu Gauri Joshi FedML 54 39 0 04 Jun 2021
FedBABU: Towards Enhanced Representation for Federated Image Classification Jaehoon Oh Sangmook Kim Se-Young Yun FedML 51 202 0 04 Jun 2021
H-FL: A Hierarchical Communication-Efficient and Privacy-Protected Architecture for Federated Learning He Yang 26 27 0 01 Jun 2021
From Distributed Machine Learning to Federated Learning: A Survey Ji Liu Jizhou Huang Yang Zhou Xuhong Li Shilei Ji Haoyi Xiong Dejing Dou FedML OOD 89 251 0 29 Apr 2021
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients A. Mitra Rayana H. Jaafar George J. Pappas Hamed Hassani FedML 72 158 0 14 Feb 2021
FedADC: Accelerated Federated Learning with Drift Control Emre Ozfatura Kerem Ozfatura Deniz Gunduz FedML 68 38 0 16 Dec 2020
Personalized Federated Learning with First Order Model Optimization Michael Zhang Karan Sapra Sanja Fidler Serena Yeung J. Álvarez FedML 53 290 0 15 Dec 2020
Communication-Efficient Federated Learning with Compensated Overlap-FedAvg Yuhao Zhou Qing Ye Jiancheng Lv FedML 41 123 0 12 Dec 2020
Federated Composite Optimization Honglin Yuan Manzil Zaheer Sashank J. Reddi FedML 52 59 0 17 Nov 2020
Fast Convergence Algorithm for Analog Federated Learning Shuhao Xia Jingyang Zhu Yuhan Yang Yong Zhou Yuanming Shi Wei Chen FedML 37 31 0 30 Oct 2020
Federated Bayesian Optimization via Thompson Sampling Zhongxiang Dai K. H. Low Patrick Jaillet FedML 110 111 0 20 Oct 2020
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning Sai Praneeth Karimireddy Martin Jaggi Satyen Kale M. Mohri Sashank J. Reddi Sebastian U. Stich A. Suresh FedML 66 217 0 08 Aug 2020
Accelerating Federated Learning over Reliability-Agnostic Clients in Mobile Edge Computing Systems Wentai Wu Ligang He Weiwei Lin Rui Mao 32 78 0 28 Jul 2020
FetchSGD: Communication-Efficient Federated Learning with Sketching D. Rothchild Ashwinee Panda Enayat Ullah Nikita Ivkin Ion Stoica Vladimir Braverman Joseph E. Gonzalez Raman Arora FedML 48 363 0 15 Jul 2020
Byzantine-Robust Learning on Heterogeneous Datasets via Bucketing Sai Praneeth Karimireddy Lie He Martin Jaggi FedML OOD 39 140 0 16 Jun 2020
Minibatch vs Local SGD for Heterogeneous Distributed Learning Blake E. Woodworth Kumar Kshitij Patel Nathan Srebro FedML 87 202 0 08 Jun 2020
FedSplit: An algorithmic framework for fast federated optimization Reese Pathak Martin J. Wainwright FedML 162 183 0 11 May 2020
Adaptive Federated Optimization Sashank J. Reddi Zachary B. Charles Manzil Zaheer Zachary Garrett Keith Rush Jakub Konecný Sanjiv Kumar H. B. McMahan FedML 88 1,417 0 29 Feb 2020
Acceleration for Compressed Gradient Descent in Distributed and Federated Optimization Zhize Li D. Kovalev Xun Qian Peter Richtárik FedML AI4CE 78 136 0 26 Feb 2020
A Communication Efficient Collaborative Learning Framework for Distributed Features Yang Liu Yan Kang Xinwei Zhang Liping Li Yong Cheng Tianjian Chen Mingyi Hong Qiang Yang FedML 41 75 0 24 Dec 2019
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 126 6,177 0 10 Dec 2019
Why are Adaptive Methods Good for Attention Models? J.N. Zhang Sai Praneeth Karimireddy Andreas Veit Seungyeon Kim Sashank J. Reddi Surinder Kumar S. Sra 79 80 0 06 Dec 2019
Local AdaAlter: Communication-Efficient Stochastic Gradient Descent with Adaptive Learning Rates Cong Xie Oluwasanmi Koyejo Indranil Gupta Yanghua Peng 37 41 0 20 Nov 2019
Accelerating Federated Learning via Momentum Gradient Descent Wei Liu Li Chen Yunfei Chen Wenyi Zhang FedML AI4CE 57 292 0 08 Oct 2019
SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum Jianyu Wang Vinayak Tantia Nicolas Ballas Michael G. Rabbat 46 201 0 01 Oct 2019
The Non-IID Data Quagmire of Decentralized Machine Learning Kevin Hsieh Amar Phanishayee O. Mutlu Phillip B. Gibbons 119 563 0 01 Oct 2019
Expanding the Reach of Federated Learning by Reducing Client Resource Requirements S. Caldas Jakub Konecný H. B. McMahan Ameet Talwalkar 52 449 0 18 Dec 2018
LEAF: A Benchmark for Federated Settings S. Caldas Sai Meher Karthik Duddu Peter Wu Tian Li Jakub Konecný H. B. McMahan Virginia Smith Ameet Talwalkar FedML 104 1,410 0 03 Dec 2018
Federated Learning for Keyword Spotting David Leroy A. Coucke Thibaut Lavril Thibault Gisselbrecht Joseph Dureau FedML 48 282 0 09 Oct 2018