Convergence and Accuracy Trade-Offs in Federated Learning and Meta-Learning

8 March 2021

Papers citing "Convergence and Accuracy Trade-Offs in Federated Learning and Meta-Learning"

33 / 33 papers shown

Title
A-FedPD: Aligning Dual-Drift is All Federated Primal-Dual Learning Needs Yan Sun Li Shen Dacheng Tao FedML 78 0 0 27 Sep 2024
An Operator Splitting View of Federated Learning Saber Malekmohammadi Kiarash Shaloudegi Zeou Hu Yaoliang Yu FedML 96 2 0 12 Aug 2021
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization Jianyu Wang Qinghua Liu Hao Liang Gauri Joshi H. Vincent Poor MoMe FedML 68 1,348 0 15 Jul 2020
Federated Accelerated Stochastic Gradient Descent Honglin Yuan Tengyu Ma FedML 67 180 0 16 Jun 2020
Training Keyword Spotting Models on Non-IID Data with Federated Learning Andrew Straiton Hard Kurt Partridge Cameron Nguyen Niranjan A. Subrahmanya Aishanee Shah Pai Zhu Ignacio López Moreno Rajiv Mathews OOD FedML 59 67 0 21 May 2020
FedSplit: An algorithmic framework for fast federated optimization Reese Pathak Martin J. Wainwright FedML 217 184 0 11 May 2020
From Local SGD to Local Fixed-Point Methods for Federated Learning Grigory Malinovsky D. Kovalev Elnur Gasanov Laurent Condat Peter Richtárik FedML 126 117 0 03 Apr 2020
Adaptive Federated Optimization Sashank J. Reddi Zachary B. Charles Manzil Zaheer Zachary Garrett Keith Rush Jakub Konecný Sanjiv Kumar H. B. McMahan FedML 179 1,452 0 29 Feb 2020
Personalized Federated Learning: A Meta-Learning Approach Alireza Fallah Aryan Mokhtari Asuman Ozdaglar FedML 157 572 0 19 Feb 2020
Is Local SGD Better than Minibatch SGD? Blake E. Woodworth Kumar Kshitij Patel Sebastian U. Stich Zhen Dai Brian Bullins H. B. McMahan Ohad Shamir Nathan Srebro FedML 74 254 0 18 Feb 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 264 6,285 0 10 Dec 2019
Local AdaAlter: Communication-Efficient Stochastic Gradient Descent with Adaptive Learning Rates Cong Xie Oluwasanmi Koyejo Indranil Gupta Yanghua Peng 64 42 0 20 Nov 2019
SCAFFOLD: Stochastic Controlled Averaging for Federated Learning Sai Praneeth Karimireddy Satyen Kale M. Mohri Sashank J. Reddi Sebastian U. Stich A. Suresh FedML 65 347 0 14 Oct 2019
The Non-IID Data Quagmire of Decentralized Machine Learning Kevin Hsieh Amar Phanishayee O. Mutlu Phillip B. Gibbons 163 572 0 01 Oct 2019
Improving Federated Learning Personalization via Model Agnostic Meta Learning Yihan Jiang Jakub Konecný Keith Rush Sreeram Kannan FedML 80 602 0 27 Sep 2019
Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification T. Hsu Qi Matthew Brown FedML 143 1,163 0 13 Sep 2019
On the Convergence Theory of Gradient-Based Model-Agnostic Meta-Learning Algorithms Alireza Fallah Aryan Mokhtari Asuman Ozdaglar 88 225 0 27 Aug 2019
Federated Learning: Challenges, Methods, and Future Directions Tian Li Anit Kumar Sahu Ameet Talwalkar Virginia Smith FedML 129 4,540 0 21 Aug 2019
Lookahead Optimizer: k steps forward, 1 step back Michael Ruogu Zhang James Lucas Geoffrey E. Hinton Jimmy Ba ODL 152 732 0 19 Jul 2019
Adaptive Gradient-Based Meta-Learning Methods M. Khodak Maria-Florina Balcan Ameet Talwalkar FedML 95 356 0 06 Jun 2019
Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification, and Local Computations Debraj Basu Deepesh Data C. Karakuş Suhas Diggavi MQ 60 406 0 06 Jun 2019
Fair Resource Allocation in Federated Learning Tian Li Maziar Sanjabi Ahmad Beirami Virginia Smith FedML 182 804 0 25 May 2019
Provable Guarantees for Gradient-Based Meta-Learning M. Khodak Maria-Florina Balcan Ameet Talwalkar FedML 127 150 0 27 Feb 2019
Federated Optimization in Heterogeneous Networks Tian Li Anit Kumar Sahu Manzil Zaheer Maziar Sanjabi Ameet Talwalkar Virginia Smith FedML 180 5,220 0 14 Dec 2018
Applied Federated Learning: Improving Google Keyboard Query Suggestions Timothy Yang Galen Andrew Hubert Eichner Haicheng Sun Wei Li Nicholas Kong Daniel Ramage F. Beaufays FedML 87 626 0 07 Dec 2018
LEAF: A Benchmark for Federated Settings S. Caldas Sai Meher Karthik Duddu Peter Wu Tian Li Jakub Konecný H. B. McMahan Virginia Smith Ameet Talwalkar FedML 153 1,422 0 03 Dec 2018
Federated Learning for Mobile Keyboard Prediction Andrew Straiton Hard Kanishka Rao Zhifeng Lin Swaroop Indra Ramaswamy Youjie Li S. Augenstein Alex Schwing M. Annavaram A. Avestimehr FedML 136 1,546 0 08 Nov 2018
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 186 1,069 0 24 May 2018
Group Normalization Yuxin Wu Kaiming He 236 3,670 0 22 Mar 2018
On First-Order Meta-Learning Algorithms Alex Nichol Joshua Achiam John Schulman 233 2,237 0 08 Mar 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 827 11,943 0 09 Mar 2017
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 406 17,593 0 17 Feb 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.0K 150,312 0 22 Dec 2014