Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning

8 August 2020

Sai Praneeth Karimireddy

Papers citing "Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning"

46 / 46 papers shown

Title
Communication-Efficient Federated Fine-Tuning of Language Models via Dynamic Update Schedules Michail Theologitis V. Samoladas Antonios Deligiannakis 34 0 0 07 May 2025
OledFL: Unleashing the Potential of Decentralized Federated Learning via Opposite Lookahead Enhancement Qinglun Li Miao Zhang Mengzhu Wang Quanjun Yin Li Shen OODD FedML 26 0 0 09 Oct 2024
The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication Kumar Kshitij Patel Margalit Glasgow Ali Zindari Lingxiao Wang Sebastian U. Stich Ziheng Cheng Nirmit Joshi Nathan Srebro 48 6 0 19 May 2024
FedDRO: Federated Compositional Optimization for Distributionally Robust Learning Prashant Khanduri Chengyin Li Rafi Ibn Sultan Yao Qiang Joerg Kliewer Dongxiao Zhu 39 0 0 21 Nov 2023
FedDrive v2: an Analysis of the Impact of Label Skewness in Federated Semantic Segmentation for Autonomous Driving Eros Fani Marco Ciccone Barbara Caputo FedML 21 4 0 23 Sep 2023
FLIPS: Federated Learning using Intelligent Participant Selection R. Bhope K. R. Jayaram N. Venkatasubramanian Ashish Verma Gegi Thomas FedML 29 3 0 07 Aug 2023
FedBug: A Bottom-Up Gradual Unfreezing Framework for Federated Learning Chia-Hsiang Kao Yu-Chiang Frank Wang FedML 24 1 0 19 Jul 2023
Federated Multi-Sequence Stochastic Approximation with Local Hypergradient Estimation Davoud Ataee Tarzanagh Mingchen Li Pranay Sharma Samet Oymak 26 0 0 02 Jun 2023
FedAVO: Improving Communication Efficiency in Federated Learning with African Vultures Optimizer Md Zarif Hossain Ahmed Imteaj FedML 29 5 0 02 May 2023
SLowcal-SGD: Slow Query Points Improve Local-SGD for Stochastic Convex Optimization Kfir Y. Levy Kfir Y. Levy FedML 45 2 0 09 Apr 2023
FedML Parrot: A Scalable Federated Learning System via Heterogeneity-aware Scheduling on Sequential and Hierarchical Training Zhenheng Tang X. Chu Ryan Yide Ran Sunwoo Lee S. Shi Yonggang Zhang Yuxin Wang Alex Liang A. Avestimehr Chaoyang He FedML 20 10 0 03 Mar 2023
Entropy-driven Fair and Effective Federated Learning Lung-Chuang Wang Zhichao Wang Sai Praneeth Karimireddy Xiaoying Tang Xiaoying Tang FedML 33 9 0 29 Jan 2023
Personalized Federated Learning with Hidden Information on Personalized Prior Mingjia Shi Yuhao Zhou Qing Ye Jiancheng Lv FedML 29 3 0 19 Nov 2022
Fast Adaptive Federated Bilevel Optimization Feihu Huang FedML 20 7 0 02 Nov 2022
Hierarchical Federated Learning with Momentum Acceleration in Multi-Tier Networks Zhengjie Yang Sen Fu Wei Bao Dong Yuan Albert Y. Zomaya FedML 44 5 0 26 Oct 2022
FeDXL: Provable Federated Learning for Deep X-Risk Optimization Zhishuai Guo R. L. Jin Jiebo Luo Tianbao Yang FedML 47 8 0 26 Oct 2022
CANIFE: Crafting Canaries for Empirical Privacy Measurement in Federated Learning Samuel Maddock Alexandre Sablayrolles Pierre Stock FedML 20 22 0 06 Oct 2022
Fast Heterogeneous Federated Learning with Hybrid Client Selection Guangyuan Shen D. Gao Duanxiao Song Libin Yang Xukai Zhou Shirui Pan W. Lou Fang Zhou FedML 39 12 0 10 Aug 2022
FLAIR: Federated Learning Annotated Image Repository Congzheng Song Filip Granqvist Kunal Talwar FedML 23 28 0 18 Jul 2022
Accelerated Federated Learning with Decoupled Adaptive Optimization Jiayin Jin Jiaxiang Ren Yang Zhou Lingjuan Lyu Ji Liu Dejing Dou AI4CE FedML 19 51 0 14 Jul 2022
A Simple and Provably Efficient Algorithm for Asynchronous Federated Contextual Linear Bandits Jiafan He Tianhao Wang Yifei Min Quanquan Gu FedML 35 32 0 07 Jul 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 23 21 0 30 Jun 2022
DELTA: Diverse Client Sampling for Fasting Federated Learning Lung-Chuang Wang Yongxin Guo Tao R. Lin Xiaoying Tang FedML 23 22 0 27 May 2022
Adaptive Aggregation For Federated Learning K. R. Jayaram Vinod Muthusamy Gegi Thomas Ashish Verma Mark Purcell FedML 30 16 0 23 Mar 2022
A dual approach for federated learning Zhenan Fan Huang Fang M. Friedlander FedML 16 3 0 26 Jan 2022
TOFU: Towards Obfuscated Federated Updates by Encoding Weight Updates into Gradients from Proxy Data Isha Garg M. Nagaraj Kaushik Roy FedML 31 1 0 21 Jan 2022
Adaptive Client Sampling in Federated Learning via Online Learning with Bandit Feedback Boxin Zhao Lingxiao Wang Mladen Kolar Ziqi Liu Qing Cui Jun Zhou Chaochao Chen FedML 34 10 0 28 Dec 2021
Robust Convergence in Federated Learning through Label-wise Clustering Hunmin Lee Yueyang Liu Donghyun Kim Yingshu Li FedML 25 1 0 28 Dec 2021
Towards Federated Learning on Time-Evolving Heterogeneous Data Yongxin Guo Tao R. Lin Xiaoying Tang FedML 22 30 0 25 Dec 2021
Differentially Private Federated Learning on Heterogeneous Data Maxence Noble A. Bellet Aymeric Dieuleveut FedML 13 102 0 17 Nov 2021
Linear Speedup in Personalized Collaborative Learning El Mahdi Chayti Sai Praneeth Karimireddy Sebastian U. Stich Nicolas Flammarion Martin Jaggi FedML 15 13 0 10 Nov 2021
Towards Model Agnostic Federated Learning Using Knowledge Distillation A. Afonin Sai Praneeth Karimireddy FedML 30 44 0 28 Oct 2021
Accelerating Federated Learning with a Global Biased Optimiser Jed Mills Jia Hu Geyong Min Rui Jin Siwei Zheng Jin Wang FedML AI4CE 34 9 0 20 Aug 2021
FedChain: Chained Algorithms for Near-Optimal Communication Cost in Federated Learning Charlie Hou K. K. Thekumparampil Giulia Fanti Sewoong Oh FedML 30 14 0 16 Aug 2021
FedJAX: Federated learning simulation with JAX Jae Hun Ro A. Suresh Ke Wu FedML 33 48 0 04 Aug 2021
On Bridging Generic and Personalized Federated Learning for Image Classification Hong-You Chen Wei-Lun Chao FedML 22 21 0 02 Jul 2021
FedCM: Federated Learning with Client-level Momentum Jing Xu Sen Wang Liwei Wang Andrew Chi-Chih Yao FedML 27 94 0 21 Jun 2021
On Large-Cohort Training for Federated Learning Zachary B. Charles Zachary Garrett Zhouyuan Huo Sergei Shmulyian Virginia Smith FedML 21 113 0 15 Jun 2021
Local Adaptivity in Federated Learning: Convergence and Consistency Jianyu Wang Zheng Xu Zachary Garrett Zachary B. Charles Luyang Liu Gauri Joshi FedML 29 39 0 04 Jun 2021
Emerging Trends in Federated Learning: From Model Fusion to Federated X Learning Shaoxiong Ji Yue Tan Teemu Saravirta Zhiqin Yang Yixin Liu Lauri Vasankari Shirui Pan Guodong Long A. Walid FedML 37 76 0 25 Feb 2021
Learning from History for Byzantine Robust Optimization Sai Praneeth Karimireddy Lie He Martin Jaggi FedML AAML 30 173 0 18 Dec 2020
Faster Non-Convex Federated Learning via Global and Local Momentum Rudrajit Das Anish Acharya Abolfazl Hashemi Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu FedML 37 82 0 07 Dec 2020
Federated Learning via Posterior Averaging: A New Perspective and Practical Algorithms Maruan Al-Shedivat Jennifer Gillenwater Eric P. Xing Afshin Rostamizadeh FedML 19 109 0 11 Oct 2020
Federated Learning with Nesterov Accelerated Gradient Zhengjie Yang Wei Bao Dong Yuan Nguyen H. Tran Albert Y. Zomaya FedML 19 29 0 18 Sep 2020
Adaptive Federated Learning in Resource Constrained Edge Computing Systems Shiqiang Wang Tiffany Tuor Theodoros Salonidis K. Leung C. Makaya T. He Kevin S. Chan 144 1,687 0 14 Apr 2018
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark W. Schmidt 139 1,199 0 16 Aug 2016