Towards More Suitable Personalization in Federated Learning via Decentralized Partial Model Training

24 May 2023

Li Shen

Papers citing "Towards More Suitable Personalization in Federated Learning via Decentralized Partial Model Training"

33 / 33 papers shown

Title
AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks Hao Sun Li Shen Qihuang Zhong Liang Ding Shi-Yong Chen Jingwei Sun Jing Li Guangzhong Sun Dacheng Tao 93 33 0 01 Mar 2023
Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challenges Enrique Tomás Martínez Beltrán Mario Quiles Pérez Pedro Miguel Sánchez Sánchez Sergio López Bernal Gérome Bovet M. Pérez Gregorio Martínez Pérez Alberto Huertas Celdrán FedML 69 254 0 15 Nov 2022
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach Peng Mi Li Shen Tianhe Ren Yiyi Zhou Xiaoshuai Sun Rongrong Ji Dacheng Tao AAML 113 71 0 11 Oct 2022
Towards Understanding Sharpness-Aware Minimization Maksym Andriushchenko Nicolas Flammarion AAML 98 142 0 13 Jun 2022
Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learning Momin Abbas Quan-Wu Xiao Lisha Chen Pin-Yu Chen Tianyi Chen 105 81 0 08 Jun 2022
Federated Learning with Partial Model Personalization Krishna Pillutla Kshitiz Malik Abdel-rahman Mohamed Michael G. Rabbat Maziar Sanjabi Lin Xiao FedML 103 169 0 08 Apr 2022
Achieving Personalized Federated Learning with Sparse Local Models Tiansheng Huang Shiwei Liu Li Shen Fengxiang He Weiwei Lin Dacheng Tao FedML 84 44 0 27 Jan 2022
Decentralized Federated Averaging Tao Sun Dongsheng Li Bao Wang FedML 83 216 0 23 Apr 2021
Towards Personalized Federated Learning A. Tan Han Yu Li-zhen Cui Qiang Yang FedML AI4CE 335 878 0 01 Mar 2021
ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks Jungmin Kwon Jeongseop Kim Hyunseong Park I. Choi 117 290 0 23 Feb 2021
Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data Tao R. Lin Sai Praneeth Karimireddy Sebastian U. Stich Martin Jaggi FedML 94 101 0 09 Feb 2021
Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learning Haibo Yang Minghong Fang Jia Liu FedML 88 261 0 27 Jan 2021
Personalized Federated Learning with First Order Model Optimization Michael Zhang Karan Sapra Sanja Fidler Serena Yeung J. Álvarez FedML 80 299 0 15 Dec 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 199 1,359 0 03 Oct 2020
HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients Enmao Diao Jie Ding Vahid Tarokh FedML 100 559 0 03 Oct 2020
Personalized Cross-Silo Federated Learning on Non-IID Data Yutao Huang Lingyang Chu Zirui Zhou Lanjun Wang Jiangchuan Liu J. Pei Yong Zhang FedML 105 613 0 07 Jul 2020
An Efficient Framework for Clustered Federated Learning Avishek Ghosh Jichan Chung Dong Yin Kannan Ramchandran FedML 87 869 0 07 Jun 2020
Adaptive Personalized Federated Learning Yuyang Deng Mohammad Mahdi Kamani M. Mahdavi FedML 318 560 0 30 Mar 2020
Adaptive Federated Optimization Sashank J. Reddi Zachary B. Charles Manzil Zaheer Zachary Garrett Keith Rush Jakub Konecný Sanjiv Kumar H. B. McMahan FedML 190 1,452 0 29 Feb 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 279 6,307 0 10 Dec 2019
Federated Learning with Personalization Layers Manoj Ghuhan Arivazhagan V. Aggarwal Aaditya Kumar Singh Sunav Choudhary FedML 96 840 0 02 Dec 2019
Overcoming Forgetting in Federated Learning on Non-IID Data N. Shoham Tomer Avidor Aviv Keren Nadav Tal-Israel Daniel Benditkis Liron Mor Yosef Itai Zeitak CLL FedML 135 226 0 17 Oct 2019
FedMD: Heterogenous Federated Learning via Model Distillation Daliang Li Junpu Wang FedML 104 862 0 08 Oct 2019
Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraints Felix Sattler K. Müller Wojciech Samek FedML 167 1,011 0 04 Oct 2019
The Non-IID Data Quagmire of Decentralized Machine Learning Kevin Hsieh Amar Phanishayee O. Mutlu Phillip B. Gibbons 182 573 0 01 Oct 2019
Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification T. Hsu Qi Matthew Brown FedML 150 1,166 0 13 Sep 2019
BrainTorrent: A Peer-to-Peer Environment for Decentralized Federated Learning Abhijit Guha Roy Shayan Siddiqui Sebastian Polsterl Nassir Navab Christian Wachinger FedML OOD MedIm 78 309 0 16 May 2019
Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication Anastasia Koloskova Sebastian U. Stich Martin Jaggi FedML 85 511 0 01 Feb 2019
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 193 1,070 0 24 May 2018
Group Normalization Yuxin Wu Kaiming He 249 3,676 0 22 Mar 2018
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent Xiangru Lian Ce Zhang Huan Zhang Cho-Jui Hsieh Wei Zhang Ji Liu 68 1,235 0 25 May 2017
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 414 17,615 0 17 Feb 2016
Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming Saeed Ghadimi Guanghui Lan ODL 124 1,562 0 22 Sep 2013