Making Batch Normalization Great in Federated Deep Learning

12 March 2023

Wei-Lun Chao

Papers citing "Making Batch Normalization Great in Federated Deep Learning"

23 / 23 papers shown

Title
Rethinking Normalization Methods in Federated Learning Zhixu Du Jingwei Sun Ang Li Pin-Yu Chen Jianyi Zhang H. Li Yiran Chen FedML 42 31 0 07 Oct 2022
Accelerated Federated Learning with Decoupled Adaptive Optimization Jiayin Jin Jiaxiang Ren Yang Zhou Lingjuan Lyu Ji Liu Dejing Dou AI4CE FedML 52 52 0 14 Jul 2022
EfficientFormer: Vision Transformers at MobileNet Speed Yanyu Li Geng Yuan Yang Wen Eric Hu Georgios Evangelidis Sergey Tulyakov Yanzhi Wang Jian Ren ViT 64 360 0 02 Jun 2022
Personalized Federated Learning with Adaptive Batchnorm for Healthcare Wang Lu Jindong Wang Yiqiang Chen Xin Qin Renjun Xu Dimitrios Dimitriadis Tao Qin FedML OOD 46 62 0 01 Dec 2021
Fed2: Feature-Aligned Federated Learning Fuxun Yu Weishan Zhang Zhuwei Qin Zirui Xu Di Wang Chenchen Liu Zhi Tian Xiang Chen FedML 51 76 0 28 Nov 2021
FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learning Nam Hyeon-Woo Moon Ye-Bin Tae-Hyun Oh FedML 63 120 0 13 Aug 2021
On Large-Cohort Training for Federated Learning Zachary B. Charles Zachary Garrett Zhouyuan Huo Sergei Shmulyian Virginia Smith FedML 51 112 0 15 Jun 2021
Federated Learning of User Verification Models Without Sharing Embeddings H. Hosseini Hyunsin Park Sungrack Yun Christos Louizos Joseph B. Soriaga Max Welling FedML 37 23 0 18 Apr 2021
FedBN: Federated Learning on Non-IID Features via Local Batch Normalization Xiaoxiao Li Meirui Jiang Xiaofei Zhang Michael Kamp Qi Dou OOD FedML 259 802 0 15 Feb 2021
HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients Enmao Diao Jie Ding Vahid Tarokh FedML 94 553 0 03 Oct 2020
Distilled One-Shot Federated Learning Yanlin Zhou George Pu Xiyao Ma Xiaolin Li D. Wu FedML DD 118 159 0 17 Sep 2020
FedBE: Making Bayesian Model Ensemble Applicable to Federated Learning Hong-You Chen Wei-Lun Chao FedML 52 260 0 04 Sep 2020
Siloed Federated Learning for Multi-Centric Histopathology Datasets M. Andreux Jean Ogier du Terrail C. Béguier Eric W. Tramel FedML OOD AI4CE 47 114 0 17 Aug 2020
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning Sai Praneeth Karimireddy Martin Jaggi Satyen Kale M. Mohri Sashank J. Reddi Sebastian U. Stich A. Suresh FedML 83 217 0 08 Aug 2020
Salvaging Federated Learning by Local Adaptation Tao Yu Eugene Bagdasaryan Vitaly Shmatikov FedML 45 262 0 12 Feb 2020
Variance Reduced Local SGD with Lower Communication Complexity Xian-Feng Liang Shuheng Shen Jingchang Liu Zhen Pan Enhong Chen Yifei Cheng FedML 71 153 0 30 Dec 2019
On the Convergence of Local Descent Methods in Federated Learning Farzin Haddadpour M. Mahdavi FedML 64 270 0 31 Oct 2019
The Non-IID Data Quagmire of Decentralized Machine Learning Kevin Hsieh Amar Phanishayee O. Mutlu Phillip B. Gibbons 121 563 0 01 Oct 2019
Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification T. Hsu Qi Matthew Brown FedML 121 1,128 0 13 Sep 2019
Understanding Batch Normalization Johan Bjorck Carla P. Gomes B. Selman Kilian Q. Weinberger 120 605 0 01 Jun 2018
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 156 1,056 0 24 May 2018
Group Normalization Yuxin Wu Kaiming He 184 3,626 0 22 Mar 2018
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 319 10,412 0 21 Jul 2016