Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning

17 March 2022

Lin Zhang

Li Shen

Liang Ding

Papers citing "Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning"

43 / 43 papers shown

Title
Corrected with the Latest Version: Make Robust Asynchronous Federated Learning Possible Chaoyi Lu Yiding Sun Pengbo Li Zhichuan Yang FedML 54 0 0 05 Apr 2025
FedSA: A Unified Representation Learning via Semantic Anchors for Prototype-based Federated Learning Yanbing Zhou Xiangmou Qu Chenlong You Jiyang Zhou Jingyue Tang Xin Zheng Chunmao Cai Yingbo Wu FedML 84 3 0 09 Jan 2025
A Unified Solution to Diverse Heterogeneities in One-shot Federated Learning Jun Bai Yiliao Song Di Wu Atul Sajjanhar Yong Xiang Wei Zhou Xiaohui Tao Yan Li Yuante Li FedML 64 0 0 28 Oct 2024
Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors Chun-Yin Huang Kartik Srinivas Xin Zhang Xiaoxiao Li DD 80 6 0 19 May 2024
Federated Class-Incremental Learning with Prompting Jiale Liu Yu-Wei Zhan Chong-Yu Zhang Xin Luo Zhen-Duo Chen Yinwei Wei CLL FedML 48 2 0 13 Oct 2023
Learning to Learn from APIs: Black-Box Data-Free Meta-Learning Zixuan Hu Li Shen Zhenyi Wang Baoyuan Wu Chun Yuan Dacheng Tao 74 7 0 28 May 2023
Architecture, Dataset and Model-Scale Agnostic Data-free Meta-Learning Zixuan Hu Li Shen Zhenyi Wang Tongliang Liu Chun Yuan Dacheng Tao 80 4 0 20 Mar 2023
Federated Learning Based on Dynamic Regularization D. A. E. Acar Yue Zhao Ramon Matas Navarro Matthew Mattina P. Whatmough Venkatesh Saligrama FedML 37 762 0 08 Nov 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 244 415 0 14 Jul 2021
Data-Free Knowledge Distillation for Heterogeneous Federated Learning Zhuangdi Zhu Junyuan Hong Jiayu Zhou FedML 43 645 0 20 May 2021
Clustered Sampling: Low-Variance and Improved Representativity for Clients Selection in Federated Learning Yann Fraboni Richard Vidal Laetitia Kameni Marco Lorenzi FedML 34 189 0 12 May 2021
Model-Contrastive Federated Learning Qinbin Li Bingsheng He D. Song FedML 38 1,024 0 30 Mar 2021
FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Space Quande Liu Cheng Chen J. Qin Qi Dou Pheng-Ann Heng OOD FedML 94 433 0 10 Mar 2021
FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learning Felix Sattler Tim Korjakow R. Rischke Wojciech Samek FedML 35 116 0 04 Feb 2021
Stochastic Client Selection for Federated Learning with Volatile Clients Tiansheng Huang Weiwei Lin Li Shen Keqin Li Albert Y. Zomaya FedML 72 98 0 17 Nov 2020
Optimal Client Sampling for Federated Learning Jiajun He Samuel Horváth Peter Richtárik FedML 59 195 0 26 Oct 2020
Particle Swarm Optimized Federated Learning For Industrial IoT and Smart City Services Basheer Qolomany Kashif Ahmad Ala I. Al-Fuqaha Junaid Qadir 36 63 0 05 Sep 2020
FedBE: Making Bayesian Model Ensemble Applicable to Federated Learning Hong-You Chen Wei-Lun Chao FedML 35 259 0 04 Sep 2020
Performance Optimization for Federated Person Re-identification via Benchmark Analysis Weiming Zhuang Yonggang Wen Xuesen Zhang Xin Gan Daiying Yin Dongzhan Zhou Shuai Zhang Shuai Yi FedML 83 95 0 26 Aug 2020
FedML: A Research Library and Benchmark for Federated Machine Learning Chaoyang He Songze Li Jinhyun So Xiao Zeng Mi Zhang ... Yang Liu Ramesh Raskar Qiang Yang M. Annavaram Salman Avestimehr FedML 200 571 0 27 Jul 2020
Ensemble Distillation for Robust Model Fusion in Federated Learning Tao R. Lin Lingjing Kong Sebastian U. Stich Martin Jaggi FedML 47 1,026 0 12 Jun 2020
Decentralised Learning from Independent Multi-Domain Labels for Person Re-Identification Guile Wu S. Gong OOD 49 27 0 07 Jun 2020
From Local SGD to Local Fixed-Point Methods for Federated Learning Grigory Malinovsky D. Kovalev Elnur Gasanov Laurent Condat Peter Richtárik FedML 105 115 0 03 Apr 2020
Data-Free Adversarial Distillation Gongfan Fang Mingli Song Chengchao Shen Xinchao Wang Da Chen Xiuming Zhang 29 146 0 23 Dec 2019
Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion Hongxu Yin Pavlo Molchanov Zhizhong Li J. Álvarez Arun Mallya Derek Hoiem N. Jha Jan Kautz 43 558 0 18 Dec 2019
Private Federated Learning with Domain Adaptation Daniel W. Peterson Pallika H. Kanani Virendra J. Marathe FedML 34 81 0 13 Dec 2019
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 96 6,177 0 10 Dec 2019
Learn Electronic Health Records by Fully Decentralized Federated Learning Songtao Lu Yawen Zhang Yunlong Wang C. Mack FedML 22 24 0 04 Dec 2019
Federated Learning for Ranking Browser History Suggestions Florian Hartmann Sunah Suh Arkadiusz Komarzewski Tim Smith I. Segall FedML 27 55 0 26 Nov 2019
Model Fusion via Optimal Transport Sidak Pal Singh Martin Jaggi MoMe FedML 65 231 0 12 Oct 2019
Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification T. Hsu Qi Matthew Brown FedML 101 1,128 0 13 Sep 2019
HHHFL: Hierarchical Heterogeneous Horizontal Federated Learning for Electroencephalography Dashan Gao Ce Ju Xiguang Wei Yang Liu Tianjian Chen Qiang Yang FedML 97 92 0 11 Sep 2019
Tighter Theory for Local SGD on Identical and Heterogeneous Data Ahmed Khaled Konstantin Mishchenko Peter Richtárik 46 432 0 10 Sep 2019
On the Convergence of FedAvg on Non-IID Data Xiang Li Kaixuan Huang Wenhao Yang Shusen Wang Zhihua Zhang FedML 123 2,311 0 04 Jul 2019
Bayesian Nonparametric Federated Learning of Neural Networks Mikhail Yurochkin Mayank Agarwal S. Ghosh Kristjan Greenewald T. Hoang Y. Khazaeni FedML 113 724 0 28 May 2019
Zero-Shot Knowledge Distillation in Deep Networks Gaurav Kumar Nayak Konda Reddy Mopuri Vaisakh Shaj R. Venkatesh Babu Anirban Chakraborty 63 245 0 20 May 2019
Data-Free Learning of Student Networks Hanting Chen Yunhe Wang Chang Xu Zhaohui Yang Chuanjian Liu Boxin Shi Chunjing Xu Chao Xu Qi Tian FedML 30 367 0 02 Apr 2019
Federated Optimization in Heterogeneous Networks Tian Li Anit Kumar Sahu Manzil Zaheer Maziar Sanjabi Ameet Talwalkar Virginia Smith FedML 78 5,105 0 14 Dec 2018
Federated Learning for Mobile Keyboard Prediction Andrew Straiton Hard Kanishka Rao Zhifeng Lin Swaroop Indra Ramaswamy Youjie Li S. Augenstein Alex Schwing M. Annavaram A. Avestimehr FedML 96 1,525 0 08 Nov 2018
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 200 17,235 0 17 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.1K 192,638 0 10 Dec 2015
A Large-Scale Car Dataset for Fine-Grained Categorization and Verification L. Yang Ping Luo Chen Change Loy Xiaoou Tang 24 812 0 30 Jun 2015
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 751 99,991 0 04 Sep 2014