Heterogeneous Ensemble Knowledge Transfer for Training Large Models in
Federated Learning

Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning

27 April 2022

Dimitrios Dimitriadis

Papers citing "Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning"

19 / 19 papers shown

Title
FedBEns: One-Shot Federated Learning based on Bayesian Ensemble Jacopo Talpini Marco Savi Giovanni Neglia FedML Presented at ResearchTrend Connect \| FedML on 07 May 2025 76 0 0 19 Mar 2025
Moss: Proxy Model-based Full-Weight Aggregation in Federated Learning with Heterogeneous Models Y. Cai Ziqi Zhang Ding Li Yao Guo Xiangqun Chen 55 0 0 13 Mar 2025
Provably Near-Optimal Federated Ensemble Distillation with Negligible Overhead Won-Jun Jang Hyeon-Seo Park Si-Hyeon Lee FedML 178 0 0 10 Feb 2025
Beyond Model Scale Limits: End-Edge-Cloud Federated Learning with Self-Rectified Knowledge Agglomeration Zhiyuan Wu Sheng Sun Yuwei Wang Min Liu Ke Xu Quyang Pan Bo Gao Tian Wen FedML 30 0 0 03 Jan 2025
Federated Learning with Label-Masking Distillation Jianghu Lu Shikun Li Kexin Bao Pengju Wang Zhenxing Qian Shiming Ge FedML 47 10 0 20 Sep 2024
On ADMM in Heterogeneous Federated Learning: Personalization, Robustness, and Fairness Shengkun Zhu Jinshan Zeng Sheng Wang Yuan Sun Xiaodong Li Yuan Yao Zhiyong Peng 49 0 0 23 Jul 2024
FedDr+: Stabilizing Dot-regression with Global Feature Distillation for Federated Learning Seongyoon Kim Minchan Jeong Sungnyun Kim Sungwoo Cho Sumyeong Ahn Se-Young Yun FedML 47 0 0 04 Jun 2024
Federated Model Heterogeneous Matryoshka Representation Learning Liping Yi Han Yu Chao Ren Gang Wang Xiaoguang Liu Xiaoxiao Li FedML 43 8 0 01 Jun 2024
AdaptiveFL: Adaptive Heterogeneous Federated Learning for Resource-Constrained AIoT Systems Chentao Jia Ming Hu Zekai Chen Yanxin Yang Xiaofei Xie Yang Liu Mingsong Chen 27 6 0 22 Nov 2023
FedMultimodal: A Benchmark For Multimodal Federated Learning Tiantian Feng Digbalay Bose Tuo Zhang Rajat Hebbar Anil Ramakrishna Rahul Gupta Mi Zhang Salman Avestimehr Shrikanth Narayanan 32 48 0 15 Jun 2023
Knowledge Distillation in Federated Edge Learning: A Survey Zhiyuan Wu Sheng Sun Yuwei Wang Min Liu Xue Jiang Runhan Li Bo Gao FedML 27 4 0 14 Jan 2023
FedICT: Federated Multi-task Distillation for Multi-access Edge Computing Zhiyuan Wu Sheng Sun Yuwei Wang Min Liu Quyang Pan Xue Jiang Bo Gao 35 31 0 01 Jan 2023
DYNAFED: Tackling Client Data Heterogeneity with Global Dynamics Renjie Pi Weizhong Zhang Yueqi Xie Jiahui Gao Xiaoyu Wang Sunghun Kim Qifeng Chen DD 39 26 0 20 Nov 2022
Completely Heterogeneous Federated Learning Chang-Shu Liu Yuwen Yang Xun Cai Yue Ding Hongtao Lu FedML 20 8 0 28 Oct 2022
Towards Efficient Communications in Federated Learning: A Contemporary Survey Zihao Zhao Yuzhu Mao Yang Liu Linqi Song Ouyang Ye Xinlei Chen Wenbo Ding FedML 54 59 0 02 Aug 2022
FEL: High Capacity Learning for Recommendation and Ranking via Federated Ensemble Learning Meisam Hejazinia Dzmitry Huba Ilias Leontiadis Kiwan Maeng Mani Malek Luca Melis Ilya Mironov Milad Nasr Kaikai Wang Carole-Jean Wu FedML 9 5 0 07 Jun 2022
Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics Prajjwal Bhargava Aleksandr Drozd Anna Rogers 98 101 0 04 Oct 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 187 412 0 14 Jul 2021
Knowledge Distillation by On-the-Fly Native Ensemble Xu Lan Xiatian Zhu S. Gong 195 473 0 12 Jun 2018