Ensemble Distillation for Robust Model Fusion in Federated Learning

12 June 2020

Papers citing "Ensemble Distillation for Robust Model Fusion in Federated Learning"

50 / 166 papers shown

Title
Soft-Label Caching and Sharpening for Communication-Efficient Federated Distillation Kitsuya Azuma Takayuki Nishio Yuichi Kitagawa Wakako Nakano Takahito Tanimura FedML 70 0 0 28 Apr 2025
Privacy-Preserving Federated Embedding Learning for Localized Retrieval-Augmented Generation Qianren Mao Qili Zhang Hanwen Hao Zhentao Han Runhua Xu ... Bo Li Y. Song Jin Dong Jianxin Li Philip S. Yu 71 1 0 27 Apr 2025
Learning Critically: Selective Self Distillation in Federated Learning on Non-IID Data Yuting He Yiqiang Chen Xiaodong Yang H. Yu Yi-Hua Huang Yang Gu FedML 55 20 0 20 Apr 2025
A Novel Algorithm for Personalized Federated Learning: Knowledge Distillation with Weighted Combination Loss Hengrui Hu Anai N. Kothari Anjishnu Banerjee FedML 38 0 0 06 Apr 2025
Corrected with the Latest Version: Make Robust Asynchronous Federated Learning Possible Chaoyi Lu Yiding Sun Pengbo Li Zhichuan Yang FedML 34 0 0 05 Apr 2025
CityGS-X: A Scalable Architecture for Efficient and Geometrically Accurate Large-Scale Scene Reconstruction Yuanyuan Gao Hao Li Jiaqi Chen Zhengyu Zou Zhihang Zhong Dingwen Zhang Xiao-Fu Sun Junwei Han 3DGS 55 0 0 29 Mar 2025
FedLWS: Federated Learning with Adaptive Layer-wise Weight Shrinking Changlong Shi Jinmeng Li He Zhao D. Guo Yi Chang FedML 47 0 0 19 Mar 2025
FedBEns: One-Shot Federated Learning based on Bayesian Ensemble Jacopo Talpini Marco Savi Giovanni Neglia FedML Presented at ResearchTrend Connect \| FedML on 07 May 2025 76 0 0 19 Mar 2025
dFLMoE: Decentralized Federated Learning via Mixture of Experts for Medical Data Analysis Luyuan Xie Tianyu Luan Wenyuan Cai Guochen Yan Z. Chen Nan Xi Yuejian Fang Qingni Shen Zhonghai Wu Junsong Yuan FedML 65 0 0 13 Mar 2025
Moss: Proxy Model-based Full-Weight Aggregation in Federated Learning with Heterogeneous Models Y. Cai Ziqi Zhang Ding Li Yao Guo Xiangqun Chen 50 0 0 13 Mar 2025
Robust Asymmetric Heterogeneous Federated Learning with Corrupted Clients Xiuwen Fang Mang Ye Bo Du FedML 68 1 0 12 Mar 2025
You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data Shanshan Yan Zexi Li Chao-Xiang Wu Meng Pang Yang Lu Yan Yan Hanzi Wang FedML 61 0 0 10 Mar 2025
Capture Global Feature Statistics for One-Shot Federated Learning Zenghao Guan Yucan Zhou Xiaoyan Gu FedML 63 0 0 10 Mar 2025
Geometric Knowledge-Guided Localized Global Distribution Alignment for Federated Learning Yanbiao Ma Wei-Ming Dai Wenke Huang Jiayi Chen 94 0 0 09 Mar 2025
FedConv: A Learning-on-Model Paradigm for Heterogeneous Federated Clients Leming Shen Qiang Yang Kaiyan Cui Yuanqing Zheng Xiao-Yong Wei Jianwei Liu Jinsong Han FedML 66 11 0 28 Feb 2025
FedCC: Robust Federated Learning against Model Poisoning Attacks Hyejun Jeong H. Son Seohu Lee Jayun Hyun T. Chung FedML 58 5 0 20 Feb 2025
Secure Federated Data Distillation Marco Arazzi Mert Cihangiroglu S. Nicolazzo Antonino Nocera FedML DD 98 0 0 19 Feb 2025
Provably Near-Optimal Federated Ensemble Distillation with Negligible Overhead Won-Jun Jang Hyeon-Seo Park Si-Hyeon Lee FedML 169 0 0 10 Feb 2025
BrainGuard: Privacy-Preserving Multisubject Image Reconstructions from Brain Activities Zhibo Tian Ruijie Quan Fan Ma Kun Zhan Yi Yang 31 1 0 24 Jan 2025
Federated Learning with Sample-level Client Drift Mitigation Haoran Xu Jiaze Li Wanyi Wu Hao Ren FedML 44 0 0 20 Jan 2025
FedSA: A Unified Representation Learning via Semantic Anchors for Prototype-based Federated Learning Yanbing Zhou Xiangmou Qu Chenlong You Jiyang Zhou Jingyue Tang Xin Zheng Chunmao Cai Yingbo Wu FedML 50 1 0 09 Jan 2025
Rehearsal-Free Continual Federated Learning with Synergistic Synaptic Intelligence Yichen Li Yuying Wang Tianzhe Xiao Haozhao Wang Yining Qi Ruixuan Li 121 0 0 18 Dec 2024
Optimizing Personalized Federated Learning through Adaptive Layer-Wise Learning Weihang Chen Jie Ren Zhiqiang Li Ling Gao Z. Wang AI4CE 120 0 0 10 Dec 2024
A Unified Solution to Diverse Heterogeneities in One-shot Federated Learning Jun Bai Yiliao Song Di Wu Atul Sajjanhar Yong Xiang Wei Zhou Xiaohui Tao Yan Li Y. Li FedML 55 0 0 28 Oct 2024
FedPeWS: Personalized Warmup via Subnetworks for Enhanced Heterogeneous Federated Learning Nurbek Tastan Samuel Horváth Martin Takáč Karthik Nandakumar FedML 57 0 0 03 Oct 2024
Federated Learning with Label-Masking Distillation Jianghu Lu Shikun Li Kexin Bao Pengju Wang Zhenxing Qian Shiming Ge FedML 39 10 0 20 Sep 2024
FedNE: Surrogate-Assisted Federated Neighbor Embedding for Dimensionality Reduction Ziwei Li Xiaoqi Wang Hong-You Chen Han-Wei Shen Wei-Lun Chao FedML 32 0 0 17 Sep 2024
Erasure Coded Neural Network Inference via Fisher Averaging Divyansh Jhunjhunwala Neharika Jali Gauri Joshi Shiqiang Wang MoMe FedML 26 1 0 02 Sep 2024
The Key of Parameter Skew in Federated Learning Sifan Wang Junfeng Liao Ye Yuan Riquan Zhang FedML 33 0 0 21 Aug 2024
On ADMM in Heterogeneous Federated Learning: Personalization, Robustness, and Fairness Shengkun Zhu Jinshan Zeng Sheng Wang Yuan Sun Xiaodong Li Yuan Yao Zhiyong Peng 44 0 0 23 Jul 2024
Federated Distillation for Medical Image Classification: Towards Trustworthy Computer-Aided Diagnosis Sufen Ren Yule Hu Shengchao Chen Guanjun Wang 29 1 0 02 Jul 2024
FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model Feijie Wu Zitao Li Yaliang Li Bolin Ding Jing Gao 34 41 0 25 Jun 2024
Personalized federated learning based on feature fusion Wolong Xing Zhenkui Shi Hongyan Peng Xiantao Hu Xianxian Li FedML 33 0 0 24 Jun 2024
FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning Jiaxing Qi Zhongzhi Luan Shaohan Huang Carol J. Fung Hailong Yang Depei Qian 32 12 0 12 Jun 2024
FedDr+: Stabilizing Dot-regression with Global Feature Distillation for Federated Learning Seongyoon Kim Minchan Jeong Sungnyun Kim Sungwoo Cho Sumyeong Ahn Se-Young Yun FedML 47 0 0 04 Jun 2024
Federated Model Heterogeneous Matryoshka Representation Learning Liping Yi Han Yu Chao Ren Gang Wang Xiaoguang Liu Xiaoxiao Li FedML 43 8 0 01 Jun 2024
Hybrid-Parallel: Achieving High Performance and Energy Efficient Distributed Inference on Robots Zekai Sun Xiuxian Guan Junming Wang Haoze Song Yuhao Qing Tianxiang Shen Dong Huang Fangming Liu Heming Cui 34 0 0 29 May 2024
Harnessing Increased Client Participation with Cohort-Parallel Federated Learning Akash Dhasade Anne-Marie Kermarrec Tuan-Anh Nguyen Rafael Pires M. Vos FedML 33 0 0 24 May 2024
Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors Chun-Yin Huang Kartik Srinivas Xin Zhang Xiaoxiao Li DD 52 6 0 19 May 2024
Stable Diffusion-based Data Augmentation for Federated Learning with Non-IID Data Mahdi Morafah M. Reisser Bill Lin Christos Louizos FedML 34 5 0 13 May 2024
DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation Jie Xu Karthikeyan P. Saravanan Rogier van Dalen Haaris Mehmood David Tuckey Mete Ozay 56 5 0 10 May 2024
FedDistill: Global Model Distillation for Local Model De-Biasing in Non-IID Federated Learning Changlin Song Divya Saxena Jiannong Cao Yuqing Zhao FedML 39 3 0 14 Apr 2024
FedUV: Uniformity and Variance for Heterogeneous Federated Learning Ha Min Son M. Kim Tai-Myung Chung Chao Huang Xin Liu FedML 41 3 0 27 Feb 2024
Practical Insights into Knowledge Distillation for Pre-Trained Models Norah Alballa Marco Canini 45 2 0 22 Feb 2024
On the Byzantine-Resilience of Distillation-Based Federated Learning Christophe Roux Max Zimmer S. Pokutta AAML 49 1 0 19 Feb 2024
FedImpro: Measuring and Improving Client Update in Federated Learning Zhenheng Tang Yonggang Zhang S. Shi Xinmei Tian Tongliang Liu Bo Han Xiaowen Chu FedML 19 13 0 10 Feb 2024
Flashback: Understanding and Mitigating Forgetting in Federated Learning Mohammed Aljahdali A. Abdelmoniem Marco Canini Samuel Horváth 24 2 0 08 Feb 2024
Spectral Co-Distillation for Personalized Federated Learning Zihan Chen Howard H. Yang Tony Q. S. Quek Kai Fong Ernest Chong OOD FedML 29 13 0 29 Jan 2024
A review on different techniques used to combat the non-IID and heterogeneous nature of data in FL Iyer Venkataraman Natarajan 23 8 0 01 Jan 2024
FedDiv: Collaborative Noise Filtering for Federated Learning with Noisy Labels Jichang Li Guanbin Li Hui Cheng Zicheng Liao Yizhou Yu FedML 32 14 0 19 Dec 2023