Title
FLAME: Towards Federated Fine-Tuning Large Language Models Through Adaptive SMoE Khiem Le Tuan V. Tran Ting Hua Nitesh Chawla MoE 19 0 0 19 Jun 2025
Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation Zikai Zhang Ping Liu Jiahao Xu Rui Hu 45 0 0 13 Jun 2025
FedNano: Toward Lightweight Federated Tuning for Pretrained Multimodal Large Language Models Y. Zhang Hewei Gao Haokun Chen Weiguo Li Yunpu Ma Volker Tresp 26 1 0 12 Jun 2025
FLoRIST: Singular Value Thresholding for Efficient and Accurate Federated Fine-Tuning of Large Language Models Hariharan Ramesh Jyotikrishna Dass 39 0 0 10 Jun 2025
Come Together, But Not Right Now: A Progressive Strategy to Boost Low-Rank Adaptation Zhan Zhuang Xiequn Wang Wei Li Yulong Zhang Qiushi Huang ... Yanbin Wei Yuhe Nie Kede Ma Yu Zhang Ying Wei 64 0 0 06 Jun 2025
FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCA Divyansh Jhunjhunwala Arian Raje Madan Ravi Ganesh Chaithanya Kumar Mummadi Chaoqun Dong Jiawei Zhou Wan-Yi Lin Gauri Joshi Zhenzhen Li 56 0 0 01 Jun 2025
SafeTy Reasoning Elicitation Alignment for Multi-Turn Dialogues Martin Kuo Jianyi Zhang Aolin Ding Louis DiValentin Amin Hass ... Bhavna Gopal Maziyar Baran Pouyan Changwei Liu H. Li Yiran Chen AAML 30 0 0 31 May 2025
Adaptive Federated LoRA in Heterogeneous Wireless Networks with Independent Sampling Yanzhao Hou Jiaxiang Geng Boyu Li Xiaofeng Tao Juncheng Wang Xiaodong Xu B. Luo 63 0 0 29 May 2025
SHE-LoRA: Selective Homomorphic Encryption for Federated Tuning with Heterogeneous LoRA Jianmin Liu Li Yan Borui Li Lei Yu Chao Shen 31 0 0 27 May 2025
FedHL: Federated Learning for Heterogeneous Low-Rank Adaptation via Unbiased Aggregation Zihao Peng Jiandian Zeng Boyuan Li Guo Li Shengbo Chen Tian Wang FedML 117 0 0 24 May 2025
A Federated Splitting Framework for LLMs: Security, Efficiency, and Adaptability Zishuai Zhang Hainan Zhang JiaYing Zheng Ziwei Wang Yongxin Tong Jin Dong Zhiming Zheng FedML 81 0 0 21 May 2025
FedSVD: Adaptive Orthogonalization for Private Federated Learning with LoRA Seanie Lee Sangwoo Park Dong Bok Lee Dominik Wagner Haebin Seong Tobias Bocklet Juho Lee Sung Ju Hwang FedML 113 0 0 19 May 2025
Federated Low-Rank Adaptation for Foundation Models: A Survey Yiyuan Yang Guodong Long Qinghua Lu Liming Zhu Jing Jiang Chengqi Zhang AI4CE 80 0 0 16 May 2025
Towards Artificial General or Personalized Intelligence? A Survey on Foundation Models for Personalized Federated Intelligence Yu Qiao Huy Q. Le Avi Deb Raha Phuong-Nam Tran Apurba Adhikary Mengchun Zhang Loc X. Nguyen Eui-nam Huh Dusit Niyato Choong Seon Hong AI4CE 165 1 0 11 May 2025
Dynamic Domain Information Modulation Algorithm for Multi-domain Sentiment Analysis Chunyi Yue Ang Li 73 0 0 10 May 2025
FedTDP: A Privacy-Preserving and Unified Framework for Trajectory Data Preparation via Federated Learning Zhihao Zeng Ziquan Fang Wei Shao Lu Chen Yunjun Gao FedML 97 0 0 08 May 2025
HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models Zheng Lin Yuxin Zhang Zhe Chen Zihan Fang Xianhao Chen Praneeth Vepakomma Wei Ni Jun Luo Yue Gao MoE 97 4 0 05 May 2025
Federated Adapter on Foundation Models: An Out-Of-Distribution Approach Yiyuan Yang Guodong Long Dinesh Manocha Qinghua Lu Shanshan Ye Jing Jiang OODD 517 2 0 02 May 2025
Communication-Efficient Wireless Federated Fine-Tuning for Large-Scale AI Models Bumjun Kim Wan Choi 98 0 0 01 May 2025
A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning Jieming Bian Yuanzhe Peng Lei Wang Yin Huang Jie Xu FedML 122 1 0 29 Apr 2025
FedMerge: Federated Personalization via Model Merging Shutong Chen Tianyi Zhou Guodong Long Jing Jiang Chengqi Zhang FedML MoMe 146 0 0 09 Apr 2025
Federated Continual Instruction Tuning Haiyang Guo Fanhu Zeng Fei Zhu Wenzhuo Liu Da-Han Wang Jian Xu Xu-Yao Zhang Cheng-Lin Liu CLL FedML 185 2 0 17 Mar 2025
A Survey on Federated Fine-tuning of Large Language Models Yebo Wu Chunlin Tian Jingguang Li He Sun Kahou Tam Zhanting Zhou Haicheng Liao Zhijiang Guo Li Li Chengzhong Xu FedML 164 5 0 15 Mar 2025
FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA Jieming Bian Lei Wang Letian Zhang Jie Xu 112 3 0 14 Mar 2025
FedRand: Enhancing Privacy in Federated Learning with Randomized LoRA Subparameter Updates Sangwoo Park Seanie Lee Byungjoo Kim Sung Ju Hwang FedML 82 1 0 10 Mar 2025
Personalized Federated Fine-tuning for Heterogeneous Data: An Automatic Rank Learning Approach via Two-Level LoRA Jie Hao Yuman Wu Ali Payani Myungjin Lee Mingrui Liu 126 2 0 05 Mar 2025
Proactive Privacy Amnesia for Large Language Models: Safeguarding PII with Negligible Impact on Model Utility Martin Kuo Jingyang Zhang Jianyi Zhang Minxue Tang Louis DiValentin ... William Chen Amin Hass Tianlong Chen Yuxiao Chen Haoyang Li MU KELM 125 4 0 24 Feb 2025
Fed-SB: A Silver Bullet for Extreme Communication Efficiency and Performance in (Private) Federated LoRA Fine-Tuning Raghav Singhal Kaustubh Ponkshe Rohit Vartak Lav R. Varshney Praneeth Vepakomma FedML 130 4 0 24 Feb 2025
A General Pseudonymization Framework for Cloud-Based LLMs: Replacing Privacy Information in Controlled Text Generation Shilong Hou Ruilin Shang Zi Long Xianghua Fu Yin Chen 123 1 0 24 Feb 2025
Ten Challenging Problems in Federated Foundation Models Tao Fan Hanlin Gu Xuemei Cao Chee Seng Chan Qian Chen ... Yu Zhang Xiaojin Zhang Zhenzhe Zheng Lixin Fan Qiang Yang FedML 180 8 0 14 Feb 2025
A Framework for Double-Blind Federated Adaptation of Foundation Models Nurbek Tastan Karthik Nandakumar FedML 88 0 0 03 Feb 2025
Privacy in Fine-tuning Large Language Models: Attacks, Defenses, and Future Directions Hao Du Shang Liu Lele Zheng Yang Cao Atsuyoshi Nakamura Lei Chen AAML 213 5 0 21 Dec 2024
Federated Learning and RAG Integration: A Scalable Approach for Medical Large Language Models Jincheol Jung Hongju Jeong Eui-Nam Huh 205 0 0 18 Dec 2024
Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures Yicheng Zhang Zhen Qin Zhaomin Wu Jian Hou Shuiguang Deng 194 3 0 28 Nov 2024
SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Models Jianyi Zhang Da-Cheng Juan Cyrus Rashtchian Chun-Sung Ferng Heinrich Jiang Yiran Chen 94 4 0 01 Nov 2024
CopRA: A Progressive LoRA Training Strategy Zhan Zhuang Xiequn Wang Yulong Zhang Wei Li Yu Zhang Ying Wei 121 1 0 30 Oct 2024
Federated Data-Efficient Instruction Tuning for Large Language Models Zhen Qin Zhaomin Wu Bingsheng He Shuiguang Deng FedML 120 2 0 14 Oct 2024
Fed-pilot: Optimizing LoRA Allocation for Efficient Federated Fine-Tuning with Heterogeneous Clients Zikai Zhang Jiahao Xu Ping Liu Rui Hu 68 5 0 14 Oct 2024
Federated Instruction Tuning of LLMs with Domain Coverage Augmentation Zezhou Wang Yaxin Du Zhuzhong Qian Yugang Jiang Zhuzhong Qian Siheng Chen FedML 526 1 0 30 Sep 2024
Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clustering Ziyu Zhao Tao Shen Didi Zhu Zexi Li Jing Su Xuwu Wang Kun Kuang Fei Wu MoMe 116 18 0 24 Sep 2024
Federated Large Language Models: Current Progress and Future Directions Yuhang Yao Jianyi Zhang Junda Wu Chengkai Huang Yu Xia ... Ang Li Lina Yao Julian McAuley Yiran Chen Carlee Joe-Wong FedML AIFin 131 12 0 24 Sep 2024
On-Device Collaborative Language Modeling via a Mixture of Generalists and Specialists Dongyang Fan Bettina Messmer N. Doikov Martin Jaggi MoE MoMe 111 2 0 20 Sep 2024
Leveraging Unstructured Text Data for Federated Instruction Tuning of Large Language Models Rui Ye Rui Ge Yuchi Fengting Jingyi Chai Yanfeng Wang Siheng Chen FedML 114 2 0 11 Sep 2024
Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models Yao Shu Wenyang Hu Szu Hui Ng Bryan Kian Hsiang Low Fei Richard Yu FedML 105 2 0 10 Sep 2024
MLLM-FL: Multimodal Large Language Model Assisted Federated Learning on Heterogeneous and Long-tailed Data Jianyi Zhang H. Yang Ang Li Xin Guo Pu Wang Haiming Wang Yiran Chen Hai Li 68 3 0 09 Sep 2024
FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations Ziyao Wang Zheyu Shen Yexiao He Guoheng Sun Hongyi Wang Lingjuan Lyu Ang Li 95 49 0 09 Sep 2024
Towards Hyper-parameter-free Federated Learning Geetika Drishya Uniyal Bapi Chatterjee FedML 101 0 0 30 Aug 2024
Fine-Tuning and Deploying Large Language Models Over Edges: Issues and Approaches Yanjie Dong Xiaoyi Fan Fangxin Wang Chengming Li Victor C. M. Leung Xiping Hu 56 5 0 20 Aug 2024
Casper: Prompt Sanitization for Protecting User Privacy in Web-Based Large Language Models Chun Jie Chong Chenxi Hou Z. Yao S. Talebi 83 7 0 13 Aug 2024
On ADMM in Heterogeneous Federated Learning: Personalization, Robustness, and Fairness Shengkun Zhu Jinshan Zeng Sheng Wang Yuan Sun Xiaodong Li Yuan Yao Zhiyong Peng 103 0 0 23 Jul 2024