Papers
Communities
Organizations
Events
Blog
Pricing
Search
Open menu
Home
Papers
2305.05644
Cited By
v1
v2 (latest)
Towards Building the Federated GPT: Federated Instruction Tuning
9 May 2023
Jianyi Zhang
Saeed Vahidian
Martin Kuo
Chunyuan Li
Ruiyi Zhang
Tong Yu
Yufan Zhou
Guoyin Wang
Yiran Chen
ALM
FedML
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Towards Building the Federated GPT: Federated Instruction Tuning"
39 / 89 papers shown
Title
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey
Guanqiao Qu
Qiyuan Chen
Wei Wei
Zheng Lin
Xianhao Chen
Kaibin Huang
196
56
0
09 Jul 2024
SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
Zheng Lin
Xuanjie Hu
Yuxin Zhang
Zhe Chen
Zihan Fang
Xianhao Chen
Ang Li
Praneeth Vepakomma
Yue Gao
96
37
0
01 Jul 2024
FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model
Feijie Wu
Zitao Li
Yaliang Li
Bolin Ding
Jing Gao
117
55
0
25 Jun 2024
Synergizing Foundation Models and Federated Learning: A Survey
Shenghui Li
Fanghua Ye
Meng Fang
Jiaxu Zhao
Yun-Hin Chan
Edith C. -H. Ngai
Thiemo Voigt
AI4CE
127
7
0
18 Jun 2024
Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Models
Rui Ye
Jingyi Chai
Xiangrui Liu
Yaodong Yang
Yanfeng Wang
Siheng Chen
AAML
158
10
0
15 Jun 2024
FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning
Jiaxing Qi
Zhongzhi Luan
Shaohan Huang
Carol J. Fung
Hailong Yang
Depei Qian
98
21
0
12 Jun 2024
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs
Charlie Hou
Akshat Shrivastava
Hongyuan Zhan
Rylan Conway
Trang Le
Adithya Sagar
Giulia Fanti
Daniel Lazar
118
15
0
05 Jun 2024
Accelerating Heterogeneous Federated Learning with Closed-form Classifiers
Eros Fani
Raffaello Camoriano
Barbara Caputo
Marco Ciccone
88
4
0
03 Jun 2024
DAGER: Exact Gradient Inversion for Large Language Models
Ivo Petrov
Dimitar I. Dimitrov
Maximilian Baader
Mark Niklas Muller
Martin Vechev
FedML
101
5
0
24 May 2024
Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecasting
Qingxiang Liu
Xu Liu
Chenghao Liu
Qingsong Wen
Yuxuan Liang
AI4TS
AI4CE
111
11
0
23 May 2024
The Future of Large Language Model Pre-training is Federated
Lorenzo Sani
Alexandru Iacob
Zeyu Cao
Bill Marino
Yan Gao
...
Wanru Zhao
William F. Shen
Preslav Aleksandrov
Xinchi Qiu
Nicholas D. Lane
AI4CE
163
21
0
17 May 2024
From Sora What We Can See: A Survey of Text-to-Video Generation
Rui Sun
Yumin Zhang
Tejal Shah
Jiahao Sun
Shuoying Zhang
Wenqi Li
Haoran Duan
Bo Wei
R. Ranjan
EGVM
136
20
0
17 May 2024
FL-TAC: Enhanced Fine-Tuning in Federated Learning via Low-Rank, Task-Specific Adapter Clustering
Siqi Ping
Yuzhu Mao
Yang Liu
Xiao-Ping Zhang
Wenbo Ding
FedML
83
4
0
23 Apr 2024
Advances and Open Challenges in Federated Learning with Foundation Models
Chao Ren
Han Yu
Hongyi Peng
Xiaoli Tang
Anran Li
...
A. Tan
Bo Zhao
Xiaoxiao Li
Zengxiang Li
Qiang Yang
FedML
AIFin
AI4CE
156
11
0
23 Apr 2024
Personalized Wireless Federated Learning for Large Language Models
Feibo Jiang
Li Dong
Siwei Tu
Yubo Peng
Kezhi Wang
Kun Yang
Cunhua Pan
Dusit Niyato
104
13
0
20 Apr 2024
FedEval-LLM: Federated Evaluation of Large Language Models on Downstream Tasks with Collective Wisdom
Yuanqin He
Yan Kang
Lixin Fan
Qiang Yang
62
3
0
18 Apr 2024
Personalized Collaborative Fine-Tuning for On-Device Large Language Models
Nicolas Wagner
Dongyang Fan
Martin Jaggi
104
4
0
15 Apr 2024
Collaborative Learning of Anomalies with Privacy (CLAP) for Unsupervised Video Anomaly Detection: A New Baseline
Anas Al-Lahham
Muhammad Zaigham Zaheer
Nurbek Tastan
Karthik Nandakumar
73
9
0
01 Apr 2024
Dual-Personalizing Adapter for Federated Foundation Models
Yiyuan Yang
Guodong Long
Taoshu Shen
Jing Jiang
Michael Blumenstein
135
27
0
28 Mar 2024
On Protecting the Data Privacy of Large Language Models (LLMs): A Survey
Biwei Yan
Kun Li
Minghui Xu
Yueyan Dong
Yue Zhang
Zhaochun Ren
Xiuzhen Cheng
AILaw
PILM
154
88
0
08 Mar 2024
Personalized Federated Instruction Tuning via Neural Architecture Search
Peng Zhang
Yingbo Zhou
Ming Hu
Junxian Feng
Jiawen Weng
Mingsong Chen
FedML
79
5
0
26 Feb 2024
OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learning
Rui Ye
Wenhao Wang
Jingyi Chai
Dihan Li
Zexi Li
Yinda Xu
Yaxin Du
Yanfeng Wang
Siheng Chen
ALM
FedML
AIFin
106
98
0
10 Feb 2024
On the Convergence of Zeroth-Order Federated Tuning for Large Language Models
Zhenqing Ling
Daoyuan Chen
Liuyi Yao
Yaliang Li
Ying Shen
FedML
116
17
0
08 Feb 2024
A Fast, Performant, Secure Distributed Training Framework For Large Language Model
Wei Huang
Yinggui Wang
Anda Cheng
Aihui Zhou
Chaofan Yu
Lei Wang
ALM
47
13
0
18 Jan 2024
FedMS: Federated Learning with Mixture of Sparsely Activated Foundations Models
Panlong Wu
Kangshuo Li
Ting Wang
Fangxin Wang
FedML
MoE
91
4
0
26 Dec 2023
Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes
Zhen Qin
Daoyuan Chen
Bingchen Qian
Bolin Ding
Yaliang Li
Shuiguang Deng
FedML
113
39
0
11 Dec 2023
Grounding Foundation Models through Federated Transfer Learning: A General Framework
Yan Kang
Tao Fan
Hanlin Gu
Xiaojin Zhang
Lixin Fan
Qiang Yang
AI4CE
195
19
0
29 Nov 2023
FedPEAT: Convergence of Federated Learning, Parameter-Efficient Fine Tuning, and Emulator Assisted Tuning for Artificial Intelligence Foundation Models with Mobile Edge Computing
Terence Jie Chua
Wen-li Yu
Junfeng Zhao
Kwok-Yan Lam
FedML
64
5
0
26 Oct 2023
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning
Liam Collins
Shanshan Wu
Sewoong Oh
K. Sim
FedML
96
10
0
06 Oct 2023
Federated Fine-Tuning of LLMs on the Very Edge: The Good, the Bad, the Ugly
Herbert Woisetschläger
Alexander Erben
Shiqiang Wang
R. Mayer
Hans-Arno Jacobsen
FedML
91
21
0
04 Oct 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models
Zihao Lin
Yan Sun
Yifan Shi
Xueqian Wang
Lifu Huang
Li Shen
Dacheng Tao
98
12
0
04 Oct 2023
Building Privacy-Preserving and Secure Geospatial Artificial Intelligence Foundation Models
Jinmeng Rao
Song Gao
Gengchen Mai
Joanna M. Wardlaw
84
22
0
29 Sep 2023
A Survey on Privacy in Graph Neural Networks: Attacks, Preservation, and Applications
Yi Zhang
Yuying Zhao
Zhaoqing Li
Xueqi Cheng
Yu Wang
Olivera Kotevska
Philip S. Yu
Hanyu Wang
130
13
0
31 Aug 2023
CEFHRI: A Communication Efficient Federated Learning Framework for Recognizing Industrial Human-Robot Interaction
Umar Khalid
Hasan Iqbal
Saeed Vahidian
Jing Hua
Chong Chen
67
3
0
29 Aug 2023
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning
Haokun Chen
Yao Zhang
Denis Krompass
Jindong Gu
Volker Tresp
FedML
124
55
0
21 Aug 2023
Towards Federated Foundation Models: Scalable Dataset Pipelines for Group-Structured Learning
Zachary B. Charles
Nicole Mitchell
Krishna Pillutla
Michael Reneer
Zachary Garrett
FedML
AI4CE
89
31
0
18 Jul 2023
Instruction Tuned Models are Quick Learners
Himanshu Gupta
Saurabh Arjun Sawant
Swaroop Mishra
Mutsumi Nakamura
Arindam Mitra
Santosh Mashetty
Chitta Baral
85
26
0
17 May 2023
When Do Curricula Work in Federated Learning?
Saeed Vahidian
Sreevatsank Kadaveru
Woo-Ram Baek
Weijia Wang
Vyacheslav Kungurtsev
Chong Chen
M. Shah
Bill Lin
FedML
95
11
0
24 Dec 2022
Decentralized digital twins of complex dynamical systems
Omer San
Suraj Pawar
Adil Rasheed
AI4CE
95
11
0
07 Jul 2022
Previous
1
2