Title
Pre-Training and Personalized Fine-Tuning via Over-the-Air Federated Meta-Learning: Convergence-Generalization Trade-Offs Haifeng Wen Hong Xing Osvaldo Simeone AI4CE 65 3 0 17 Jun 2024
The Future of Large Language Model Pre-training is Federated Lorenzo Sani Alexandru Iacob Zeyu Cao Bill Marino Yan Gao ... Wanru Zhao William F. Shen Preslav Aleksandrov Xinchi Qiu Nicholas D. Lane AI4CE 81 18 0 17 May 2024
Improving LoRA in Privacy-preserving Federated Learning Youbang Sun Zitao Li Yaliang Li Bolin Ding 53 70 0 18 Mar 2024
FeB4RAG: Evaluating Federated Search in the Context of Retrieval Augmented Generation Shuai Wang Ekaterina Khramtsova Shengyao Zhuang Guido Zuccon 52 12 0 19 Feb 2024
FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning Weirui Kuang Bingchen Qian Zitao Li Daoyuan Chen Dawei Gao Xuchen Pan Yuexiang Xie Yaliang Li Bolin Ding Jingren Zhou FedML 50 119 0 01 Sep 2023
Simple synthetic data reduces sycophancy in large language models Jerry W. Wei Da Huang Yifeng Lu Denny Zhou Quoc V. Le 48 70 0 07 Aug 2023
FedYolo: Augmenting Federated Learning with Pretrained Transformers Xuechen Zhang Mingchen Li Xiangyu Chang Jiasi Chen Amit K. Roy-Chowdhury A. Suresh Samet Oymak FedML 56 7 0 10 Jul 2023
When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directions Weiming Zhuang Chen Chen Lingjuan Lyu Chong Chen Yaochu Jin Lingjuan Lyu AIFin AI4CE 104 93 0 27 Jun 2023
Towards Building the Federated GPT: Federated Instruction Tuning Jianyi Zhang Saeed Vahidian Martin Kuo Chunyuan Li Ruiyi Zhang Tong Yu Yufan Zhou Guoyin Wang Yiran Chen ALM FedML 49 118 0 09 May 2023
Federated Few-Shot Learning for Mobile NLP Dongqi Cai Shangguang Wang Yaozong Wu F. Lin Mengwei Xu FedML 53 12 0 12 Dec 2022
Federated Learning for Inference at Anytime and Anywhere Zicheng Liu Da Li Javier Fernandez-Marques Stefanos Laskaridis Yan Gao Łukasz Dudziak Stan Z. Li S. Hu Timothy M. Hospedales FedML 49 5 0 08 Dec 2022
Recovering Private Text in Federated Learning of Language Models Samyak Gupta Yangsibo Huang Zexuan Zhong Tianyu Gao Kai Li Danqi Chen FedML 51 78 0 17 May 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 506 9,009 0 28 Jan 2022
FedMD: Heterogenous Federated Learning via Model Distillation Daliang Li Junpu Wang FedML 63 845 0 08 Oct 2019