Pretrained Models for Multilingual Federated Learning

6 June 2022

Papers citing "Pretrained Models for Multilingual Federated Learning"

23 / 23 papers shown

Title
Selective Aggregation for Low-Rank Adaptation in Federated Learning Pengxin Guo Shuang Zeng Y. Wang Huijie Fan Feifei Wang Liangqiong Qu FedML 44 10 0 02 Oct 2024
A Survey for Large Language Models in Biomedicine Chong Wang Mengyao Li Junjun He Zhongruo Wang Erfan Darzi ... Yi Yu Pietro Liò Tianyun Wang Yu Guang Wang Yiqing Shen LM&MA 36 9 0 29 Aug 2024
Recent Advances in Federated Learning Driven Large Language Models: A Survey on Architecture, Performance, and Security Youyang Qu Ming Liu Tianqing Zhu Longxiang Gao Shui Yu Wanlei Zhou MU FedML 65 2 0 14 Jun 2024
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs Charlie Hou Akshat Shrivastava Hongyuan Zhan Rylan Conway Trang Le Adithya Sagar Giulia Fanti Daniel Lazar 36 8 0 05 Jun 2024
The Future of Large Language Model Pre-training is Federated Lorenzo Sani Alexandru Iacob Zeyu Cao Bill Marino Yan Gao ... Wanru Zhao William F. Shen Preslav Aleksandrov Xinchi Qiu Nicholas D. Lane AI4CE 35 13 0 17 May 2024
Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare Xingyu Li Lu Peng Yuping Wang Weihua Zhang AI4CE MedIm LM&MA 71 5 0 10 May 2024
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition Yuxuan Yan Qianqian Yang Shunpu Tang Zhiguo Shi 38 14 0 29 Apr 2024
Only Send What You Need: Learning to Communicate Efficiently in Federated Multilingual Machine Translation Yun-Wei Chu Dong-Jun Han Christopher G. Brinton 28 4 0 15 Jan 2024
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning Liam Collins Shanshan Wu Sewoong Oh K. Sim FedML 39 9 0 06 Oct 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models Zihao Lin Yan Sun Yifan Shi Xueqian Wang Lifu Huang Li Shen Dacheng Tao 42 11 0 04 Oct 2023
FedBPT: Efficient Federated Black-box Prompt Tuning for Large Language Models Jingwei Sun Ziyue Xu Hongxu Yin Dong Yang Daguang Xu Yiran Chen Holger R. Roth VLM 101 23 0 02 Oct 2023
Fingerprint Attack: Client De-Anonymization in Federated Learning Qiongkai Xu Trevor Cohn Olga Ohrimenko FedML 26 2 0 12 Sep 2023
FedYolo: Augmenting Federated Learning with Pretrained Transformers Xuechen Zhang Mingchen Li Xiangyu Chang Jiasi Chen A. Roy-Chowdhury A. Suresh Samet Oymak FedML 31 7 0 10 Jul 2023
Communication Efficient Federated Learning for Multilingual Neural Machine Translation with Adapter Yi Liu Xiaohan Bi Lei Li Sishuo Chen Wenkai Yang Xu Sun FedML 35 12 0 21 May 2023
Towards Building the Federated GPT: Federated Instruction Tuning Jianyi Zhang Saeed Vahidian Martin Kuo Chunyuan Li Ruiyi Zhang Tong Yu Yufan Zhou Guoyin Wang Yiran Chen ALM FedML 37 112 0 09 May 2023
Personalized Federated Learning via Gradient Modulation for Heterogeneous Text Summarization Rong Pan Jianzong Wang Lingwei Kong Zhangcheng Huang Jing Xiao FedML 38 2 0 23 Apr 2023
Federated Learning Based Multilingual Emoji Prediction In Clean and Attack Scenarios Karim Gamal A. Gaber Hossam Amer FedML 28 6 0 30 Mar 2023
On the Efficacy of Differentially Private Few-shot Image Classification Marlon Tobaben Aliaksandra Shysheya J. Bronskill Andrew J. Paverd Shruti Tople Santiago Zanella Béguelin Richard Turner Antti Honkela 38 11 0 02 Feb 2023
When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning Methods Zhuo Zhang Yuanhang Yang Yong Dai Lizhen Qu Zenglin Xu FedML 46 66 0 20 Dec 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 8 68 0 14 Oct 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 26 21 0 30 Jun 2022
On the Importance and Applicability of Pre-Training for Federated Learning Hong-You Chen Cheng-Hao Tu Zi-hua Li Hang Shen Wei-Lun Chao FedML 22 77 0 23 Jun 2022
Collaborative Semantic Aggregation and Calibration for Federated Domain Generalization Junkun Yuan Xu Ma Defang Chen Fei Wu Lanfen Lin Kun Kuang FedML 35 22 0 13 Oct 2021