Scaling Federated Learning for Fine-tuning of Large Language Models

Scaling Federated Learning for Fine-tuning of Large Language Models

1 February 2021

Sebastian Callh

Matteo Barbieri

Edvin Listo Zec

Papers citing "Scaling Federated Learning for Fine-tuning of Large Language Models"

11 / 11 papers shown

Title
FedTLU: Federated Learning with Targeted Layer Updates Jong-Ik Park Carlee Joe-Wong FedML 89 0 0 28 Jan 2025
Enhancing Privacy in the Early Detection of Sexual Predators Through Federated Learning and Differential Privacy Khaoula Chehbouni Martine De Cock Gilles Caporossi Afaf Taik Reihaneh Rabbany G. Farnadi 78 0 0 21 Jan 2025
Federated Fine-Tuning of LLMs: Framework Comparison and Research Directions Na Yan Yang Su Yansha Deng Robert Schober FedML 77 0 0 08 Jan 2025
No Need to Talk: Asynchronous Mixture of Language Models Anastasiia Filippova Angelos Katharopoulos David Grangier Ronan Collobert MoE 44 0 0 04 Oct 2024
Recent Advances in Federated Learning Driven Large Language Models: A Survey on Architecture, Performance, and Security Youyang Qu Ming Liu Tianqing Zhu Longxiang Gao Shui Yu Wanlei Zhou MU FedML 65 2 0 14 Jun 2024
A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiency Jiawei Shao Zijian Li Wenqiang Sun Tailin Zhou Yuchang Sun Lumin Liu Zehong Lin Yuyi Mao Jun Zhang FedML 43 23 0 20 Jul 2023
Can Foundation Models Help Us Achieve Perfect Secrecy? Simran Arora Christopher Ré FedML 24 6 0 27 May 2022
Federated Split BERT for Heterogeneous Text Classification Zhengyang Li Shijing Si Jianzong Wang Jing Xiao FedML 35 21 0 26 May 2022
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks Rishabh Bhardwaj Tushar Vaidya Soujanya Poria OT FedML 65 7 0 06 Oct 2021
Federated Learning Meets Natural Language Processing: A Survey Ming Liu Stella Ho Mengqi Wang Longxiang Gao Yuan Jin Heng Zhang FedML 30 67 0 27 Jul 2021
Natural Language Processing for EHR-Based Computational Phenotyping Zexian Zeng Yu Deng Xiaoyu Li Tristan Naumann Yuan Luo 40 147 0 13 Jun 2018