Pretraining Federated Text Models for Next Word Prediction

11 May 2020

Papers citing "Pretraining Federated Text Models for Next Word Prediction"

12 / 12 papers shown

Title
Analysis of Privacy Leakage in Federated Large Language Models Minh Nhat Vu Truc D. T. Nguyen Tre' R. Jeter My T. Thai 45 6 0 02 Mar 2024
Mutual Enhancement of Large and Small Language Models with Cross-Silo Knowledge Transfer Yongheng Deng Ziqing Qiao Ju Ren Yang Liu Yaoxue Zhang 30 11 0 10 Dec 2023
FedBIAD: Communication-Efficient and Accuracy-Guaranteed Federated Learning with Bayesian Inference-Based Adaptive Dropout Jingjing Xue Min Liu Sheng Sun Yuwei Wang Hui Jiang Xue Jiang 21 7 0 14 Jul 2023
Enhancing Older Adults' Gesture Typing Experience Using the T9 Keyboard on Small Touchscreen Devices Emily Kuang Ruihuan Chen Mingming Fan 21 1 0 07 Mar 2023
SPARTAN: Sparse Hierarchical Memory for Parameter-Efficient Transformers Ameet Deshpande Md Arafat Sultan Anthony Ferritto Ashwin Kalyan Karthik R. Narasimhan Avirup Sil MoE 46 1 0 29 Nov 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 29 21 0 30 Jun 2022
Pretrained Models for Multilingual Federated Learning Orion Weller Marc Marone Vladimir Braverman Dawn J Lawrie Benjamin Van Durme VLM FedML AI4CE 46 42 0 06 Jun 2022
Training Mixed-Domain Translation Models via Federated Learning Peyman Passban Tanya Roosta Rahul Gupta Ankit R. Chadha Clement Chung FedML AI4CE 29 18 0 03 May 2022
Federated Named Entity Recognition Joel Mathew Dimitris Stripelis J. Ambite FedML 22 1 0 28 Mar 2022
Federated Natural Language Generation for Personalized Dialogue System Yujie Lu Chao-Wei Huang Huanli Zhan Yong Zhuang FedML 85 9 0 13 Oct 2021
Federated Learning Meets Natural Language Processing: A Survey Ming Liu Stella Ho Mengqi Wang Longxiang Gao Yuan Jin Heng Zhang FedML 30 67 0 27 Jul 2021
One-Shot Federated Learning with Neuromorphic Processors Kenneth Stewart Yanqi Gu FedML 11 2 0 01 Nov 2020