GPT-FL: Generative Pre-trained Model-Assisted Federated Learning

3 June 2023

Tuo Zhang

Tiantian Feng

Samiul Alam

Dimitrios Dimitriadis

Sunwoo Lee

Mi Zhang

Shrikanth S. Narayanan

Salman Avestimehr

FedML

ArXiv PDF HTML

Papers citing "GPT-FL: Generative Pre-trained Model-Assisted Federated Learning"

27 / 27 papers shown

Title
Generative Artificial Intelligence for Internet of Things Computing: A Systematic Survey Fabrizio Mangione Claudio Savaglio Giancarlo Fortino 31 0 0 10 Apr 2025
FedPaI: Achieving Extreme Sparsity in Federated Learning via Pruning at Initialization Haonan Wang Ziqiang Liu Kajimusugura Hoshino Tuo Zhang J. Walters S. Crago 49 0 0 01 Apr 2025
Federated Learning for Diffusion Models Zihao Peng Xijun Wang Shengbo Chen Hong Rao Cong Shen DiffM FedML 53 0 0 09 Mar 2025
WarmFed: Federated Learning with Warm-Start for Globalization and Personalization Via Personalized Diffusion Models Tao Feng Jie Zhang Xiangjian Li Rong Huang Huashan Liu Zhijie Wang FedML 62 0 0 05 Mar 2025
Ten Challenging Problems in Federated Foundation Models Tao Fan Hanlin Gu Xuemei Cao Chee Seng Chan Qian Chen ... Y. Zhang Xiaojin Zhang Zhenzhe Zheng Lixin Fan Qiang Yang FedML 89 4 0 14 Feb 2025
Securing Federated Learning against Backdoor Threats with Foundation Model Integration Xiaohuan Bi Xi Li 60 1 0 23 Oct 2024
A Survey for Large Language Models in Biomedicine Chong Wang Mengyao Li Junjun He Zhongruo Wang Erfan Darzi ... Yi Yu Pietro Liò Tianyun Wang Yu Guang Wang Yiqing Shen LM&MA 36 9 0 29 Aug 2024
MSfusion: A Dynamic Model Splitting Approach for Resource-Constrained Machines to Collaboratively Train Larger Models Jin Xie Songze Li FedML 44 0 0 04 Jul 2024
Can Synthetic Audio From Generative Foundation Models Assist Audio Recognition and Speech Modeling? Tiantian Feng Dimitrios Dimitriadis Shrikanth Narayanan 40 4 0 13 Jun 2024
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs Charlie Hou Akshat Shrivastava Hongyuan Zhan Rylan Conway Trang Le Adithya Sagar Giulia Fanti Daniel Lazar 36 8 0 05 Jun 2024
Stable Diffusion-based Data Augmentation for Federated Learning with Non-IID Data Mahdi Morafah M. Reisser Bill Lin Christos Louizos FedML 34 5 0 13 May 2024
Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare Xingyu Li Lu Peng Yuping Wang Weihua Zhang AI4CE MedIm LM&MA 71 5 0 10 May 2024
TI-ASU: Toward Robust Automatic Speech Understanding through Text-to-speech Imputation Against Missing Speech Modality Tiantian Feng Xuan Shi Rahul Gupta Shrikanth S. Narayanan 49 0 0 27 Apr 2024
Prompt Public Large Language Models to Synthesize Data for Private On-device Applications Shanshan Wu Zheng Xu Yanxiang Zhang Yuanbo Zhang Daniel Ramage SyDa 26 9 0 05 Apr 2024
Can Text-to-image Model Assist Multi-modal Learning for Visual Recognition with Visual Modality Missing? Tiantian Feng Daniel Yang Digbalay Bose Shrikanth Narayanan 40 5 0 14 Feb 2024
IoT in the Era of Generative AI: Vision and Challenges Xin Wang Zhongwei Wan Arvin Hekmati M. Zong Samiul Alam Mi Zhang Bhaskar Krishnamachari 32 15 0 03 Jan 2024
Grounding Foundation Models through Federated Transfer Learning: A General Framework Yan Kang Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 68 19 0 29 Nov 2023
FedRA: A Random Allocation Strategy for Federated Tuning to Unleash the Power of Heterogeneous Clients Shangchao Su Bin Li Xiangyang Xue FedML 43 11 0 19 Nov 2023
Backdoor Threats from Compromised Foundation Models to Federated Learning Xi Li Songhe Wang Chen Henry Wu Hao Zhou Jiaqi Wang 97 10 0 31 Oct 2023
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning Liam Collins Shanshan Wu Sewoong Oh K. Sim FedML 42 9 0 06 Oct 2023
FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things Samiul Alam Tuo Zhang Tiantian Feng Hui Shen Zhichao Cao ... JeongGil Ko Kiran Somasundaram Shrikanth S. Narayanan Salman Avestimehr Mi Zhang 38 11 0 29 Sep 2023
When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directions Weiming Zhuang Chen Chen Lingjuan Lyu Cheng Chen Yaochu Jin Lingjuan Lyu AIFin AI4CE 99 85 0 27 Jun 2023
Unlocking Foundation Models for Privacy-Enhancing Speech Understanding: An Early Study on Low Resource Speech Training Leveraging Label-guided Synthetic Speech Content Tiantian Feng Digbalay Bose Xuan Shi Shrikanth Narayanan 31 1 0 13 Jun 2023
Dataset Condensation via Efficient Synthetic-Data Parameterization Jang-Hyun Kim Jinuk Kim Seong Joon Oh Sangdoo Yun Hwanjun Song Joonhyun Jeong Jung-Woo Ha Hyun Oh Song DD 406 158 0 30 May 2022
SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing Junyi Ao Rui Wang Long Zhou Chengyi Wang Shuo Ren ... Yu Zhang Zhihua Wei Yao Qian Jinyu Li Furu Wei 118 193 0 14 Oct 2021
LightSecAgg: a Lightweight and Versatile Design for Secure Aggregation in Federated Learning Jinhyun So Chaoyang He Chien-Sheng Yang Songze Li Qian-long Yu Ramy E. Ali Başak Güler Salman Avestimehr FedML 67 166 0 29 Sep 2021
FedML: A Research Library and Benchmark for Federated Machine Learning Chaoyang He Songze Li Jinhyun So Xiao Zeng Mi Zhang ... Yang Liu Ramesh Raskar Qiang Yang M. Annavaram Salman Avestimehr FedML 168 564 0 27 Jul 2020