FedAdapter: Efficient Federated Learning for Modern NLP

FedAdapter: Efficient Federated Learning for Modern NLP

20 May 2022

Shangguang Wang

Mengwei Xu

Papers citing "FedAdapter: Efficient Federated Learning for Modern NLP"

13 / 13 papers shown

Title
ReCIT: Reconstructing Full Private Data from Gradient in Parameter-Efficient Fine-Tuning of Large Language Models Jin Xie Ruishi He Songze Li Xiaojun Jia Shouling Ji SILM AAML 66 0 0 29 Apr 2025
FedConv: A Learning-on-Model Paradigm for Heterogeneous Federated Clients Leming Shen Qiang Yang Kaiyan Cui Yuanqing Zheng Xiao-Yong Wei Jianwei Liu Jinsong Han FedML 66 11 0 28 Feb 2025
FedSpaLLM: Federated Pruning of Large Language Models Guangji Bai Yijiang Li Zilinghan Li Liang Zhao Kibaek Kim FedML 62 4 0 20 Feb 2025
Save It All: Enabling Full Parameter Tuning for Federated Large Language Models via Cycle Block Gradient Descent Lin Wang Zhichao Wang Xiaoying Tang 39 1 0 17 Jun 2024
FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning Jiaxing Qi Zhongzhi Luan Shaohan Huang Carol J. Fung Hailong Yang Depei Qian 32 12 0 12 Jun 2024
FedPEAT: Convergence of Federated Learning, Parameter-Efficient Fine Tuning, and Emulator Assisted Tuning for Artificial Intelligence Foundation Models with Mobile Edge Computing Terence Jie Chua Wen-li Yu Junfeng Zhao Kwok-Yan Lam FedML 26 5 0 26 Oct 2023
Mobile Foundation Model as Firmware Jinliang Yuan Chenchen Yang Dongqi Cai Shihe Wang Xin Yuan ... Di Zhang Hanzi Mei Xianqing Jia Shangguang Wang Mengwei Xu 40 19 0 28 Aug 2023
A Secure and Efficient Federated Learning Framework for NLP Jieren Deng Chenghong Wang Xianrui Meng Yijue Wang Ji Li Sheng Lin Shuo Han Fei Miao Sanguthevar Rajasekaran Caiwen Ding FedML 74 22 0 28 Jan 2022
Transformer in Transformer Kai Han An Xiao Enhua Wu Jianyuan Guo Chunjing Xu Yunhe Wang ViT 284 1,524 0 27 Feb 2021
Device Sampling for Heterogeneous Federated Learning: Theory, Algorithms, and Implementation Su Wang Mengyuan Lee Seyyedali Hosseinalipour Roberto Morabito M. Chiang Christopher G. Brinton FedML 77 110 0 04 Jan 2021
BinaryBERT: Pushing the Limit of BERT Quantization Haoli Bai Wei Zhang Lu Hou Lifeng Shang Jing Jin Xin Jiang Qun Liu Michael Lyu Irwin King MQ 142 221 0 31 Dec 2020
Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System Heterogeneity Amirhossein Reisizadeh Isidoros Tziotis Hamed Hassani Aryan Mokhtari Ramtin Pedarsani FedML 172 99 0 28 Dec 2020
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,889 0 15 Sep 2016