v1v2 (latest)

Federated Learning of Gboard Language Models with Differential Privacy

29 May 2023

Zheng Xu

Yanxiang Zhang

Galen Andrew

Christopher A. Choquette-Choo

Papers citing "Federated Learning of Gboard Language Models with Differential Privacy"

50 / 61 papers shown

Title
Constant Stepsize Local GD for Logistic Regression: Acceleration by Instability M. Crawshaw Blake Woodworth Mingrui Liu 32 0 0 16 Jun 2025
Synthesizing and Adapting Error Correction Data for Mobile Large Language Model Applications Yanxiang Zhang Zheng Xu Shanshan Wu Yuanbo Zhang Daniel Ramage KELM 48 0 0 24 May 2025
UnifyFL: Enabling Decentralized Cross-Silo Federated Learning Sarang S Druva Dhakshinamoorthy Aditya Shiva Sharma Yuvraj Singh Bhadauria Siddharth Chaitra Vivek Arihant Bansal Arnab K. Paul FedML 213 0 0 26 Apr 2025
Private Federated Learning using Preference-Optimized Synthetic Data Charlie Hou Mei-Yu Wang Yige Zhu Daniel Lazar Giulia Fanti FedML Presented at ResearchTrend Connect \| FedML on 07 May 2025 188 2 0 23 Apr 2025
Accelerating Differentially Private Federated Learning via Adaptive Extrapolation Shokichi Takakura Seng Pei Liew Satoshi Hasegawa FedML 104 0 0 14 Apr 2025
$Infinitely Divisible Noise for Differential Privacy: Nearly Optimal Error in the High $\varepsilon$ Regime$ Infinitely Divisible Noise for Differential Privacy: Nearly Optimal Error in the High $\varepsilon$ Regime Charlie Harrison Pasin Manurangsi 90 0 0 07 Apr 2025
Synthesizing Privacy-Preserving Text Data via Finetuning without Finetuning Billion-Scale LLMs Bowen Tan Zheng Xu Eric P. Xing Zhiting Hu Shanshan Wu SyDa 162 3 0 16 Mar 2025
Empirical Privacy Variance Yuzheng Hu Fan Wu Ruicheng Xian Yuhang Liu Lydia Zakynthinou Pritish Kamath Chiyuan Zhang David A. Forsyth 151 0 0 16 Mar 2025
Multi-Agent Collaboration Mechanisms: A Survey of LLMs Khanh-Tung Tran Dung Dao Minh-Duong Nguyen Quoc-Viet Pham Barry O'Sullivan Hoang D. Nguyen LLMAG 151 57 0 10 Jan 2025
Fingerprinting Codes Meet Geometry: Improved Lower Bounds for Private Query Release and Adaptive Data Analysis Xin Lyu Kunal Talwar 84 0 0 18 Dec 2024
Secure Stateful Aggregation: A Practical Protocol with Applications in Differentially-Private Federated Learning Marshall Ball James Bell-Clark Adria Gascon Peter Kairouz Sewoong Oh Zhiye Xie FedML 82 1 0 15 Oct 2024
Federated Learning in Practice: Reflections and Projections Katharine Daly Hubert Eichner Peter Kairouz H. B. McMahan Daniel Ramage Zheng Xu FedML 94 10 0 11 Oct 2024
Debiasing Federated Learning with Correlated Client Participation Zhenyu Sun Ziyang Zhang Zheng Xu Gauri Joshi Pranay Sharma Ermin Wei FedML 138 0 0 02 Oct 2024
Byzantine-Robust Aggregation for Securing Decentralized Federated Learning Diego Cajaraville-Aboy Ana Fernández-Vilas R. Redondo Manuel Fernández-Veiga 86 3 0 26 Sep 2024
Scalable Differential Privacy Mechanisms for Real-Time Machine Learning Applications Jessica Smith David Williams Emily Brown 76 0 0 16 Sep 2024
A Statistical Viewpoint on Differential Privacy: Hypothesis Testing, Representation and Blackwell's Theorem Weijie J. Su 84 1 0 14 Sep 2024
A Hassle-free Algorithm for Private Learning in Practice: Don't Use Tree Aggregation, Use BLTs H. B. McMahan Zheng Xu Yanxiang Zhang FedML 125 8 0 16 Aug 2024
Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models Wentao Gao Omid Tavallaie Shuaijun Chen Albert Zomaya FedML 95 5 0 30 Jul 2024
Universally Harmonizing Differential Privacy Mechanisms for Federated Learning: Boosting Accuracy and Convergence Shuya Feng Meisam Mohammady Hanbin Hong Shenao Yan Ashish Kundu Binghui Wang Yuan Hong FedML 102 3 0 20 Jul 2024
Fine-Tuning Large Language Models with User-Level Differential Privacy Zachary Charles Arun Ganesh Ryan McKenna H. B. McMahan Nicole Mitchell Krishna Pillutla Keith Rush 88 14 0 10 Jul 2024
Synergizing Foundation Models and Federated Learning: A Survey Shenghui Li Fanghua Ye Meng Fang Jiaxu Zhao Yun-Hin Chan Edith C. -H. Ngai Thiemo Voigt AI4CE 125 7 0 18 Jun 2024
Empirical Guidelines for Deploying LLMs onto Resource-constrained Edge Devices Ruiyang Qin Dancheng Liu Zheyu Yan Zhaoxuan Tan Zixuan Pan Zhenge Jia Meng Jiang Ahmed Abbasi Jinjun Xiong Yiyu Shi 101 15 0 06 Jun 2024
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs Charlie Hou Akshat Shrivastava Hongyuan Zhan Rylan Conway Trang Le Adithya Sagar Giulia Fanti Daniel Lazar 118 15 0 05 Jun 2024
DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation Jie Xu Karthikeyan P. Saravanan Rogier van Dalen Haaris Mehmood David Tuckey Mete Ozay 173 8 0 10 May 2024
Improved Communication-Privacy Trade-offs in $L_2$ Mean Estimation under Streaming Differential Privacy Wei-Ning Chen Berivan Isik Peter Kairouz Albert No Sewoong Oh Zheng Xu 109 3 0 02 May 2024
Efficient and Near-Optimal Noise Generation for Streaming Differential Privacy Krishnamurthy Dvijotham H. B. McMahan Krishna Pillutla Thomas Steinke Abhradeep Thakurta 99 17 0 25 Apr 2024
Confidential Federated Computations Hubert Eichner Daniel Ramage Kallista A. Bonawitz Dzmitry Huba Tiziano Santoro ... Albert Cheu Katharine Daly Adria Gascon Marco Gruteser Brendan McMahan 117 5 0 16 Apr 2024
pfl-research: simulation framework for accelerating research in Private Federated Learning Filip Granqvist Congzheng Song Áine Cahill Rogier van Dalen Martin Pelikan Yi Sheng Chan Xiaojun Feng Natarajan Krishnaswami Vojta Jina Mona Chitnis FedML 90 6 0 09 Apr 2024
Prompt Public Large Language Models to Synthesize Data for Private On-device Applications Shanshan Wu Zheng Xu Yanxiang Zhang Yuanbo Zhang Daniel Ramage SyDa 88 12 0 05 Apr 2024
Efficient Language Model Architectures for Differentially Private Federated Learning Jae Hun Ro Srinadh Bhojanapalli Zheng Xu Yanxiang Zhang A. Suresh FedML 80 3 0 12 Mar 2024
Differentially Private Knowledge Distillation via Synthetic Text Generation James Flemings Murali Annavaram SyDa 81 14 0 01 Mar 2024
Teach LLMs to Phish: Stealing Private Information from Language Models Ashwinee Panda Christopher A. Choquette-Choo Zhengming Zhang Yaoqing Yang Prateek Mittal PILM 110 26 0 01 Mar 2024
Private Gradient Descent for Linear Regression: Tighter Error Bounds and Instance-Specific Uncertainty Estimation Gavin Brown Krishnamurthy Dvijotham Georgina Evans Daogao Liu Adam D. Smith Abhradeep Thakurta 96 6 0 21 Feb 2024
Auditing Private Prediction Karan Chadha Matthew Jagielski Nicolas Papernot Christopher A. Choquette-Choo Milad Nasr 120 8 0 14 Feb 2024
Momentum Approximation in Asynchronous Private Federated Learning Tao Yu Congzheng Song Jianyu Wang Mona Chitnis FedML 101 1 0 14 Feb 2024
A Survey on Efficient Federated Learning Methods for Foundation Model Training Herbert Woisetschläger Alexander Isenko Shiqiang Wang R. Mayer Hans-Arno Jacobsen FedML 115 26 0 09 Jan 2024
Lotto: Secure Participant Selection against Adversarial Servers in Federated Learning Zhifeng Jiang Peng Ye Shiqi He Wei Wang Ruichuan Chen Bo Li 91 2 0 05 Jan 2024
Venn: Resource Management for Collaborative Learning Jobs Jiachen Liu Fan Lai Ding Ding Yiwen Zhang Mosharaf Chowdhury FedML 109 1 0 13 Dec 2023
Grounding Foundation Models through Federated Transfer Learning: A General Framework Yan Kang Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 189 19 0 29 Nov 2023
Enabling On-Device Large Language Model Personalization with Self-Supervised Data Selection and Synthesis Ruiyang Qin Jun Xia Zhenge Jia Meng Jiang Ahmed Abbasi Peipei Zhou Jingtong Hu Yiyu Shi 115 20 0 21 Nov 2023
Robust and Actively Secure Serverless Collaborative Learning Olive Franzese Adam Dziedzic Christopher A. Choquette-Choo Mark R. Thomas Muhammad Ahmad Kaleem Stephan Rabanser Cong Fang Somesh Jha Nicolas Papernot Xiao Wang OOD 79 2 0 25 Oct 2023
FedTherapist: Mental Health Monitoring with User-Generated Linguistic Expressions on Smartphones via Federated Learning Jaemin Shin Hyungjun Yoon Seungjoo Lee Sungjoon Park Yunxin Liu Jinho D. Choi Sung-Ju Lee 72 6 0 25 Oct 2023
User Inference Attacks on Large Language Models Nikhil Kandpal Krishna Pillutla Alina Oprea Peter Kairouz Christopher A. Choquette-Choo Zheng Xu SILM AAML 132 20 0 13 Oct 2023
Optimization of Federated Learning's Client Selection for Non-IID Data Based on Grey Relational Analysis Shuaijun Chen Omid Tavallaie Michael Henri Hambali S. M. Zandavi Hamed Haddadi Nicholas D. Lane Song Guo Albert Y. Zomaya FedML 106 2 0 12 Oct 2023
Correlated Noise Provably Beats Independent Noise for Differentially Private Learning Christopher A. Choquette-Choo Krishnamurthy Dvijotham Krishna Pillutla Arun Ganesh Thomas Steinke Abhradeep Thakurta 86 17 0 10 Oct 2023
Enabling Differentially Private Federated Learning for Speech Recognition: Benchmarks, Adaptive Optimizers and Gradient Clipping Martin Pelikan Sheikh Shams Azam Vitaly Feldman Jan Honza Silovsky Kunal Talwar Christopher G. Brinton Tatiana Likhomanenko 113 8 0 29 Sep 2023
How to Protect Copyright Data in Optimization of Large Language Models? T. Chu Zhao Song Chiwun Yang 85 31 0 23 Aug 2023
Private Distribution Learning with Public Data: The View from Sample Compression Shai Ben-David Alex Bie C. Canonne Gautam Kamath Vikrant Singhal 86 13 0 11 Aug 2023
When Federated Learning meets Watermarking: A Comprehensive Overview of Techniques for Intellectual Property Protection Mohammed Lansari Reda Bellafqira K. Kapusta V. Thouvenot Olivier Bettan Gouenou Coatrieux FedML 71 21 0 07 Aug 2023
Samplable Anonymous Aggregation for Private Federated Data Analysis Kunal Talwar Shan Wang Audra McMillan Vojta Jina Vitaly Feldman ... Congzheng Song Karl Tarbe Sebastian Vogt L. Winstrom Shundong Zhou FedML 161 14 0 27 Jul 2023