Differentially Private Next-Token Prediction of Large Language Models

22 March 2024

Papers citing "Differentially Private Next-Token Prediction of Large Language Models"

10 / 10 papers shown

Title
The KL3M Data Project: Copyright-Clean Training Resources for Large Language Models Michael J Bommarito II Jillian Bommarito Daniel Martin Katz AILaw 59 0 0 10 Apr 2025
Exactly Minimax-Optimal Locally Differentially Private Sampling Hyun-Young Park Shahab Asoodeh Si-Hyeon Lee 36 1 0 30 Oct 2024
Adaptively Private Next-Token Prediction of Large Language Models James Flemings Meisam Razaviyayn Murali Annavaram 34 0 0 02 Oct 2024
Private prediction for large-scale synthetic text generation Kareem Amin Alex Bie Weiwei Kong Alexey Kurakin Natalia Ponomareva Umar Syed Andreas Terzis Sergei Vassilvitskii SyDa SILM 45 3 0 16 Jul 2024
How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy Natalia Ponomareva Hussein Hazimeh Alexey Kurakin Zheng Xu Carson E. Denison H. B. McMahan Sergei Vassilvitskii Steve Chien Abhradeep Thakurta 96 167 0 01 Mar 2023
Generalized PTR: User-Friendly Recipes for Data-Adaptive Algorithms with Differential Privacy Rachel Redberg Yuqing Zhu Yu-Xiang Wang 36 7 0 31 Dec 2022
Composition of Differential Privacy & Privacy Amplification by Subsampling Thomas Steinke 64 49 0 02 Oct 2022
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 134 347 0 13 Oct 2021
Opacus: User-Friendly Differential Privacy Library in PyTorch Ashkan Yousefpour I. Shilov Alexandre Sablayrolles Davide Testuggine Karthik Prasad ... Sayan Gosh Akash Bharadwaj Jessica Zhao Graham Cormode Ilya Mironov VLM 168 350 0 25 Sep 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 290 1,815 0 14 Dec 2020