Differentially Private Decoding in Large Language Models

26 May 2022

Papers citing "Differentially Private Decoding in Large Language Models"

27 / 27 papers shown

Title
Ontology- and LLM-based Data Harmonization for Federated Learning in Healthcare Natallia Kokash Lei Wang Thomas H. Gillespie Adam Belloum Paola Grosso Sara Quinney Lang Li Bernard de Bono 41 0 0 26 May 2025
Proactive Privacy Amnesia for Large Language Models: Safeguarding PII with Negligible Impact on Model Utility Martin Kuo Jingyang Zhang Jianyi Zhang Minxue Tang Louis DiValentin ... William Chen Amin Hass Tianlong Chen Yuxiao Chen Haoyang Li MU KELM 83 3 0 24 Feb 2025
ObfuscaTune: Obfuscated Offsite Fine-tuning and Inference of Proprietary LLMs on Private Datasets Ahmed Frikha Nassim Walha Ricardo Mendes Krishna Kanth Nakka Xue Jiang Xuebing Zhou 92 3 0 03 Jul 2024
Quantifying Memorization Across Neural Language Models Nicholas Carlini Daphne Ippolito Matthew Jagielski Katherine Lee Florian Tramèr Chiyuan Zhang PILM 121 623 0 15 Feb 2022
Submix: Practical Private Prediction for Large-Scale Language Models Antonio A. Ginart Laurens van der Maaten James Zou Chuan Guo 59 23 0 04 Jan 2022
Counterfactual Memorization in Neural Language Models Chiyuan Zhang Daphne Ippolito Katherine Lee Matthew Jagielski Florian Tramèr Nicholas Carlini 71 135 0 24 Dec 2021
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 227 367 0 13 Oct 2021
An Efficient DP-SGD Mechanism for Large Scale NLP Models Christophe Dupuy Radhika Arava Rahul Gupta Anna Rumshisky SyDa 66 35 0 14 Jul 2021
Membership Inference Attack Susceptibility of Clinical Language Models Abhyuday N. Jagannatha Bhanu Pratap Singh Rawat Hong-ye Yu MIACV 61 64 0 16 Apr 2021
When is Memorization of Irrelevant Training Data Necessary for High-Accuracy Learning? Gavin Brown Mark Bun Vitaly Feldman Adam D. Smith Kunal Talwar 295 99 0 11 Dec 2020
mT5: A massively multilingual pre-trained text-to-text transformer Linting Xue Noah Constant Adam Roberts Mihir Kale Rami Al-Rfou Aditya Siddhant Aditya Barua Colin Raffel 138 2,555 0 22 Oct 2020
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 157 464 0 09 Aug 2020
PAC learning with stable and private predictions Y. Dagan Vitaly Feldman 41 12 0 24 Nov 2019
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 215 6,555 0 05 Nov 2019
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism Mohammad Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 329 1,904 0 17 Sep 2019
When Does Label Smoothing Help? Rafael Müller Simon Kornblith Geoffrey E. Hinton UQCV 195 1,950 0 06 Jun 2019
The Curious Case of Neural Text Degeneration Ari Holtzman Jan Buys Li Du Maxwell Forbes Yejin Choi 184 3,184 0 22 Apr 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 94,891 0 11 Oct 2018
Privacy-preserving Prediction Cynthia Dwork Vitaly Feldman 55 91 0 27 Mar 2018
The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks Nicholas Carlini Chang-rui Liu Ulfar Erlingsson Jernej Kos D. Song 139 1,143 0 22 Feb 2018
Generalization in Deep Learning Kenji Kawaguchi L. Kaelbling Yoshua Bengio ODL 88 459 0 16 Oct 2017
Privacy Risk in Machine Learning: Analyzing the Connection to Overfitting Samuel Yeom Irene Giacomelli Matt Fredrikson S. Jha MIACV 100 39 0 05 Sep 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 701 131,652 0 12 Jun 2017
Renyi Differential Privacy Ilya Mironov 77 1,259 0 24 Feb 2017
Deep Learning with Differential Privacy Martín Abadi Andy Chu Ian Goodfellow H. B. McMahan Ilya Mironov Kunal Talwar Li Zhang FedML SyDa 205 6,121 0 01 Jul 2016
Generalization in Adaptive Data Analysis and Holdout Reuse Cynthia Dwork Vitaly Feldman Moritz Hardt T. Pitassi Omer Reingold Aaron Roth 62 231 0 08 Jun 2015
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 434 20,553 0 10 Sep 2014