Differentially Private Language Models for Secure Data Sharing

25 October 2022

Papers citing "Differentially Private Language Models for Secure Data Sharing"

45 / 45 papers shown

Title
PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restoration Huiping Zhuang Jianwei Wang Zhengdong Lu Huiping Zhuang Haoran Li Huiping Zhuang Cen Chen RALM KELM 62 8 0 03 Jun 2024
The Limits of Word Level Differential Privacy Justus Mattern Benjamin Weggenmann Florian Kerschbaum 23 48 0 02 May 2022
How reparametrization trick broke differentially-private text representation learning Ivan Habernal 17 13 0 24 Feb 2022
What Does it Mean for a Language Model to Preserve Privacy? Hannah Brown Katherine Lee Fatemehsadat Mireshghallah Reza Shokri Florian Tramèr PILM 73 235 0 11 Feb 2022
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 174 356 0 13 Oct 2021
When differential privacy meets NLP: The devil is in the detail Ivan Habernal SILM 16 36 0 07 Sep 2021
Large-Scale Differentially Private BERT Rohan Anil Badih Ghazi Vineet Gupta Ravi Kumar Pasin Manurangsi 48 133 0 03 Aug 2021
Towards Understanding and Mitigating Social Biases in Language Models Paul Pu Liang Chiyu Wu Louis-Philippe Morency Ruslan Salakhutdinov 63 387 0 24 Jun 2021
Numerical Composition of Differential Privacy Sivakanth Gopi Y. Lee Lukas Wutschitz 32 176 0 05 Jun 2021
Generating Datasets with Pretrained Language Models Timo Schick Hinrich Schütze 115 235 0 15 Apr 2021
StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer Yiwei Lyu Paul Pu Liang Hai Pham Eduard H. Hovy Barnabas Poczos Ruslan Salakhutdinov Louis-Philippe Morency 42 42 0 12 Apr 2021
Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP Timo Schick Sahana Udupa Hinrich Schütze 278 380 0 28 Feb 2021
MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers Krishna Pillutla Swabha Swayamdipta Rowan Zellers John Thickstun Sean Welleck Yejin Choi Zaïd Harchaoui 77 347 0 02 Feb 2021
ADePT: Auto-encoder based Differentially Private Text Transformation Satyapriya Krishna Rahul Gupta Christophe Dupuy MIACV SILM 54 36 0 29 Jan 2021
Persistent Anti-Muslim Bias in Large Language Models Abubakar Abid Maheen Farooqi James Zou AILaw 70 545 0 14 Jan 2021
Few-Shot Text Generation with Pattern-Exploiting Training Timo Schick Hinrich Schütze 56 145 0 22 Dec 2020
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 398 1,868 0 14 Dec 2020
Private Post-GAN Boosting Marcel Neunhoeffer Zhiwei Steven Wu Cynthia Dwork 133 29 0 23 Jul 2020
GS-WGAN: A Gradient-Sanitized Approach for Learning Differentially Private Generators Dingfan Chen Tribhuvanesh Orekondy Mario Fritz SyDa 32 183 0 15 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 453 41,106 0 28 May 2020
Information Leakage in Embedding Models Congzheng Song A. Raghunathan MIACV 27 264 0 31 Mar 2020
DP-CGAN: Differentially Private Synthetic Data and Label Generation Reihaneh Torkzadehmahani Peter Kairouz B. Paten SyDa 37 236 0 27 Jan 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 211 42,038 0 03 Dec 2019
Deep Learning with Gaussian Differential Privacy Zhiqi Bu Jinshuo Dong Qi Long Weijie J. Su FedML 34 205 0 26 Nov 2019
Not Enough Data? Deep Learning to the Rescue! Ateret Anaby-Tavor Boaz Carmeli Esther Goldbraich Amir Kantor George Kour Segev Shlomov N. Tepper Naama Zwerdling 52 368 0 08 Nov 2019
Leveraging Hierarchical Representations for Preserving Privacy and Utility in Text Oluwaseyi Feyisetan Tom Diethe Thomas Drake 38 74 0 20 Oct 2019
Privacy- and Utility-Preserving Textual Analysis via Calibrated Multivariate Perturbations Oluwaseyi Feyisetan Borja Balle Thomas Drake Tom Diethe 29 153 0 20 Oct 2019
The Woman Worked as a Babysitter: On Biases in Language Generation Emily Sheng Kai-Wei Chang Premkumar Natarajan Nanyun Peng 254 631 0 03 Sep 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 545 11,979 0 27 Aug 2019
ER-AE: Differentially Private Text Generation for Authorship Anonymization Haohan Bo Steven H. H. Ding Benjamin C. M. Fung Farkhund Iqbal DeLMO 41 38 0 20 Jul 2019
I Am Not What I Write: Privacy Preserving Text Representation Learning Ghazaleh Beigi Kai Shu Ruocheng Guo Suhang Wang Huan Liu 57 25 0 06 Jul 2019
The Curious Case of Neural Text Degeneration Ari Holtzman Jan Buys Li Du Maxwell Forbes Yejin Choi 145 3,133 0 22 Apr 2019
Generalised Differential Privacy for Text Document Processing Natasha Fernandes Mark Dras Annabelle McIver 29 107 0 26 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 870 93,936 0 11 Oct 2018
Privacy-preserving Neural Representations of Text Maximin Coavoux Shashi Narayan Shay B. Cohen AAML 21 116 0 28 Aug 2018
SynTF: Synthetic and Differentially Private Term Frequency Vectors for Privacy-Preserving Text Mining Benjamin Weggenmann Florian Kerschbaum 19 49 0 02 May 2018
Differentially Private Generative Adversarial Network Liyang Xie Kaixiang Lin Shu Wang Fei Wang Jiayu Zhou SyDa 66 492 0 19 Feb 2018
$$A^{4}NT$: Author Attribute Anonymity by Adversarial Training of Neural Machine Translation$ $A^{4}NT$ : Author Attribute Anonymity by Adversarial Training of Neural Machine Translation Rakshith Shetty Bernt Schiele Mario Fritz 66 95 0 06 Nov 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 422 129,831 0 12 Jun 2017
Renyi Differential Privacy Ilya Mironov 51 1,243 0 24 Feb 2017
Deep Learning with Differential Privacy Martín Abadi Andy Chu Ian Goodfellow H. B. McMahan Ilya Mironov Kunal Talwar Li Zhang FedML SyDa 160 6,049 0 01 Jul 2016
Concentrated Differential Privacy: Simplifications, Extensions, and Lower Bounds Mark Bun Thomas Steinke 52 823 0 06 May 2016
Concentrated Differential Privacy Cynthia Dwork G. Rothblum 50 446 0 06 Mar 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 678 149,474 0 22 Dec 2014
The Composition Theorem for Differential Privacy Peter Kairouz Sewoong Oh Pramod Viswanath 86 677 0 04 Nov 2013