v1v2 (latest)

Privacy-Preserving Prompt Tuning for Large Language Model Services

10 May 2023

Papers citing "Privacy-Preserving Prompt Tuning for Large Language Model Services"

31 / 81 papers shown

Title
Guiding Text-to-Text Privatization by Syntax Stefan Arnold Dilara Yesilbas Sven Weinzierl 57 9 0 02 Jun 2023
QLoRA: Efficient Finetuning of Quantized LLMs Tim Dettmers Artidoro Pagnoni Ari Holtzman Luke Zettlemoyer ALM 163 2,641 0 23 May 2023
Attack Named Entity Recognition by Entity Boundary Interference Yifei Yang Hongqiu Wu Hai Zhao AAML 78 5 0 09 May 2023
A Paradigm Shift: The Future of Machine Translation Lies with Large Language Models Chenyang Lyu Zefeng Du Jitao Xu Yitao Duan Minghao Wu Teresa Lynn Alham Fikri Aji Derek F. Wong Siyou Liu Longyue Wang 134 26 0 02 May 2023
Analyzing Leakage of Personally Identifiable Information in Language Models Nils Lukas A. Salem Robert Sim Shruti Tople Lukas Wutschitz Santiago Zanella Béguelin PILM 182 235 0 01 Feb 2023
Differentially Private Natural Language Models: Recent Advances and Future Directions Lijie Hu Ivan Habernal Lei Shen Di Wang AAML 92 19 0 22 Jan 2023
Just Fine-tune Twice: Selective Differential Privacy for Large Language Models Weiyan Shi Ryan Shea Si-An Chen Chiyuan Zhang R. Jia Zhou Yu AAML 84 42 0 15 Apr 2022
On Robust Prefix-Tuning for Text Classification Zonghan Yang Yang Liu VLM 68 21 0 19 Mar 2022
Should You Mask 15% in Masked Language Modeling? Alexander Wettig Tianyu Gao Zexuan Zhong Danqi Chen CVBM 105 167 0 16 Feb 2022
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 301 863 0 14 Oct 2021
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 260 372 0 13 Oct 2021
Selective Differential Privacy for Language Modeling Weiyan Shi Aiqi Cui Evan Li R. Jia Zhou Yu 73 72 0 30 Aug 2021
CAPE: Context-Aware Private Embeddings for Private Language Learning Richard Plant Dimitra Gkatzia V. Giuffrida 80 27 0 27 Aug 2021
Large-Scale Differentially Private BERT Rohan Anil Badih Ghazi Vineet Gupta Ravi Kumar Pasin Manurangsi 93 139 0 03 Aug 2021
Large Scale Private Learning via Low-rank Reparametrization Da Yu Huishuai Zhang Wei Chen Jian Yin Tie-Yan Liu 76 106 0 17 Jun 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 676 4,119 0 18 Apr 2021
Prefix-Tuning: Optimizing Continuous Prompts for Generation Xiang Lisa Li Percy Liang 254 4,330 0 01 Jan 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown Basel Alomair Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 559 1,964 0 14 Dec 2020
Differentially Private Representation for NLP: Formal Guarantee and An Empirical Study on Privacy and Fairness Lingjuan Lyu Xuanli He Yitong Li 117 90 0 03 Oct 2020
Differentially Private Language Models Benefit from Public Pre-training Gavin Kerrigan Dylan Slack Jens Tuyls 93 57 0 13 Sep 2020
Emergence of Separable Manifolds in Deep Language Representations Jonathan Mamou Hang Le Miguel Angel del Rio Cory Stephenson Hanlin Tang Yoon Kim SueYeon Chung AAML AI4CE 107 40 0 01 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 1.1K 42,651 0 28 May 2020
Information Leakage in Embedding Models Congzheng Song A. Raghunathan MIACV 92 274 0 31 Mar 2020
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 626 20,418 0 23 Oct 2019
Privacy- and Utility-Preserving Textual Analysis via Calibrated Multivariate Perturbations Oluwaseyi Feyisetan Borja Balle Thomas Drake Tom Diethe 72 157 0 20 Oct 2019
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 299 187 0 03 Sep 2019
BioBERT: a pre-trained biomedical language representation model for biomedical text mining Jinhyuk Lee Wonjin Yoon Sungdong Kim Donghyeon Kim Sunkyu Kim Chan Ho So Jaewoo Kang OOD 226 5,709 0 25 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.9K 95,531 0 11 Oct 2018
Privacy-preserving Neural Representations of Text Maximin Coavoux Shashi Narayan Shay B. Cohen AAML 69 118 0 28 Aug 2018
Adafactor: Adaptive Learning Rates with Sublinear Memory Cost Noam M. Shazeer Mitchell Stern ODL 96 1,055 0 11 Apr 2018
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.3K 150,586 0 22 Dec 2014