Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning

19 May 2023

Mustafa Safa Ozdayi

Charith Peris

Jack G. M. FitzGerald

Papers citing "Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning"

32 / 32 papers shown

Title
Malicious and Unintentional Disclosure Risks in Large Language Models for Code Generation Rafiqul Rabin Sean McGregor Nick Judd AAML PILM 62 0 0 27 Mar 2025
VeriLeaky: Navigating IP Protection vs Utility in Fine-Tuning for LLM-Driven Verilog Coding Zeng Wang Minghao Shao M. Nabeel P. Roy Likhitha Mankali Jitendra Bhandari Ramesh Karri Ozgur Sinanoglu Muhammad Shafique J. Knechtel 73 0 0 17 Mar 2025
Mitigating Memorization in LLMs using Activation Steering Manan Suri Nishit Anand Amisha Bhaskar LLMSV 57 3 0 08 Mar 2025
Privacy Ripple Effects from Adding or Removing Personal Information in Language Model Training Jaydeep Borkar Matthew Jagielski Katherine Lee Niloofar Mireshghallah David A. Smith Christopher A. Choquette-Choo PILM 85 1 0 24 Feb 2025
Privacy in Fine-tuning Large Language Models: Attacks, Defenses, and Future Directions Hao Du Shang Liu Lele Zheng Yang Cao Atsuyoshi Nakamura Lei Chen AAML 114 3 0 21 Dec 2024
Do LLMs Know to Respect Copyright Notice? Jialiang Xu Shenglan Li Zhaozhuo Xu Denghui Zhang 43 2 0 02 Nov 2024
PII-Scope: A Benchmark for Training Data PII Leakage Assessment in LLMs K. K. Nakka Ahmed Frikha Ricardo Mendes Xue Jiang Xuebing Zhou 33 3 0 09 Oct 2024
Undesirable Memorization in Large Language Models: A Survey Ali Satvaty Suzan Verberne Fatih Turkmen ELM PILM 91 7 0 03 Oct 2024
Unlocking Memorization in Large Language Models with Dynamic Soft Prompting Zhepeng Wang Runxue Bao Yawen Wu Jackson Taylor Cao Xiao Feng Zheng Weiwen Jiang Shangqian Gao Yanfu Zhang PILM 39 7 0 20 Sep 2024
MIA-Tuner: Adapting Large Language Models as Pre-training Text Detector Wenjie Fu Huandong Wang Chen Gao Guanghua Liu Yong Li Tao Jiang 34 3 0 16 Aug 2024
The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies Feng He Tianqing Zhu Dayong Ye Bo Liu Wanlei Zhou Philip S. Yu PILM LLMAG ELM 72 24 0 28 Jul 2024
Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs) Apurv Verma Satyapriya Krishna Sebastian Gehrmann Madhavan Seshadri Anu Pradhan Tom Ault Leslie Barrett David Rabinowitz John Doucette Nhathai Phan 59 10 0 20 Jul 2024
PII-Compass: Guiding LLM training data extraction prompts towards the target PII via grounding K. K. Nakka Ahmed Frikha Ricardo Mendes Xue Jiang Xuebing Zhou 32 7 0 03 Jul 2024
Enhancing Data Privacy in Large Language Models through Private Association Editing Davide Venditti Elena Sofia Ruzzetti Giancarlo A. Xompero Cristina Giannone Andrea Favalli Raniero Romagnoli Fabio Massimo Zanzotto KELM 48 2 0 26 Jun 2024
Large Language Models Memorize Sensor Datasets! Implications on Human Activity Recognition Research H. Haresamudram Hrudhai Rajasekhar Nikhil Murlidhar Shanbhogue Thomas Ploetz 37 1 0 09 Jun 2024
Safeguarding Large Language Models: A Survey Yi Dong Ronghui Mu Yanghao Zhang Siqi Sun Tianle Zhang ... Yi Qi Jinwei Hu Jie Meng Saddek Bensalem Xiaowei Huang OffRL KELM AILaw 45 19 0 03 Jun 2024
Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data Haoran Li Xinyuan Zhao Dadi Guo Hanlin Gu Ziqian Zeng Yuxing Han Yangqiu Song Lixin Fan Qiang Yang 27 1 0 23 May 2024
Special Characters Attack: Toward Scalable Training Data Extraction From Large Language Models Yang Bai Ge Pei Jindong Gu Yong Yang Xingjun Ma 33 10 0 09 May 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 150 319 0 21 Mar 2024
Ethos: Rectifying Language Models in Orthogonal Parameter Space Lei Gao Yue Niu Tingting Tang A. Avestimehr Murali Annavaram MU 40 10 0 13 Mar 2024
Building Guardrails for Large Language Models Yizhen Dong Ronghui Mu Gao Jin Yi Qi Jinwei Hu Xingyu Zhao Jie Meng Wenjie Ruan Xiaowei Huang OffRL 65 27 0 02 Feb 2024
Security and Privacy Challenges of Large Language Models: A Survey B. Das M. H. Amini Yanzhao Wu PILM ELM 26 108 0 30 Jan 2024
On the steerability of large language models toward data-driven personas Junyi Li Ninareh Mehrabi Charith Peris Palash Goyal Kai-Wei Chang Aram Galstyan Richard Zemel Rahul Gupta 31 30 0 08 Nov 2023
SoK: Memorization in General-Purpose Large Language Models Valentin Hartmann Anshuman Suri Vincent Bindschaedler David Evans Shruti Tople Robert West KELM LLMAG 29 20 0 24 Oct 2023
The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Risks Xiaoyi Chen Siyuan Tang Rui Zhu Shijun Yan Lei Jin Zihao Wang Liya Su Zhikun Zhang Xiaofeng Wang Haixu Tang AAML PILM 24 17 0 24 Oct 2023
Copyright Violations and Large Language Models Antonia Karamolegkou Jiaang Li Li Zhou Anders Sogaard 25 55 0 20 Oct 2023
Privacy in Large Language Models: Attacks, Defenses and Future Directions Haoran Li Yulin Chen Jinglong Luo Yan Kang Xiaojin Zhang Qi Hu Chunkit Chan Yangqiu Song PILM 52 42 0 16 Oct 2023
Quantifying and Analyzing Entity-level Memorization in Large Language Models Zhenhong Zhou Jiuyang Xiang Chao-Yi Chen Sen Su PILM 38 8 0 30 Aug 2023
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 218 1,664 0 15 Oct 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,879 0 18 Apr 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 282 2,007 0 31 Dec 2020
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 290 1,831 0 14 Dec 2020