Special Characters Attack: Toward Scalable Training Data Extraction From
Large Language Models

v1v2 (latest)

Special Characters Attack: Toward Scalable Training Data Extraction From Large Language Models

9 May 2024

Jindong Gu

ArXiv (abs)PDF HTML

Papers citing "Special Characters Attack: Toward Scalable Training Data Extraction From Large Language Models"

12 / 12 papers shown

Title
Rethinking LLM Memorization through the Lens of Adversarial Compression Avi Schwarzschild Zhili Feng Pratyush Maini Zachary Chase Lipton J. Zico Kolter 125 56 0 23 Apr 2024
Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning Mustafa Safa Ozdayi Charith Peris Jack G. M. FitzGerald Christophe Dupuy Jimit Majmudar Haidar Khan Rahil Parikh Rahul Gupta 65 34 0 19 May 2023
LLMEffiChecker: Understanding and Testing Efficiency Degradation of Large Language Models Simin Chen Cong Liu Mirazul Haque Wei Yang 75 24 0 07 Oct 2022
GLM-130B: An Open Bilingual Pre-trained Model Aohan Zeng Xiao Liu Zhengxiao Du Zihan Wang Hanyu Lai ... Jidong Zhai Wenguang Chen Peng Zhang Yuxiao Dong Jie Tang BDL LRM 362 1,094 0 05 Oct 2022
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 339 682 0 21 Apr 2021
GLM: General Language Model Pretraining with Autoregressive Blank Infilling Zhengxiao Du Yujie Qian Xiao Liu Ming Ding J. Qiu Zhilin Yang Jie Tang BDL AI4CE 151 1,556 0 18 Mar 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown Basel Alomair Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 517 1,953 0 14 Dec 2020
A Panda? No, It's a Sloth: Slowdown Attacks on Adaptive Multi-Exit Neural Network Inference Sanghyun Hong Yigitcan Kaya Ionut-Vlad Modoranu Tudor Dumitras AAML 76 73 0 06 Oct 2020
Label-Only Membership Inference Attacks Christopher A. Choquette-Choo Florian Tramèr Nicholas Carlini Nicolas Papernot MIACV MIALM 104 516 0 28 Jul 2020
Sponge Examples: Energy-Latency Attacks on Neural Networks Ilia Shumailov Yiren Zhao Daniel Bates Nicolas Papernot Robert D. Mullins Ross J. Anderson SILM 68 138 0 05 Jun 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 651 4,921 0 23 Jan 2020
Membership Inference Attacks against Machine Learning Models Reza Shokri M. Stronati Congzheng Song Vitaly Shmatikov SLR MIALM MIACV 280 4,160 0 18 Oct 2016