v1v2 (latest)

Training Data Leakage Analysis in Language Models

14 January 2021

Papers citing "Training Data Leakage Analysis in Language Models"

27 / 27 papers shown

Title
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown Basel Alomair Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 509 1,946 0 14 Dec 2020
When is Memorization of Irrelevant Training Data Necessary for High-Accuracy Learning? Gavin Brown Mark Bun Vitaly Feldman Adam D. Smith Kunal Talwar 298 100 0 11 Dec 2020
Label-Only Membership Inference Attacks Christopher A. Choquette-Choo Florian Tramèr Nicholas Carlini Nicolas Papernot MIACV MIALM 98 516 0 28 Jul 2020
ML Privacy Meter: Aiding Regulatory Compliance by Quantifying the Privacy Risks of Machine Learning S. K. Murakonda Reza Shokri 45 76 0 18 Jul 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 880 42,379 0 28 May 2020
Analyzing Information Leakage of Updates to Natural Language Models Santiago Zanella Béguelin Lukas Wutschitz Shruti Tople Victor Rühle Andrew Paverd O. Ohrimenko Boris Köpf Marc Brockschmidt ELM MIACV FedML PILM KELM 59 127 0 17 Dec 2019
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 268 6,285 0 10 Dec 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 576 2,674 0 03 Sep 2019
White-box vs Black-box: Bayes Optimal Strategies for Membership Inference Alexandre Sablayrolles Matthijs Douze Yann Ollivier Cordelia Schmid Hervé Jégou MIACV 76 368 0 29 Aug 2019
Stolen Memories: Leveraging Model Memorization for Calibrated White-Box Membership Inference Klas Leino Matt Fredrikson MIACV 96 272 0 27 Jun 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 236 8,447 0 19 Jun 2019
Does Learning Require Memorization? A Short Tale about a Long Tail Vitaly Feldman TDI 134 498 0 12 Jun 2019
Gmail Smart Compose: Real-Time Assisted Writing Mengzhao Chen Benjamin Lee G. Bansal Yuan Cao Shuyuan Zhang ... Yinan Wang Andrew M. Dai Zhiwen Chen Timothy Sohn Yonghui Wu 66 206 0 17 May 2019
ERNIE: Enhanced Representation through Knowledge Integration Yu Sun Shuohuan Wang Yukun Li Shikun Feng Xuyi Chen Han Zhang Xin Tian Danxiang Zhu Hao Tian Hua Wu 121 903 0 19 Apr 2019
Membership Inference Attacks on Sequence-to-Sequence Models: Is My Data In Your Machine Translation System? Sorami Hisamoto Matt Post Kevin Duh MIACV SLR 58 107 0 11 Apr 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Models A. Salem Yang Zhang Mathias Humbert Pascal Berrang Mario Fritz Michael Backes MIACV MIALM 102 950 0 04 Jun 2018
The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks Nicholas Carlini Chang-rui Liu Ulfar Erlingsson Jernej Kos Basel Alomair 150 1,148 0 22 Feb 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 233 11,566 0 15 Feb 2018
Understanding Membership Inferences on Well-Generalized Learning Models Yunhui Long Vincent Bindschaedler Lei Wang Diyue Bu Xiaofeng Wang Haixu Tang Carl A. Gunter Kai Chen MIALM MIACV 55 224 0 13 Feb 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 786 132,363 0 12 Jun 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 351 4,635 0 10 Nov 2016
Membership Inference Attacks against Machine Learning Models Reza Shokri M. Stronati Congzheng Song Vitaly Shmatikov SLR MIALM MIACV 272 4,159 0 18 Oct 2016
Deep Learning with Differential Privacy Martín Abadi Andy Chu Ian Goodfellow H. B. McMahan Ilya Mironov Kunal Talwar Li Zhang FedML SyDa 216 6,162 0 01 Jul 2016
Conversational Contextual Cues: The Case of Personalization and History for Response Ranking Rami Al-Rfou Marc Pickett J. Snaider Yun-hsuan Sung B. Strope R. Kurzweil HAI 70 92 0 01 Jun 2016
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 578 27,327 0 01 Sep 2014
One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling Ciprian Chelba Tomas Mikolov M. Schuster Qi Ge T. Brants P. Koehn T. Robinson 190 1,109 0 11 Dec 2013