The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks

22 February 2018

Papers citing "The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks"

50 / 716 papers shown

Title
Gradients Look Alike: Sensitivity is Often Overestimated in DP-SGD Anvith Thudi Hengrui Jia Casey Meehan Ilia Shumailov Nicolas Papernot 33 3 0 01 Jul 2023
Deconstructing Classifiers: Towards A Data Reconstruction Attack Against Text Classification Models Adel M. Elmahdy A. Salem SILM 25 6 0 23 Jun 2023
Protecting User Privacy in Remote Conversational Systems: A Privacy-Preserving framework based on text sanitization Zhigang Kan Linbo Qiao Hao Yu Liwen Peng Yifu Gao Dongsheng Li 28 20 0 14 Jun 2023
DP-HyPO: An Adaptive Private Hyperparameter Optimization Framework Hua Wang Sheng-yang Gao Huanyu Zhang Weijie J. Su Milan Shen 25 5 0 09 Jun 2023
Machine Unlearning: A Survey Heng Xu Tianqing Zhu Lefeng Zhang Wanlei Zhou Philip S. Yu MU 41 19 0 06 Jun 2023
Harnessing large-language models to generate private synthetic text Alexey Kurakin Natalia Ponomareva Umar Syed Liam MacDermed Andreas Terzis SILM SyDa 36 36 0 02 Jun 2023
A Note On Interpreting Canary Exposure Matthew Jagielski 20 4 0 31 May 2023
Surrogate Model Extension (SME): A Fast and Accurate Weight Update Attack on Federated Learning Junyi Zhu Ruicong Yao Matthew B. Blaschko FedML 8 9 0 31 May 2023
Quantifying Overfitting: Evaluating Neural Network Performance through Analysis of Null Space Hossein Rezaei Mohammad Sabokrou 18 3 0 30 May 2023
Federated Learning of Gboard Language Models with Differential Privacy Zheng Xu Yanxiang Zhang Galen Andrew Christopher A. Choquette-Choo Peter Kairouz H. B. McMahan Jesse Rosenstock Yuanbo Zhang FedML 44 77 0 29 May 2023
Unleashing the Power of Randomization in Auditing Differentially Private ML Krishna Pillutla Galen Andrew Peter Kairouz H. B. McMahan Alina Oprea Sewoong Oh 38 20 0 29 May 2023
NOTABLE: Transferable Backdoor Attacks Against Prompt-based NLP Models Kai Mei Zheng Li Zhenting Wang Yang Zhang Shiqing Ma AAML SILM 37 48 0 28 May 2023
DPFormer: Learning Differentially Private Transformer on Long-Tailed Data Youlong Ding Xueyang Wu Hongya Wang Weike Pan 39 0 0 28 May 2023
Training Data Extraction From Pre-trained Language Models: A Survey Shotaro Ishihara 32 46 0 25 May 2023
Privacy Protectability: An Information-theoretical Approach Siping Shi Bihai Zhang Dan Wang 23 1 0 25 May 2023
Trade-Offs Between Fairness and Privacy in Language Modeling Cleo Matzken Steffen Eger Ivan Habernal SILM 41 6 0 24 May 2023
Privacy Implications of Retrieval-Based Language Models Yangsibo Huang Samyak Gupta Zexuan Zhong Keqin Li Danqi Chen RALM 33 29 0 24 May 2023
Differentially Private Synthetic Data via Foundation Model APIs 1: Images Zinan Lin Sivakanth Gopi Janardhan Kulkarni Harsha Nori Sergey Yekhanin 41 37 0 24 May 2023
Watermarking Text Data on Large Language Models for Dataset Copyright Yixin Liu Hongsheng Hu Xun Chen Xuyun Zhang Lichao Sun WaLM 19 22 0 22 May 2023
Evaluating Privacy Leakage in Split Learning Xinchi Qiu Ilias Leontiadis Luca Melis Alex Sablayrolles Pierre Stock 33 5 0 22 May 2023
Random Relabeling for Efficient Machine Unlearning Junde Li Swaroop Ghosh MU 34 3 0 21 May 2023
Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning Mustafa Safa Ozdayi Charith Peris Jack G. M. FitzGerald Christophe Dupuy Jimit Majmudar Haidar Khan Rahil Parikh Rahul Gupta 25 33 0 19 May 2023
PaLM 2 Technical Report Rohan Anil Andrew M. Dai Orhan Firat Melvin Johnson Dmitry Lepikhin ... Ce Zheng Wei Zhou Denny Zhou Slav Petrov Yonghui Wu ReLM LRM 128 1,152 0 17 May 2023
Privacy Loss of Noisy Stochastic Gradient Descent Might Converge Even for Non-Convex Losses S. Asoodeh Mario Díaz 20 6 0 17 May 2023
Memorization for Good: Encryption with Autoregressive Language Models Samuel Stevens Yung-Chun Su 20 0 0 15 May 2023
Patchwork Learning: A Paradigm Towards Integrative Analysis across Diverse Biomedical Data Sources Suraj Rajendran Weishen Pan M. Sabuncu Yong Chen Jiayu Zhou Fei Wang 57 14 0 10 May 2023
Synthetic Query Generation for Privacy-Preserving Deep Retrieval Systems using Differentially Private Language Models Aldo G. Carranza Rezsa Farahani Natalia Ponomareva Alexey Kurakin Matthew Jagielski Milad Nasr SyDa 28 7 0 10 May 2023
PreCog: Exploring the Relation between Memorization and Performance in Pre-trained Language Models Leonardo Ranaldi Elena Sofia Ruzzetti Fabio Massimo Zanzotto 33 6 0 08 May 2023
Reconstructing Training Data from Multiclass Neural Networks G. Buzaglo Niv Haim Gilad Yehudai Gal Vardi Michal Irani 33 4 0 05 May 2023
Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentence Haoran Li Mingshi Xu Yangqiu Song 95 46 0 04 May 2023
Private Information Retrieval and Its Applications: An Introduction, Open Problems, Future Directions Sajani Vithana Zhusheng Wang S. Ulukus 35 5 0 27 Apr 2023
Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning Casey Meehan Florian Bordes Pascal Vincent Kamalika Chaudhuri Chuan Guo 36 18 0 26 Apr 2023
Emergent and Predictable Memorization in Large Language Models Stella Biderman USVSN Sai Prashanth Lintang Sutawika Hailey Schoelkopf Quentin G. Anthony Shivanshu Purohit Edward Raf 35 117 0 21 Apr 2023
An Evaluation on Large Language Model Outputs: Discourse and Memorization Adrian de Wynter Xun Wang Alex Sokolov Qilong Gu Si-Qing Chen ELM 90 32 0 17 Apr 2023
Does Prompt-Tuning Language Model Ensure Privacy? Shangyu Xie Wei Dai Esha Ghosh Sambuddha Roy Dan Schwartz Kim Laine SILM 53 4 0 07 Apr 2023
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling Stella Biderman Hailey Schoelkopf Quentin G. Anthony Herbie Bradley Kyle O'Brien ... USVSN Sai Prashanth Edward Raff Aviya Skowron Lintang Sutawika Oskar van der Wal 36 1,178 0 03 Apr 2023
Recognition, recall, and retention of few-shot memories in large language models A. Orhan LRM KELM CLL 39 3 0 30 Mar 2023
Foundation Models and Fair Use Peter Henderson Xuechen Li Dan Jurafsky Tatsunori Hashimoto Mark A. Lemley Percy Liang 33 119 0 28 Mar 2023
Ablating Concepts in Text-to-Image Diffusion Models Nupur Kumari Bin Zhang Sheng-Yu Wang Eli Shechtman Richard Y. Zhang Jun-Yan Zhu VLM 21 184 0 23 Mar 2023
Development and validation of a natural language processing algorithm to pseudonymize documents in the context of a clinical data warehouse X. Tannier Perceval Wajsburt Alice Calliger Basile Dura Alexandre Mouchet M. Hilka R. Bey 26 10 0 23 Mar 2023
Do Backdoors Assist Membership Inference Attacks? Yumeki Goto Nami Ashizawa Toshiki Shibahara Naoto Yanai MIACV 22 2 0 22 Mar 2023
Secret-Keeping in Question Answering Nathaniel W. Rollings Kent O'Sullivan Sakshum Kulshrestha KELM 30 0 0 16 Mar 2023
Efficient and Secure Federated Learning for Financial Applications Tao Liu Zhi Wang Hui He Wei Shi Liangliang Lin Wei Shi Ran An Chenhao Li FedML 16 20 0 15 Mar 2023
Erasing Concepts from Diffusion Models Rohit Gandikota Joanna Materzyñska Jaden Fiotto-Kaufman David Bau DiffM 42 286 0 13 Mar 2023
A Human Subject Study of Named Entity Recognition (NER) in Conversational Music Recommendation Queries Elena V. Epure Romain Hennequin 16 5 0 13 Mar 2023
Private Read-Update-Write with Controllable Information Leakage for Storage-Efficient Federated Learning with Top $r$ Sparsification Sajani Vithana S. Ulukus FedML 30 5 0 07 Mar 2023
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset Hugo Laurenccon Lucile Saulnier Thomas Wang Christopher Akiki Albert Villanova del Moral ... Violette Lepercq Suzana Ilić Margaret Mitchell Sasha Luccioni Yacine Jernite AI4CE AILaw 44 163 0 07 Mar 2023
Can Membership Inferencing be Refuted? Zhifeng Kong A. Chowdhury Kamalika Chaudhuri MIALM MIACV 29 6 0 07 Mar 2023
A Comparison of Methods for Neural Network Aggregation John Pomerat Aviv Segev OOD FedML 29 0 0 06 Mar 2023
How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy Natalia Ponomareva Hussein Hazimeh Alexey Kurakin Zheng Xu Carson E. Denison H. B. McMahan Sergei Vassilvitskii Steve Chien Abhradeep Thakurta 96 167 0 01 Mar 2023