Selective Differential Privacy for Language Modeling

30 August 2021

Papers citing "Selective Differential Privacy for Language Modeling"

46 / 46 papers shown

Title
DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models Yanming Liu Xinyue Peng Yuwei Zhang Xiaolan Ke Songhang Deng ... Sheng Cheng Xun Wang Jianwei Yin Tianyu Du Xuhong Zhang 70 0 0 21 Feb 2025
Noise-Aware Algorithm for Heterogeneous Differentially Private Federated Learning Saber Malekmohammadi Yaoliang Yu Yang Cao FedML 83 5 0 17 Feb 2025
Optimal Defenses Against Gradient Reconstruction Attacks Yuxiao Chen Gamze Gürsoy Qi Lei FedML AAML 31 0 0 06 Nov 2024
Masked Differential Privacy David Schneider Sina Sajadmanesh Vikash Sehwag Saquib Sarfraz Rainer Stiefelhagen Lingjuan Lyu Vivek Sharma 28 0 0 22 Oct 2024
Evaluating Differentially Private Synthetic Data Generation in High-Stakes Domains Krithika Ramesh Nupoor Gandhi Pulkit Madaan Lisa Bauer Charith Peris Anjalie Field SyDa 30 1 0 10 Oct 2024
Bridging Today and the Future of Humanity: AI Safety in 2024 and Beyond Shanshan Han 78 1 0 09 Oct 2024
Undesirable Memorization in Large Language Models: A Survey Ali Satvaty Suzan Verberne Fatih Turkmen ELM PILM 71 7 0 03 Oct 2024
Enhancing Text-to-SQL Capabilities of Large Language Models via Domain Database Knowledge Injection Xingyu Ma Xin Tian Lingxiang Wu Xuepeng Wang Xueming Tang Jinqiao Wang 46 0 0 24 Sep 2024
Characterizing Stereotypical Bias from Privacy-preserving Pre-Training Stefan Arnold Rene Gröbner Annika Schreiner 37 0 0 30 Jun 2024
Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas Chengyuan Deng Yiqun Duan Xin Jin Heng Chang Yijun Tian ... Kuofeng Gao Sihong He Jun Zhuang Lu Cheng Haohan Wang AILaw 40 16 0 08 Jun 2024
PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restoration Ziqian Zeng Jianwei Wang Zhengdong Lu Huiping Zhuang Cen Chen RALM KELM 37 7 0 03 Jun 2024
Just Rewrite It Again: A Post-Processing Method for Enhanced Semantic Similarity and Privacy Preservation of Differentially Private Rewritten Text Stephen Meisenbacher Florian Matthes 43 0 0 30 May 2024
Large Language Models for UAVs: Current State and Pathways to the Future Shumaila Javaid Nasir Saeed Bin He 32 16 0 02 May 2024
$1-Diffractor: Efficient and Utility-Preserving Text Obfuscation Leveraging Word-Level Metric Differential Privacy$ 1-Diffractor: Efficient and Utility-Preserving Text Obfuscation Leveraging Word-Level Metric Differential Privacy Stephen Meisenbacher Maulik Chevli Florian Matthes 33 6 0 02 May 2024
LLM-based Privacy Data Augmentation Guided by Knowledge Distillation with a Distribution Tutor for Medical Text Classification Yiping Song Juhua Zhang Zhiliang Tian Yuxin Yang Minlie Huang Dongsheng Li 34 10 0 26 Feb 2024
De-amplifying Bias from Differential Privacy in Language Model Fine-tuning Sanjari Srivastava Piotr (Peter) Mardziel Zhikhun Zhang Archana Ahlawat Anupam Datta John C. Mitchell 32 1 0 07 Feb 2024
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems Tianyu Cui Yanling Wang Chuanpu Fu Yong Xiao Sijia Li ... Junwu Xiong Xinyu Kong Zujie Wen Ke Xu Qi Li 57 56 0 11 Jan 2024
Differentially Private Low-Rank Adaptation of Large Language Model Using Federated Learning Xiao-Yang Liu Rongyi Zhu Daochen Zha Jiechao Gao Shan Zhong Matt White Meikang Qiu 23 15 0 29 Dec 2023
Grounding Foundation Models through Federated Transfer Learning: A General Framework Yan Kang Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 68 19 0 29 Nov 2023
DP-NMT: Scalable Differentially-Private Machine Translation Timour Igamberdiev Doan Nam Long Vu Felix Künnecke Zhuo Yu Jannik Holmer Ivan Habernal 31 7 0 24 Nov 2023
Moderating Model Marketplaces: Platform Governance Puzzles for AI Intermediaries Robert Gorwa Michael Veale 11 10 0 21 Nov 2023
Where have you been? A Study of Privacy Risk for Point-of-Interest Recommendation Kunlin Cai Jinghuai Zhang Zhiqing Hong Will Shand Guang Wang Desheng Zhang Jianfeng Chi Yuan Tian 16 1 0 28 Oct 2023
Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory Niloofar Mireshghallah Hyunwoo J. Kim Xuhui Zhou Yulia Tsvetkov Maarten Sap Reza Shokri Yejin Choi PILM 30 73 0 27 Oct 2023
SoK: Memorization in General-Purpose Large Language Models Valentin Hartmann Anshuman Suri Vincent Bindschaedler David E. Evans Shruti Tople Robert West KELM LLMAG 16 20 0 24 Oct 2023
Privacy Preserving Large Language Models: ChatGPT Case Study Based Vision and Framework Imdad Ullah Najm Hassan S. Gill Basem Suleiman T. Ahanger Zawar Shah Junaid Qadir S. Kanhere 37 16 0 19 Oct 2023
Disentangling the Linguistic Competence of Privacy-Preserving BERT Stefan Arnold Nils Kemmerzell Annika Schreiner 25 0 0 17 Oct 2023
Protecting User Privacy in Remote Conversational Systems: A Privacy-Preserving framework based on text sanitization Zhigang Kan Linbo Qiao Hao Yu Liwen Peng Yifu Gao Dongsheng Li 26 20 0 14 Jun 2023
Trade-Offs Between Fairness and Privacy in Language Modeling Cleo Matzken Steffen Eger Ivan Habernal SILM 39 6 0 24 May 2023
Privacy Implications of Retrieval-Based Language Models Yangsibo Huang Samyak Gupta Zexuan Zhong K. Li Danqi Chen RALM 25 29 0 24 May 2023
Can Copyright be Reduced to Privacy? N. Elkin-Koren Uri Y. Hacohen Roi Livni Shay Moran 29 21 0 24 May 2023
Domain Private Transformers for Multi-Domain Dialog Systems Anmol Kabra Ethan R. Elenberg 11 0 0 23 May 2023
Privacy-Preserving Prompt Tuning for Large Language Model Services Yansong Li Zhixing Tan Yang Liu SILM VLM 45 63 0 10 May 2023
Analyzing Leakage of Personally Identifiable Information in Language Models Nils Lukas A. Salem Robert Sim Shruti Tople Lukas Wutschitz Santiago Zanella Béguelin PILM 19 211 0 01 Feb 2023
Context-Aware Differential Privacy for Language Modeling M. H. Dinh Ferdinando Fioretto 25 2 0 28 Jan 2023
Differentially Private Natural Language Models: Recent Advances and Future Directions Lijie Hu Ivan Habernal Lei Shen Di Wang AAML 15 18 0 22 Jan 2023
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey Sachin Kumar Vidhisha Balachandran Lucille Njoo Antonios Anastasopoulos Yulia Tsvetkov ELM 68 85 0 14 Oct 2022
PQLM -- Multilingual Decentralized Portable Quantum Language Model for Privacy Protection Shuyue Stella Li Xiangyu Zhang Shu Zhou Hongchao Shu Ruixing Liang Hexin Liu Leibny Paola García 38 22 0 06 Oct 2022
On the Impossible Safety of Large AI Models El-Mahdi El-Mhamdi Sadegh Farhadkhani R. Guerraoui Nirupam Gupta L. Hoang Rafael Pinot Sébastien Rouault John Stephan 30 31 0 30 Sep 2022
Are Large Pre-Trained Language Models Leaking Your Personal Information? Jie Huang Hanyin Shao Kevin Chen-Chuan Chang PILM 17 177 0 25 May 2022
Provably Confidential Language Modelling Xuandong Zhao Lei Li Yu-Xiang Wang MU 14 15 0 04 May 2022
Just Fine-tune Twice: Selective Differential Privacy for Large Language Models Weiyan Shi Ryan Shea Si-An Chen Chiyuan Zhang R. Jia Zhou Yu AAML 26 38 0 15 Apr 2022
Towards Differential Relational Privacy and its use in Question Answering Simone Bombari Alessandro Achille Zijian Wang Yu-Xiang Wang Yusheng Xie Kunwar Yashraj Singh Srikar Appalaraju Vijay Mahadevan Stefano Soatto 16 1 0 30 Mar 2022
What Does it Mean for a Language Model to Preserve Privacy? Hannah Brown Katherine Lee Fatemehsadat Mireshghallah Reza Shokri Florian Tramèr PILM 29 232 0 11 Feb 2022
Submix: Practical Private Prediction for Large-Scale Language Models Antonio A. Ginart L. V. D. van der Maaten James Y. Zou Chuan Guo 22 22 0 04 Jan 2022
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 290 1,814 0 14 Dec 2020
Tempered Sigmoid Activations for Deep Learning with Differential Privacy Nicolas Papernot Abhradeep Thakurta Shuang Song Steve Chien Ulfar Erlingsson AAML 139 178 0 28 Jul 2020