Large-Scale Differentially Private BERT

3 August 2021

Papers citing "Large-Scale Differentially Private BERT"

50 / 107 papers shown

Title
How Private is Your Attention? Bridging Privacy with In-Context Learning Soham Bonnerjee Zhen Wei Yeon Anna Asch Sagnik Nandy Promit Ghosal 47 0 0 22 Apr 2025
Empirical Calibration and Metric Differential Privacy in Language Models Pedro Faustini Natasha Fernandes Annabelle McIver Mark Dras 62 0 0 18 Mar 2025
Empirical Privacy Variance Yuzheng Hu Fan Wu Ruicheng Xian Yuhang Liu Lydia Zakynthinou Pritish Kamath Chiyuan Zhang David A. Forsyth 62 0 0 16 Mar 2025
PoisonedParrot: Subtle Data Poisoning Attacks to Elicit Copyright-Infringing Content from Large Language Models Michael-Andrei Panaitescu-Liess Pankayaraj Pathmanathan Yigitcan Kaya Zora Che Bang An Sicheng Zhu Aakriti Agrawal Furong Huang AAML 59 0 0 10 Mar 2025
Privacy Auditing of Large Language Models Ashwinee Panda Xinyu Tang Milad Nasr Christopher A. Choquette-Choo Prateek Mittal PILM 62 5 0 09 Mar 2025
Mitigating Memorization in LLMs using Activation Steering Manan Suri Nishit Anand Amisha Bhaskar LLMSV 50 2 0 08 Mar 2025
Balls-and-Bins Sampling for DP-SGD Lynn Chua Badih Ghazi Charlie Harrison Ethan Leeman Pritish Kamath Ravi Kumar Pasin Manurangsi Amer Sinha Chiyuan Zhang 80 3 0 21 Dec 2024
Copyright-Protected Language Generation via Adaptive Model Fusion Javier Abad Konstantin Donhauser Francesco Pinto Fanny Yang 74 1 0 09 Dec 2024
On the Privacy Risk of In-context Learning Haonan Duan Adam Dziedzic Mohammad Yaghini Nicolas Papernot Franziska Boenisch SILM PILM 61 36 0 15 Nov 2024
Scalable DP-SGD: Shuffling vs. Poisson Subsampling Lynn Chua Badih Ghazi Pritish Kamath Ravi Kumar Pasin Manurangsi Amer Sinha Chiyuan Zhang 36 5 0 06 Nov 2024
R+R:Understanding Hyperparameter Effects in DP-SGD Felix Morsbach J. Reubold T. Strufe 31 0 0 04 Nov 2024
Does Differential Privacy Impact Bias in Pretrained NLP Models? Md. Khairul Islam Andrew Wang Tianhao Wang Yangfeng Ji Judy Fox Jieyu Zhao AI4CE 28 0 0 24 Oct 2024
Privately Learning from Graphs with Applications in Fine-tuning Large Language Models Haoteng Yin Rongzhe Wei Eli Chien P. Li 28 0 0 10 Oct 2024
Enhancing Text-to-SQL Capabilities of Large Language Models via Domain Database Knowledge Injection Xingyu Ma Xin Tian Lingxiang Wu Xuepeng Wang Xueming Tang Jinqiao Wang 46 0 0 24 Sep 2024
Training Large ASR Encoders with Differential Privacy Geeticka Chauhan Steve Chien Om Thakkar Abhradeep Thakurta Arun Narayanan 33 1 0 21 Sep 2024
A Different Level Text Protection Mechanism With Differential Privacy Qingwen Fu 35 0 0 05 Sep 2024
Strong Copyright Protection for Language Models via Adaptive Model Fusion Javier Abad Konstantin Donhauser Francesco Pinto Fanny Yang 42 4 0 29 Jul 2024
Weights Shuffling for Improving DPSGD in Transformer-based Models Jungang Yang Zhe Ji Liyao Xiang 37 0 0 22 Jul 2024
Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs) Apurv Verma Satyapriya Krishna Sebastian Gehrmann Madhavan Seshadri Anu Pradhan Tom Ault Leslie Barrett David Rabinowitz John Doucette Nhathai Phan 51 9 0 20 Jul 2024
Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning Lynn Chua Badih Ghazi Yangsibo Huang Pritish Kamath Ravi Kumar Daogao Liu Pasin Manurangsi Amer Sinha Chiyuan Zhang 24 11 0 20 Jun 2024
Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs Abhimanyu Hans Yuxin Wen Neel Jain John Kirchenbauer Hamid Kazemi ... Siddharth Singh Gowthami Somepalli Jonas Geiping A. Bhatele Tom Goldstein 33 30 0 14 Jun 2024
REVS: Unlearning Sensitive Information in Language Models via Rank Editing in the Vocabulary Space Tomer Ashuach Martin Tutek Yonatan Belinkov KELM MU 65 4 0 13 Jun 2024
Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas Chengyuan Deng Yiqun Duan Xin Jin Heng Chang Yijun Tian ... Kuofeng Gao Sihong He Jun Zhuang Lu Cheng Haohan Wang AILaw 40 16 0 08 Jun 2024
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs Charlie Hou Akshat Shrivastava Hongyuan Zhan Rylan Conway Trang Le Adithya Sagar Giulia Fanti Daniel Lazar 26 8 0 05 Jun 2024
Delving into Differentially Private Transformer Youlong Ding Xueyang Wu Yining Meng Yonggang Luo Hao Wang Weike Pan 29 5 0 28 May 2024
Learnable Privacy Neurons Localization in Language Models Ruizhe Chen Tianxiang Hu Yang Feng Zuo-Qiang Liu 38 12 0 16 May 2024
ExplainableDetector: Exploring Transformer-based Language Modeling Approach for SMS Spam Detection with Explainability Analysis Mohammad Amaz Uddin Muhammad Nazrul Islam Leandros A. Maglaras Helge Janicke Iqbal H. Sarker 42 2 0 12 May 2024
To Each (Textual Sequence) Its Own: Improving Memorized-Data Unlearning in Large Language Models George-Octavian Barbulescu Peter Triantafillou MU 33 16 0 06 May 2024
LazyDP: Co-Designing Algorithm-Software for Scalable Training of Differentially Private Recommendation Models Juntaek Lim Youngeun Kwon Ranggi Hwang Kiwan Maeng Edward Suh Minsoo Rhu SyDa 31 0 0 12 Apr 2024
How Private are DP-SGD Implementations? Lynn Chua Badih Ghazi Pritish Kamath Ravi Kumar Pasin Manurangsi Amer Sinha Chiyuan Zhang 37 12 0 26 Mar 2024
DP-TabICL: In-Context Learning with Differentially Private Tabular Data Alycia N. Carey Karuna Bhaila Kennedy Edemacu Xintao Wu 35 7 0 08 Mar 2024
Privacy-preserving Fine-tuning of Large Language Models through Flatness Tiejin Chen Longchao Da Huixue Zhou Pingzhi Li Kaixiong Zhou Tianlong Chen Hua Wei 29 5 0 07 Mar 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text Chulin Xie Zinan Lin A. Backurs Sivakanth Gopi Da Yu ... Haotian Jiang Huishuai Zhang Yin Tat Lee Bo-wen Li Sergey Yekhanin SyDa 63 33 0 04 Mar 2024
LLM-based Privacy Data Augmentation Guided by Knowledge Distillation with a Distribution Tutor for Medical Text Classification Yiping Song Juhua Zhang Zhiliang Tian Yuxin Yang Minlie Huang Dongsheng Li 34 10 0 26 Feb 2024
Privacy-Preserving Instructions for Aligning Large Language Models Da Yu Peter Kairouz Sewoong Oh Zheng Xu 32 17 0 21 Feb 2024
Amplifying Training Data Exposure through Fine-Tuning with Pseudo-Labeled Memberships Myung Gyo Oh Hong Eun Ahn L. Park T.-H. Kwon MIALM AAML 29 0 0 19 Feb 2024
Security and Privacy Challenges of Large Language Models: A Survey B. Das M. H. Amini Yanzhao Wu PILM ELM 19 103 0 30 Jan 2024
Differentially Private Low-Rank Adaptation of Large Language Model Using Federated Learning Xiao-Yang Liu Rongyi Zhu Daochen Zha Jiechao Gao Shan Zhong Matt White Meikang Qiu 23 15 0 29 Dec 2023
Enhancing Trade-offs in Privacy, Utility, and Computational Efficiency through MUltistage Sampling Technique (MUST) Xingyuan Zhao Fang Liu 30 0 0 20 Dec 2023
Unlearn What You Want to Forget: Efficient Unlearning for LLMs Jiaao Chen Diyi Yang MU 24 136 0 31 Oct 2023
MoPe: Model Perturbation-based Privacy Attacks on Language Models Marvin Li Jason Wang Jeffrey G. Wang Seth Neel AAML 35 18 0 22 Oct 2023
Privacy Preserving Large Language Models: ChatGPT Case Study Based Vision and Framework Imdad Ullah Najm Hassan S. Gill Basem Suleiman T. Ahanger Zawar Shah Junaid Qadir S. Kanhere 40 16 0 19 Oct 2023
Identifying and Mitigating Privacy Risks Stemming from Language Models: A Survey Victoria Smith Ali Shahin Shamsabadi Carolyn Ashurst Adrian Weller PILM 32 24 0 27 Sep 2023
DP-Forward: Fine-tuning and Inference on Language Models with Differential Privacy in Forward Pass Minxin Du Xiang Yue Sherman S. M. Chow Tianhao Wang Chenyu Huang Huan Sun SILM 29 58 0 13 Sep 2023
Unlocking Accuracy and Fairness in Differentially Private Image Classification Leonard Berrada Soham De J. Shen Jamie Hayes Robert Stanforth David Stutz Pushmeet Kohli Samuel L. Smith Borja Balle 21 13 0 21 Aug 2023
Population Expansion for Training Language Models with Private Federated Learning Tatsuki Koga Congzheng Song Martin Pelikan Mona Chitnis FedML 16 1 0 14 Jul 2023
Differentially Private Video Activity Recognition Zelun Luo Yuliang Zou Yijin Yang Zane Durante De-An Huang Zhiding Yu Chaowei Xiao L. Fei-Fei Anima Anandkumar PICV 27 3 0 27 Jun 2023
ViP: A Differentially Private Foundation Model for Computer Vision Yaodong Yu Maziar Sanjabi Y. Ma Kamalika Chaudhuri Chuan Guo 16 12 0 15 Jun 2023
Privately generating tabular data using language models Alexandre Sablayrolles Yue Wang Brian Karrer LMTD 11 4 0 07 Jun 2023
DPFormer: Learning Differentially Private Transformer on Long-Tailed Data Youlong Ding Xueyang Wu Hongya Wang Weike Pan 31 0 0 28 May 2023