v1v2 (latest)

Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?

15 April 2021

ArXiv (abs)PDF HTML Github (51★)

Papers citing "Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?"

23 / 23 papers shown

Title
A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics Kai He Rui Mao Qika Lin Yucheng Ruan Xiang Lan Mengling Feng Min Zhang LM&MA AILaw 209 173 0 28 Jan 2025
Undesirable Memorization in Large Language Models: A Survey Ali Satvaty Suzan Verberne Fatih Turkmen ELM PILM 164 7 0 03 Oct 2024
PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action Yijia Shao Tianshi Li Weiyan Shi Yanchen Liu Diyi Yang PILM 116 26 0 29 Aug 2024
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown Basel Alomair Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 489 1,923 0 14 Dec 2020
X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models Zhengbao Jiang Antonios Anastasopoulos Jun Araki Haibo Ding Graham Neubig HILM KELM 65 143 0 13 Oct 2020
Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkit Z. Kraljevic Thomas Searle Anthony Shek Lukasz Roguski Kawsar Noor ... A. Shah W. K. Wong Zina M. Ibrahim J. Teo Richard J. B. Dobson AI4MH 109 165 0 02 Oct 2020
Language Models as Knowledge Bases: On Entity Representations, Storage Capacity, and Paraphrased Queries Benjamin Heinzerling Kentaro Inui KELM 57 131 0 20 Aug 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 799 42,055 0 28 May 2020
How Much Knowledge Can You Pack Into the Parameters of a Language Model? Adam Roberts Colin Raffel Noam M. Shazeer KELM 110 891 0 10 Feb 2020
Inducing Relational Knowledge from BERT Zied Bouraoui Jose Camacho-Collados Steven Schockaert 90 167 0 28 Nov 2019
How Can We Know What Language Models Know? Zhengbao Jiang Frank F. Xu Jun Araki Graham Neubig KELM 132 1,405 0 28 Nov 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 442 20,181 0 23 Oct 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 571 2,670 0 03 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 662 24,464 0 26 Jul 2019
ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission Kexin Huang Jaan Altosaar Rajesh Ranganath OOD 105 905 0 10 Apr 2019
Publicly Available Clinical BERT Embeddings Emily Alsentzer John R. Murphy Willie Boag W. Weng Di Jin Tristan Naumann Matthew B. A. McDermott AI4MH 156 1,979 0 06 Apr 2019
BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model Alex Jinpeng Wang Kyunghyun Cho VLM 82 358 0 11 Feb 2019
Privacy-Preserving Distributed Deep Learning for Clinical Data Brett K. Beaulieu-Jones W. Yuan S. G. Finlayson Zhiwei Steven Wu OOD FedML 52 46 0 04 Dec 2018
Auditing Data Provenance in Text-Generation Models Congzheng Song Vitaly Shmatikov MLAU 49 17 0 01 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 94,891 0 11 Oct 2018
ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Models A. Salem Yang Zhang Mathias Humbert Pascal Berrang Mario Fritz Michael Backes MIACV MIALM 94 949 0 04 Jun 2018
Understanding intermediate layers using linear classifier probes Guillaume Alain Yoshua Bengio FAtt 158 949 0 05 Oct 2016
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 677 31,512 0 16 Jan 2013