Publicly Available Clinical BERT Embeddings

6 April 2019

Matthew B. A. McDermott

AI4MH

ArXiv PDF HTML

Papers citing "Publicly Available Clinical BERT Embeddings"

50 / 806 papers shown

Title
BERT-XML: Large Scale Automated ICD Coding Using BERT Pretraining Zachariah Zhang Jingshu Liu N. Razavian 25 73 0 26 May 2020
Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease prediction L. Rasmy Yang Xiang Z. Xie Cui Tao Degui Zhi AI4MH LM&MA 24 656 0 22 May 2020
Extracting Daily Dosage from Medication Instructions in EHRs: An Automated Approach and Lessons Learned Diwakar Mahajan Jennifer J. Liang Ching-Huei Tsou 6 8 0 21 May 2020
Closing the Gap: Joint De-Identification and Concept Extraction in the Clinical Domain Lukas Lange Heike Adel Jannik Strötgen 17 10 0 19 May 2020
Pre-training technique to localize medical BERT and enhance biomedical BERT Shoya Wada Toshihiro Takeda S. Manabe Shozo Konishi Jun Kamohara Y. Matsumura LM&MA 18 12 0 14 May 2020
Entity-Enriched Neural Models for Clinical Question Answering Bhanu Pratap Singh Rawat W. Weng So Yeon Min Preethi Raghavan Peter Szolovits 23 18 0 13 May 2020
Detecting Adverse Drug Reactions from Twitter through Domain-Specific Preprocessing and BERT Ensembling Amy Breden L. Moore 25 13 0 11 May 2020
An Empirical Study of Multi-Task Learning on BERT for Biomedical Text Mining Yifan Peng Qingyu Chen Zhiyong Lu 8 112 0 06 May 2020
Clinical Reading Comprehension: A Thorough Analysis of the emrQA Dataset Xiang Yue Bernal Jimenez Gutierrez Huan Sun 18 48 0 01 May 2020
Biomedical Entity Representations with Synonym Marginalization Mujeen Sung Hwisang Jeon Jinhyuk Lee Jaewoo Kang 6 128 0 01 May 2020
Data and Representation for Turkish Natural Language Inference Emrah Budur Rıza Özçelik Tunga Güngör Christopher Potts 14 1 0 30 Apr 2020
Unlocking the Power of Deep PICO Extraction: Step-wise Medical NER Identification Tengteng Zhang Yiqin Yu Jing Mei Zefang Tang Xiang Zhang Shaochun Li 19 10 0 30 Apr 2020
Don't Stop Pretraining: Adapt Language Models to Domains and Tasks Suchin Gururangan Ana Marasović Swabha Swayamdipta Kyle Lo Iz Beltagy Doug Downey Noah A. Smith VLM AI4CE CLL 42 2,358 0 23 Apr 2020
MT-Clinical BERT: Scaling Clinical Information Extraction with Multitask Learning Andriy Mulyar Bridget T. McInnes 16 52 0 21 Apr 2020
Train No Evil: Selective Masking for Task-Guided Pre-Training Yuxian Gu Zhengyan Zhang Xiaozhi Wang Zhiyuan Liu Maosong Sun 32 59 0 21 Apr 2020
CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERT Akshay Smit Saahil Jain Pranav Rajpurkar Anuj Pareek A. Ng M. Lungren MedIm 6 317 0 20 Apr 2020
Enhancing Pharmacovigilance with Drug Reviews and Social Media Brent Biseda K. Mo 14 11 0 18 Apr 2020
Augmented Curation of Unstructured Clinical Notes from a Massive EHR System Reveals Specific Phenotypic Signature of Impending COVID-19 Diagnosis F. Shweta K. Murugadoss S. Awasthi A. Venkatakrishnan Arjun Puranik ... G. Gores A. Williams J. Halamka V. Soundararajan A. Badley 8 26 0 17 Apr 2020
Robustly Pre-trained Neural Model for Direct Temporal Relation Extraction Hong Guan Jianfu Li Hua Xu M. Devarakonda 12 10 0 13 Apr 2020
Annotating Social Determinants of Health Using Active Learning, and Characterizing Determinants Using Neural Event Extraction K. Lybarger Mari Ostendorf Meliha Yetisgen 18 68 0 11 Apr 2020
CALM: Continuous Adaptive Learning for Language Modeling Kristjan Arumae Parminder Bhatia CLL KELM 27 6 0 08 Apr 2020
Inexpensive Domain Adaptation of Pretrained Language Models: Case Studies on Biomedical NER and Covid-19 QA Nina Poerner Ulli Waltinger Hinrich Schütze OOD 6 49 0 07 Apr 2020
Continual Domain-Tuning for Pretrained Language Models Subendhu Rongali Abhyuday N. Jagannatha Bhanu Pratap Singh Rawat Hong-ye Yu CLL KELM 8 7 0 05 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,452 0 18 Mar 2020
Hurtful Words: Quantifying Biases in Clinical Contextual Word Embeddings H. Zhang Amy X. Lu Mohamed Abdalla Matthew B. A. McDermott Marzyeh Ghassemi 10 171 0 11 Mar 2020
Med7: a transferable clinical natural language processing model for electronic health records Andrey Kormilitzin N. Vaci Qiang Liu A. Nevado-Holgado 22 115 0 03 Mar 2020
Federated pretraining and fine tuning of BERT using clinical notes from multiple silos Dianbo Liu Timothy A. Miller AI4MH 38 34 0 20 Feb 2020
Automated Labelling using an Attention model for Radiology reports of MRI scans (ALARM) D. Wood J. Lynch S. Kafiabadi Emily Guilhem A. A. Busaidi ... Keena Patel Gareth J. Barker S. Ourselin James H. Cole Thomas C Booth MedIm 20 42 0 16 Feb 2020
Application of Pre-training Models in Named Entity Recognition Yu Wang Yining Sun Zuchang Ma Lisheng Gao Yang Xu Ting Sun 18 20 0 09 Feb 2020
UNCC Biomedical Semantic Question Answering Systems. BioASQ: Task-7B, Phase-B Sai Krishna Telukuntla Aditya Kapri Wlodek Zadrozny 6 9 0 05 Feb 2020
MT-BioNER: Multi-task Learning for Biomedical Named Entity Recognition using Deep Bidirectional Transformers Muhammad Raza Khan Morteza Ziyadi M. Abdelhady MedIm 12 44 0 24 Jan 2020
Clinical XLNet: Modeling Sequential Clinical Notes and Predicting Prolonged Mechanical Ventilation Kexin Huang Abhishek Singh Sitong Chen E. Moseley Chih-ying Deng Naomi George C. Lindvall 59 57 0 27 Dec 2019
Medication Regimen Extraction From Medical Conversations Sai P. Selvaraj Sandeep Konam MedIm 11 18 0 10 Dec 2019
Self-Supervised Contextual Language Representation of Radiology Reports to Improve the Identification of Communication Urgency Xing Meng C. Ganoe R. Sieberg Yvonne Y. Cheung Saeid Hassanpour MedIm 11 12 0 05 Dec 2019
EduBERT: Pretrained Deep Language Models for Learning Analytics Benjamin Clavié K. Gal 6 15 0 02 Dec 2019
Factorized Multimodal Transformer for Multimodal Sequential Learning Amir Zadeh Chengfeng Mao Kelly Shi Yiwei Zhang Paul Pu Liang Soujanya Poria Louis-Philippe Morency 25 43 0 22 Nov 2019
Evaluating robustness of language models for chief complaint extraction from patient-generated text Ilya Valmianski Caleb Goodwin Ian M. Finn Naqi Khan D. Zisook 24 6 0 15 Nov 2019
Adapting and evaluating a deep learning language model for clinical why-question answering Andrew Wen Mohamed Y. Elwazir Sungrim Moon Jungwei Fan LM&MA 16 31 0 13 Nov 2019
Phenotyping of Clinical Notes with Improved Document Classification Models Using Contextualized Neural Language Models Andriy Mulyar Elliot Schumacher Masoud Rouhizadeh Mark Dredze 19 39 0 30 Oct 2019
Clinical Concept Extraction: a Methodology Review S. Fu David C. Chen Huan He Sijia Liu Sungrim Moon ... Yanshan Wang Andrew Wen Yiqing Zhao S. Sohn Hongfang Liu 17 3 0 24 Oct 2019
Progress Notes Classification and Keyword Extraction using Attention-based Deep Learning Models with BERT Matthew Tang P. Gandhi Md. Ahsanul Kabir C. Zou J. Blakey Xiao Luo 30 38 0 13 Oct 2019
Extracting UMLS Concepts from Medical Text Using General and Domain-Specific Deep Learning Models Sicong Tang Feitong Tan Berry de Bruijn Muqun Li A. LaPlante P. Tan 19 13 0 03 Oct 2019
Representation Learning for Electronic Health Records W. Weng Peter Szolovits 33 19 0 19 Sep 2019
Pre-trained Language Model for Biomedical Question Answering Wonjin Yoon Jinhyuk Lee Donghyeon Kim Minbyul Jeong Jaewoo Kang AI4MH 11 85 0 18 Sep 2019
HARE: a Flexible Highlighting Annotator for Ranking and Exploration Denis R. Newman-Griffis Eric Fosler-Lussier 12 11 0 29 Aug 2019
TAPER: Time-Aware Patient EHR Representation Sajad Darabi Mohammad Kachuee Shayan Fazeli Majid Sarrafzadeh 27 56 0 11 Aug 2019
BERT-based Ranking for Biomedical Entity Normalization Zongcheng Ji Qiang Wei Hua Xu OOD MedIm 22 121 0 09 Aug 2019
UW-BHI at MEDIQA 2019: An Analysis of Representation Methods for Medical Natural Language Inference William R. Kearns Wilson Lau Jason Thomas 13 3 0 09 Jul 2019
REflex: Flexible Framework for Relation Extraction in Multiple Domains Geeticka Chauhan Matthew B. A. McDermott Peter Szolovits 11 13 0 19 Jun 2019
Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets Yifan Peng Shankai Yan Zhiyong Lu LM&MA AI4MH 15 830 0 13 Jun 2019