Publicly Available Clinical BERT Embeddings

6 April 2019

Matthew B. A. McDermott

AI4MH

ArXiv PDF HTML

Papers citing "Publicly Available Clinical BERT Embeddings"

50 / 806 papers shown

Title
TweetBERT: A Pretrained Language Representation Model for Twitter Text Analysis Mohiuddin Md Abdul Qudar Vijay K. Mago SSeg 28 35 0 17 Oct 2020
Medical Code Assignment with Gated Convolution and Note-Code Interaction Shaoxiong Ji Shirui Pan Pekka Marttinen MedIm 30 18 0 14 Oct 2020
BioMegatron: Larger Biomedical Domain Language Model Hoo-Chang Shin Yang Zhang Evelina Bakhturina Raul Puri M. Patwary M. Shoeybi Raghav Mani AI4CE 21 144 0 12 Oct 2020
Multi-Stage Pre-training for Low-Resource Domain Adaptation Rong Zhang Revanth Reddy Gangi Reddy Md Arafat Sultan Vittorio Castelli Anthony Ferritto Radu Florian Efsun Sarioglu Kayi Salim Roukos Avirup Sil T. Ward 16 42 0 12 Oct 2020
Extracting Angina Symptoms from Clinical Notes Using Pre-Trained Transformer Architectures A. Eisman Nishant R. Shah Carsten Eickhoff George Zerveas Elizabeth S. Chen Wen‐Chih Wu I. Sarkar 11 7 0 12 Oct 2020
PHICON: Improving Generalization of Clinical Text De-identification Models via Data Augmentation Xiang Yue Shuang Zhou 17 10 0 11 Oct 2020
Information Extraction from Swedish Medical Prescriptions with Sig-Transformer Encoder John N. Pougue Biyong Bo Wang Terry Lyons A. Nevado-Holgado MedIm 21 4 0 10 Oct 2020
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition Yun He Ziwei Zhu Yin Zhang Qin Chen James Caverlee AI4MH 33 108 0 08 Oct 2020
Characterizing the Value of Information in Medical Notes Chao-Chun Hsu Shantanu Karnwal S. Mullainathan Ziad Obermeyer Chenhao Tan 10 19 0 07 Oct 2020
COMETA: A Corpus for Medical Entity Linking in the Social Media Marco Basaldella Fangyu Liu Ehsan Shareghi Nigel Collier 16 86 0 07 Oct 2020
LEGAL-BERT: The Muppets straight out of Law School Ilias Chalkidis Manos Fergadiotis Prodromos Malakasiotis Nikolaos Aletras Ion Androutsopoulos AILaw 6 255 0 06 Oct 2020
MedFilter: Improving Extraction of Task-relevant Utterances from Doctor-Patient Conversations through Integration of Discourse Structure and Ontological Knowledge Sopan Khosla Shikhar Vashishth J. Lehman Carolyn Rose MedIm 19 2 0 05 Oct 2020
Effective Unsupervised Domain Adaptation with Adversarially Trained Language Models Thuy-Trang Vu Dinh Q. Phung Gholamreza Haffari 16 24 0 05 Oct 2020
An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot Labels Ilias Chalkidis Manos Fergadiotis Sotiris Kotitsas Prodromos Malakasiotis Nikolaos Aletras Ion Androutsopoulos VLM AI4TS 25 84 0 04 Oct 2020
Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkit Z. Kraljevic Thomas Searle Anthony Shek Lukasz Roguski Kawsar Noor ... A. Shah W. K. Wong Zina M. Ibrahim J. Teo Richard J. B. Dobson AI4MH 33 162 0 02 Oct 2020
Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media Xiang Dai Sarvnaz Karimi Ben Hachey Cécile Paris 16 35 0 02 Oct 2020
Contrastive Learning of Medical Visual Representations from Paired Images and Text Yuhao Zhang Hang Jiang Yasuhide Miura Christopher D. Manning C. Langlotz MedIm 61 731 0 02 Oct 2020
An Empirical Investigation Towards Efficient Multi-Domain Language Model Pre-training Kristjan Arumae Q. Sun Parminder Bhatia 11 14 0 01 Oct 2020
Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank Ethan C. Chau Lucy H. Lin Noah A. Smith 19 15 0 29 Sep 2020
Zero-Shot Clinical Acronym Expansion via Latent Meaning Cells Griffin Adams Mert Ketenci Shreyas Bhave A. Perotte Noémie Elhadad BDL 12 0 0 29 Sep 2020
What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams Di Jin Eileen Pan Nassim Oufattole W. Weng Hanyi Fang Peter Szolovits FaML ELM LM&MA 31 706 0 28 Sep 2020
Unsupervised Pre-training for Biomedical Question Answering Vaishnavi Kommaraju K. Gunasekaran Kun Li Trapit Bansal Andrew McCallum Ivana Williams Ana-Maria Istrate SSL MedIm 16 18 0 27 Sep 2020
Feature Adaptation of Pre-Trained Language Models across Languages and Domains with Robust Self-Training Hai Ye Qingyu Tan Ruidan He Juntao Li Hwee Tou Ng Lidong Bing VLM 14 7 0 24 Sep 2020
AnchiBERT: A Pre-Trained Model for Ancient ChineseLanguage Understanding and Generation Huishuang Tian Kexin Yang Dayiheng Liu Jiancheng Lv 33 31 0 24 Sep 2020
Deep Learning Approaches for Extracting Adverse Events and Indications of Dietary Supplements from Clinical Text Yadan Fan Sicheng Zhou Yifan Li Rui Zhang 18 18 0 16 Sep 2020
Patient Cohort Retrieval using Transformer Language Models Sarvesh Soni Kirk Roberts 12 9 0 10 Sep 2020
Biomedical named entity recognition using BERT in the machine reading comprehension framework Cong Sun Zhihao Yang Lei Wang Yin Zhang Hongfei Lin Jian Wang 15 93 0 03 Sep 2020
A Comparison of Pre-trained Vision-and-Language Models for Multimodal Representation Learning across Medical Images and Reports Yikuan Li Hanyin Wang Yuan Luo 19 63 0 03 Sep 2020
Automatic Assignment of Radiology Examination Protocols Using Pre-trained Language Models with Knowledge Distillation Wilson Lau Laura Aaltonen Martin Gunn Meliha Yetisgen-Yildiz 6 5 0 01 Sep 2020
Intimate Partner Violence and Injury Prediction From Radiology Reports Irene Y. Chen Emily Alsentzer Hyesun Park Richard Thomas B. Gosangi Rahul Gujrathi B. Khurana 6 21 0 28 Aug 2020
GREEK-BERT: The Greeks visiting Sesame Street John Koutsikakis Ilias Chalkidis Prodromos Malakasiotis Ion Androutsopoulos 16 89 0 27 Aug 2020
Prediction of ICD Codes with Clinical BERT Embeddings and Text Augmentation with Label Balancing using MIMIC-III Brent Biseda Gaurav Desai Haifeng Lin A. Philip 9 13 0 24 Aug 2020
Adapting Event Extractors to Medical Data: Bridging the Covariate Shift Aakanksha Naik J. Lehman Carolyn Rose OOD 14 3 0 21 Aug 2020
Ontology-driven weak supervision for clinical entity classification in electronic health records Jason Alan Fries E. Steinberg S. Khattar Scott L. Fleming J. Posada A. Callahan N. Shah 21 72 0 05 Aug 2020
Cross-Global Attention Graph Kernel Network Prediction of Drug Prescription Hao-Ren Yao D. Chang O. Frieder Wendy Huang I. Liang C. Hung GNN 21 4 0 04 Aug 2020
Paying Per-label Attention for Multi-label Extraction from Radiology Reports Patrick Schrempf Hannah I. Watson Shadia S. Mikhael Maciej Pajak Matús Falis Aneta Lisowska K. Muir David Harris-Birtill Alison Q. OÑeil 9 8 0 31 Jul 2020
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing Yu Gu Robert Tinn Hao Cheng Michael R. Lucas Naoto Usuyama Xiaodong Liu Tristan Naumann Jianfeng Gao Hoifung Poon LM&MA AI4CE 14 1,711 0 31 Jul 2020
Dynamically Extracting Outcome-Specific Problem Lists from Clinical Notes with Guided Multi-Headed Attention Justin Lovelace N. Hurley A. Haimovich B. Mortazavi 12 4 0 25 Jul 2020
Towards Debiasing Sentence Representations Paul Pu Liang Irene Z Li Emily Zheng Y. Lim Ruslan Salakhutdinov Louis-Philippe Morency 18 230 0 16 Jul 2020
Extracting Structured Data from Physician-Patient Conversations By Predicting Noteworthy Utterances Kundan Krishna Amy Pavel Benjamin Schloss Jeffrey P. Bigham Zachary Chase Lipton 24 17 0 14 Jul 2020
COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation Qingyun Wang Manling Li Xuan Wang Nikolaus Nova Parulian G. Han ... Ahmed Elsayed Martha Palmer Clare Voss Cynthia Schneider Boyan A. Onyshkevych 21 118 0 01 Jul 2020
Transferability of Natural Language Inference to Biomedical Question Answering Minbyul Jeong Mujeen Sung Gangwoo Kim Donghyeon Kim Wonjin Yoon J. Yoo Jaewoo Kang 19 38 0 01 Jul 2020
CheXpert++: Approximating the CheXpert labeler for Speed,Differentiability, and Probabilistic Output Matthew B. A. McDermott T. Hsu W. Weng Marzyeh Ghassemi U. Toronto 26 31 0 26 Jun 2020
Benchmark and Best Practices for Biomedical Knowledge Graph Embeddings David Chang Ivana Balazevic Carl Allen Daniel Chawla C. Brandt R. Taylor 14 40 0 24 Jun 2020
A Deep Learning Pipeline for Patient Diagnosis Prediction Using Electronic Health Records Leopold Franz Yash Raj Shrestha B. Paudel OOD 23 25 0 23 Jun 2020
Towards User Friendly Medication Mapping Using Entity-Boosted Two-Tower Neural Network Shaoqing Yuan Parminder Bhatia B. Celikkaya Haiyang Liu Kyunghwan Choi 15 1 0 17 Jun 2020
COMPOSE: Cross-Modal Pseudo-Siamese Network for Patient Trial Matching Junyi Gao Cao Xiao Lucas Glass Jimeng Sun 20 64 0 15 Jun 2020
FinBERT: A Pretrained Language Model for Financial Communications Yi Yang Mark Christopher Siy Uy Allen H Huang AIFin AI4CE 20 230 0 15 Jun 2020
Extensive Error Analysis and a Learning-Based Evaluation of Medical Entity Recognition Systems to Approximate User Experience I. Nejadgholi Kathleen C. Fraser Berry de Bruijn 17 14 0 09 Jun 2020
The SOFC-Exp Corpus and Neural Approaches to Information Extraction in the Materials Science Domain Annemarie Friedrich Heike Adel F. Tomazic Johannes Hingerl Renou Benteau Anika Maruscyk Lukas Lange 24 71 0 04 Jun 2020