Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease prediction

22 May 2020

Papers citing "Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease prediction"

50 / 209 papers shown

Title
Knowledge-Driven New Drug Recommendation Zhenbang Wu Huaxiu Yao Zhe Su David M. Liebovitz Lucas Glass James Zou Chelsea Finn Jimeng Sun 31 4 0 11 Oct 2022
KSAT: Knowledge-infused Self Attention Transformer -- Integrating Multiple Domain-Specific Contexts Kaushik Roy Yuxin Zi Vignesh Narayanan Manas Gaur Amit P. Sheth AI4MH 46 12 0 09 Oct 2022
KG-MTT-BERT: Knowledge Graph Enhanced BERT for Multi-Type Medical Text Classification Yong He Cheng Wang Shun Zhang Na Li Zhao Li Zhenyu Zeng AI4MH 44 10 0 08 Oct 2022
A Dual-Attention Learning Network with Word and Sentence Embedding for Medical Visual Question Answering Xiaofei Huang Hongfang Gong MedIm 66 12 0 01 Oct 2022
A Systematic Evaluation of Node Embedding Robustness Alexandru Mara Jefrey Lijffijt Stephan Günnemann T. D. Bie AAML 22 0 0 16 Sep 2022
Learning Clinical Concepts for Predicting Risk of Progression to Severe COVID-19 Helen Zhou Cheng Cheng K. Shields G. Kochhar T. Cheema Zachary Chase Lipton Jeremy C. Weiss 6 1 0 28 Aug 2022
A Multifaceted Benchmarking of Synthetic Electronic Health Record Generation Models Chao Yan Yao Yan Zhiyu Wan Ziqi Zhang L. Omberg J. Guinney S. Mooney B. Malin SyDa 34 65 0 02 Aug 2022
Debiasing Deep Chest X-Ray Classifiers using Intra- and Post-processing Methods Ricards Marcinkevics Ece Ozkan Julia E. Vogt 33 18 0 26 Jul 2022
Unsupervised pre-training of graph transformers on patient population graphs Chantal Pellegrini Nassir Navab Anees Kazi MedIm AI4CE 46 11 0 21 Jul 2022
GenHPF: General Healthcare Predictive Framework with Multi-task Multi-source Learning Kyunghoon Hur Jungwoo Oh Junu Kim Jiyoun Kim Min Jae Lee Eunbyeol Choi Seong-Eun Moon Young-Hak Kim Louis Atallah Edward Choi AI4TS 22 22 0 20 Jul 2022
FD-GATDR: A Federated-Decentralized-Learning Graph Attention Network for Doctor Recommendation Using EHR Luning Bi Yunlong Wang Fan Zhang Zhuqing Liu Yong Cai E. Zhao FedML 20 3 0 11 Jul 2022
GERNERMED++: Transfer Learning in German Medical NLP Johann Frei Ludwig Frei-Stuber Frank Kramer MedIm 41 8 0 29 Jun 2022
Multimodal Learning with Transformers: A Survey Peng Xu Xiatian Zhu David Clifton ViT 79 530 0 13 Jun 2022
SsciBERT: A Pre-trained Language Model for Social Science Texts Si Shen Jiang-fu Liu Litao Lin Ying Huang Lin Zhang Changting Liu Yu Feng Dongbo Wang 11 27 0 09 Jun 2022
Artificial intelligence for topic modelling in Hindu philosophy: mapping themes between the Upanishads and the Bhagavad Gita Rohitash Chandra Mukul Ranjan AI4CE 19 12 0 23 May 2022
Overcoming Language Disparity in Online Content Classification with Multimodal Learning Gaurav Verma Rohit Mujumdar Zijie J. Wang M. D. Choudhury Srijan Kumar 31 14 0 19 May 2022
Write It Like You See It: Detectable Differences in Clinical Notes By Race Lead To Differential Model Recommendations Hammaad Adam Ming Yang K. Cato Ioana Baldini C. Senteio Leo Anthony Celi J. Zeng Moninder Singh Marzyeh Ghassemi 24 34 0 08 May 2022
AKI-BERT: a Pre-trained Clinical Language Model for Early Prediction of Acute Kidney Injury Chengsheng Mao Liang Yao Yuan Luo 21 1 0 07 May 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 35 9 0 29 Apr 2022
CATNet: Cross-event Attention-based Time-aware Network for Medical Event Prediction Sicen Liu Xiaolong Wang Yang Xiang Huiqin Xu Hui Wang Buzhou Tang AI4TS 30 10 0 29 Apr 2022
RobBERTje: a Distilled Dutch BERT Model Pieter Delobelle Thomas Winters Bettina Berendt 30 14 0 28 Apr 2022
Unsupervised Pre-Training on Patient Population Graphs for Patient-Level Predictions Chantal Pellegrini Anees Kazi Nassir Navab 27 2 0 23 Mar 2022
Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representations Robert Wolfe Aylin Caliskan VLM 25 13 0 14 Mar 2022
AutoMap: Automatic Medical Code Mapping for Clinical Prediction Model Deployment Zhenbang Wu Cao Xiao Lucas Glass David M. Liebovitz Jimeng Sun 48 5 0 04 Mar 2022
BERT WEAVER: Using WEight AVERaging to enable lifelong learning for transformer-based models in biomedical semantic search engines Lisa Langnickel Alexander Schulz Barbara Hammer Juliane Fluck CLL MedIm 14 3 0 21 Feb 2022
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences Yikuan Li R. M. Wehbe F. Ahmad Hanyin Wang Yuan Luo VLM MedIm 150 86 0 27 Jan 2022
Multimodal data matters: language model pre-training over structured and unstructured electronic health records Sicen Liu Xiaolong Wang Yongshuai Hou Ge Li Hui Wang Huiqin Xu Yang Xiang Buzhou Tang 52 30 0 25 Jan 2022
Label Dependent Attention Model for Disease Risk Prediction Using Multimodal Electronic Health Records Shuai Niu Qing Yin Yunya Song Yike Guo Xian Yang 34 10 0 18 Jan 2022
Semantic and sentiment analysis of selected Bhagavad Gita translations using BERT-based language framework Rohitash Chandra Venkatesh Kulkarni 25 28 0 09 Jan 2022
What Do You See in this Patient? Behavioral Testing of Clinical NLP Models Betty van Aken S. Herrmann Alexander Loser 29 11 0 30 Nov 2021
RoBERTuito: a pre-trained language model for social media text in Spanish Juan Manuel Pérez D. Furman Laura Alonso Alemany Franco Luque 20 99 0 18 Nov 2021
CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction tasks Chao Pang Xinzhuo Jiang Krishna S. Kalluri M. Spotnitz Ruijun Chen A. Perotte Karthik Natarajan OOD 19 58 0 10 Nov 2021
Machine Learning Models Disclosure from Trusted Research Environments (TRE), Challenges and Opportunities Esma Mansouri-Benssassi Simon Rogers Jim Q. Smith F. Ritchie E. Jefferson 25 5 0 10 Nov 2021
Multi-Task Prediction of Clinical Outcomes in the Intensive Care Unit using Flexible Multimodal Transformers B. Shickel P. Tighe A. Bihorac Parisa Rashidi 30 5 0 09 Nov 2021
Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives Ziyi Liu Jiaqi Zhang Yongshuai Hou Xinran Zhang Ge Li Yang Xiang 19 14 0 09 Nov 2021
ClimateBert: A Pretrained Language Model for Climate-Related Text Nicolas Webersinke Mathias Kraus Jiabo Huang Markus Leippold AI4CE 37 131 0 22 Oct 2021
Natural Language Processing for Smart Healthcare Binggui Zhou Guanghua Yang Zheng Shi Shaodan Ma AI4MH LM&MA 35 112 0 19 Oct 2021
Pre-trained Language Models in Biomedical Domain: A Systematic Survey Benyou Wang Qianqian Xie Jiahuan Pei Zhihong Chen Prayag Tiwari Zhao Li Jie Fu LM&MA AI4CE 39 165 0 11 Oct 2021
GERNERMED -- An Open German Medical NER Model Johann Frei Frank Kramer 11 0 0 24 Sep 2021
SANSformers: Self-Supervised Forecasting in Electronic Health Records with Attention-Free Models Yogesh Kumar Alexander Ilin H. Salo S. Kulathinal M. Leinonen Pekka Marttinen AI4TS MedIm 28 0 0 31 Aug 2021
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha VLM LM&MA 31 261 0 12 Aug 2021
Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embedding Kyunghoon Hur Jiyoung Lee Jungwoo Oh Wesley Price Young-Hak Kim Edward Choi 43 17 0 08 Aug 2021
Transfer Learning in Electronic Health Records through Clinical Concept Embedding J. R. A. Solares Yajie Zhu A. Hassaine Shishir Rao Yikuan Li M. Mamouei D. Canoy K. Rahimi G. Salimi-Khorshidi 34 6 0 27 Jul 2021
MIPO: Mutual Integration of Patient Journey and Medical Ontology for Healthcare Representation Learning Xueping Peng Guodong Long Sen Wang Jing Jiang Allison Clarke Clement Schlegel Chen Zhang AI4TS 27 4 0 20 Jul 2021
Self-supervision for health insurance claims data: a Covid-19 use case Emilia Apostolova Fazle Karim G. Muscioni Anubhav Rana J. Clyman 16 0 0 19 Jul 2021
MedGPT: Medical Concept Prediction from Clinical Narratives Z. Kraljevic Anthony Shek D. Bean R. Bendayan J. Teo Richard J. B. Dobson LM&MA AI4TS MedIm 25 39 0 07 Jul 2021
Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Review Irene Z Li Jessica Pan Jeremy Goldwasser Neha Verma Wai Pan Wong ... Matthew Zhang David Chang R. Taylor H. Krumholz Dragomir R. Radev BDL 26 154 0 07 Jul 2021
Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records Yikuan Li M. Mamouei G. Salimi-Khorshidi Shishir Rao A. Hassaine D. Canoy Thomas Lukasiewicz K. Rahimi 29 76 0 21 Jun 2021
Medical Profile Model: Scientific and Practical Applications in Healthcare Pavel Blinov V. Kokh 15 1 0 21 Jun 2021
pysentimiento: A Python Toolkit for Opinion Mining and Social NLP tasks Juan Manuel Pérez Mariela Rajngewerc Juan Carlos Giudici D. Furman Franco Luque Laura Alonso Alemany María Vanina Martínez 23 30 0 17 Jun 2021