v1v2v3v4 (latest)

BioBERT: a pre-trained biomedical language representation model for biomedical text mining

25 January 2019

ArXiv (abs)PDF HTML Github (689★)

Papers citing "BioBERT: a pre-trained biomedical language representation model for biomedical text mining"

50 / 1,714 papers shown

Title
Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model Ming Zheng Dinghan Shen Yelong Shen Weizhu Chen Lin Xiao SSL 29 4 0 12 Oct 2020
Multi-Stage Pre-training for Low-Resource Domain Adaptation Rong Zhang Revanth Reddy Gangi Reddy Md Arafat Sultan Vittorio Castelli Anthony Ferritto Radu Florian Efsun Sarioglu Kayi Salim Roukos Avirup Sil T. Ward 61 44 0 12 Oct 2020
Extracting Angina Symptoms from Clinical Notes Using Pre-Trained Transformer Architectures A. Eisman Nishant R. Shah Carsten Eickhoff George Zerveas Elizabeth S. Chen Wen‐Chih Wu I. Sarkar 18 7 0 12 Oct 2020
Predicting Clinical Trial Results by Implicit Evidence Integration Qiao Jin Chuanqi Tan Mosha Chen Xiaozhong Liu Songfang Huang 66 10 0 12 Oct 2020
Information Extraction from Swedish Medical Prescriptions with Sig-Transformer Encoder John N. Pougue Biyong Bo Wang Terry Lyons A. Nevado-Holgado MedIm 52 4 0 10 Oct 2020
Artificial Intelligence (AI) in Action: Addressing the COVID-19 Pandemic with Natural Language Processing (NLP) Qingyu Chen Robert Leaman Alexis Allot Ling Luo Chih-Hsuan Wei Shankai Yan Zhiyong Lu 80 38 0 09 Oct 2020
On the importance of pre-training data volume for compact language models Vincent Micheli Martin d'Hoffschmidt Franccois Fleuret 67 42 0 08 Oct 2020
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition Yun He Ziwei Zhu Yin Zhang Qin Chen James Caverlee AI4MH 87 109 0 08 Oct 2020
A Self-supervised Approach for Semantic Indexing in the Context of COVID-19 Pandemic Nima Ebadi Peyman Najafirad OOD 37 2 0 07 Oct 2020
COMETA: A Corpus for Medical Entity Linking in the Social Media Marco Basaldella Fangyu Liu Ehsan Shareghi Nigel Collier 88 87 0 07 Oct 2020
Contrastive Cross-Modal Pre-Training: A General Strategy for Small Sample Medical Imaging G. Liang Connor Greenwell Yu Zhang Xiaoqin Wang Ramakanth Kavuluru Nathan Jacobs 84 22 0 06 Oct 2020
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation Minki Kang Moonsu Han Sung Ju Hwang OOD 73 18 0 06 Oct 2020
LEGAL-BERT: The Muppets straight out of Law School Ilias Chalkidis Manos Fergadiotis Prodromos Malakasiotis Nikolaos Aletras Ion Androutsopoulos AILaw 77 264 0 06 Oct 2020
PublishInCovid19 at WNUT 2020 Shared Task-1: Entity Recognition in Wet Lab Protocols using Structured Learning Ensemble and Contextualised Embeddings Janvijay Singh Anshul Wadhawan 34 4 0 05 Oct 2020
Effective Unsupervised Domain Adaptation with Adversarially Trained Language Models Thuy-Trang Vu Dinh Q. Phung Gholamreza Haffari 86 25 0 05 Oct 2020
Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media Xiang Dai Sarvnaz Karimi Ben Hachey Cécile Paris 67 35 0 02 Oct 2020
Data Transfer Approaches to Improve Seq-to-Seq Retrosynthesis Katsuhiko Ishiguro K. Ujihara R. Sawada Hirotaka Akita Masaaki Kotera 108 6 0 02 Oct 2020
An Empirical Investigation Towards Efficient Multi-Domain Language Model Pre-training Kristjan Arumae Q. Sun Parminder Bhatia 58 15 0 01 Oct 2020
Extracting Concepts for Precision Oncology from the Biomedical Literature N. Greenspan Yuqi Si Kirk Roberts 27 2 0 30 Sep 2020
Gender prediction using limited Twitter Data M. Burghoorn M. D. Boer S. Raaijmakers 18 1 0 29 Sep 2020
Zero-Shot Clinical Acronym Expansion via Latent Meaning Cells Griffin Adams Mert Ketenci Shreyas Bhave A. Perotte Noémie Elhadad BDL 29 0 0 29 Sep 2020
What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams Di Jin Eileen Pan Nassim Oufattole W. Weng Hanyi Fang Peter Szolovits FaML ELM LM&MA 132 815 0 28 Sep 2020
Unsupervised Pre-training for Biomedical Question Answering Vaishnavi Kommaraju K. Gunasekaran Kun Li Trapit Bansal Andrew McCallum Ivana Williams Ana-Maria Istrate SSL MedIm 50 18 0 27 Sep 2020
Machine Knowledge: Creation and Curation of Comprehensive Knowledge Bases Gerhard Weikum Luna Dong Simon Razniewski Fabian M. Suchanek 144 128 0 24 Sep 2020
Feature Adaptation of Pre-Trained Language Models across Languages and Domains with Robust Self-Training Hai Ye Qingyu Tan Ruidan He Juntao Li Hwee Tou Ng Lidong Bing VLM 68 7 0 24 Sep 2020
AnchiBERT: A Pre-Trained Model for Ancient ChineseLanguage Understanding and Generation Huishuang Tian Kexin Yang Dayiheng Liu Jiancheng Lv 67 31 0 24 Sep 2020
Global-to-Local Neural Networks for Document-Level Relation Extraction D. Wang Wei Hu E. Cao Weijian Sun NAI 90 121 0 22 Sep 2020
"When they say weed causes depression, but it's your fav antidepressant": Knowledge-aware Attention Framework for Relationship Extraction S. Yadav Usha Lokala Raminta Daniulaityte K. Thirunarayan Francois R. Lamy A. Sheth 36 17 0 21 Sep 2020
Assessing the Severity of Health States based on Social Media Posts S. Yadav Joy Prakash Sain A. Sheth Asif Ekbal S. Saha P. Bhattacharyya AI4MH 13 3 0 21 Sep 2020
BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition Usman Naseem Matloob Khushi V. Reddy S. Rajendran Imran Razzak Jinman Kim 58 63 0 19 Sep 2020
PhenoTagger: A Hybrid Method for Phenotype Concept Recognition using Human Phenotype Ontology Ling Luo Shankai Yan Po-Ting Lai Daniel Veltri Andrew J. Oler Sandhya Xirasagar R. Ghosh M. Similuk Peter N. Robinson Zhiyong Lu 30 46 0 17 Sep 2020
UPB at SemEval-2020 Task 11: Propaganda Detection with Domain-Specific Trained BERT Andrei Paraschiv Dumitru-Clementin Cercel M. Dascalu 38 17 0 11 Sep 2020
Patient Cohort Retrieval using Transformer Language Models Sarvesh Soni Kirk Roberts 46 9 0 10 Sep 2020
High-throughput relation extraction algorithm development associating knowledge articles and electronic health records Yucong Lin Keming Lu Yulin Chen C. Hong Sheng Yu 45 5 0 08 Sep 2020
E-BERT: A Phrase and Product Knowledge Enhanced Language Model for E-commerce Denghui Zhang Zixuan Yuan Yanchi Liu Fuzhen Zhuang Haifeng Chen Hui Xiong 81 34 0 07 Sep 2020
Vapur: A Search Engine to Find Related Protein-Compound Pairs in COVID-19 Literature Abdullatif Köksal Hilal Dönmez Rıza Özçelik Elif Özkirimli Arzucan Özgür 45 13 0 05 Sep 2020
Multi-Perspective Semantic Information Retrieval Samarth Rawal Chitta Baral 34 3 0 03 Sep 2020
Biomedical named entity recognition using BERT in the machine reading comprehension framework Cong Sun Zhihao Yang Lei Wang Yin Zhang Hongfei Lin Jian Wang 106 97 0 03 Sep 2020
Automatic Assignment of Radiology Examination Protocols Using Pre-trained Language Models with Knowledge Distillation Wilson Lau Laura Aaltonen Martin Gunn Meliha Yetisgen-Yildiz 27 5 0 01 Sep 2020
TATL at W-NUT 2020 Task 2: A Transformer-based Baseline System for Identification of Informative COVID-19 English Tweets A. Nguyen MedIm 34 2 0 28 Aug 2020
Intimate Partner Violence and Injury Prediction From Radiology Reports Irene Y. Chen Emily Alsentzer Hyesun Park Richard Thomas B. Gosangi Rahul Gujrathi B. Khurana 50 22 0 28 Aug 2020
Repurposing TREC-COVID Annotations to Answer the Key Questions of CORD-19 Connor T. Heaton P. Mitra 29 2 0 27 Aug 2020
Query Focused Multi-document Summarisation of Biomedical Texts Diego Mollá Aliod Christopher Jones Vincent Nguyen 147 12 0 27 Aug 2020
Multimodal Learning for Cardiovascular Risk Prediction using EHR Data A. Bagheri T. K. Groenhof W. B. Veldhuis P. A. Jong F. Asselbergs Daniel L. Oberski 65 15 0 27 Aug 2020
Conceptualized Representation Learning for Chinese Biomedical Text Mining Ningyu Zhang Qianghuai Jia Kangping Yin Liang Dong Feng Gao Nengwei Hua OOD 82 67 0 25 Aug 2020
Knowledge-Empowered Representation Learning for Chinese Medical Reading Comprehension: Task, Model and Resources Taolin Zhang Chengyu Wang Minghui Qiu Bite Yang Xiaofeng He Jun Huang 64 5 0 24 Aug 2020
Assigning function to protein-protein interactions: a weakly supervised BioBERT based approach using PubMed abstracts Aparna Elangovan Melissa J. Davis Karin Verspoor 33 8 0 20 Aug 2020
HunFlair: An Easy-to-Use Tool for State-of-the-Art Biomedical Named Entity Recognition Leon Weber Mario Sanger Jannes Munchmeyer Maryam Habibi Ulf Leser Alan Akbik 58 97 0 17 Aug 2020
Adding Recurrence to Pretrained Transformers for Improved Efficiency and Context Size Davis Yoshida Allyson Ettinger Kevin Gimpel AI4CE 42 7 0 16 Aug 2020
Prosody Learning Mechanism for Speech Synthesis System Without Text Length Limit Zhen Zeng Jianzong Wang Ning Cheng Jing Xiao 61 8 0 13 Aug 2020