An Empirical Study of Multi-Task Learning on BERT for Biomedical Text Mining

6 May 2020

Papers citing "An Empirical Study of Multi-Task Learning on BERT for Biomedical Text Mining"

21 / 21 papers shown

Title
Forecasting from Clinical Textual Time Series: Adaptations of the Encoder and Decoder Language Model Families Shahriar Noroozizadeh Sayantan Kumar Jeremy C. Weiss AI4TS 55 1 0 14 Apr 2025
MT-BioNER: Multi-task Learning for Biomedical Named Entity Recognition using Deep Bidirectional Transformers Muhammad Raza Khan Morteza Ziyadi M. Abdelhady MedIm 40 44 0 24 Jan 2020
Fine-tuning BERT for Joint Entity and Relation Extraction in Chinese Medical Text Kui Xue Yangming Zhou Zhiyuan Ma Tong Ruan Huanhuan Zhang Ping He 52 90 0 21 Aug 2019
Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets Yifan Peng Shankai Yan Zhiyong Lu LM&MA AI4MH 53 843 0 13 Jun 2019
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding Xiaodong Liu Pengcheng He Weizhu Chen Jianfeng Gao FedML 45 182 0 20 Apr 2019
Publicly Available Clinical BERT Embeddings Emily Alsentzer John R. Murphy Willie Boag W. Weng Di Jin Tristan Naumann Matthew B. A. McDermott AI4MH 134 1,968 0 06 Apr 2019
Multi-Task Deep Neural Networks for Natural Language Understanding Xiaodong Liu Pengcheng He Weizhu Chen Jianfeng Gao AI4CE 121 1,270 0 31 Jan 2019
BioBERT: a pre-trained biomedical language representation model for biomedical text mining Jinhyuk Lee Wonjin Yoon Sungdong Kim Donghyeon Kim Sunkyu Kim Chan Ho So Jaewoo Kang OOD 140 5,628 0 25 Jan 2019
A Neural Multi-Task Learning Framework to Jointly Model Medical Named Entity Recognition and Normalization Sendong Zhao Ting Liu Sicheng Zhao Fei Wang MedIm 49 113 0 14 Dec 2018
A multi-task deep learning model for the classification of Age-related Macular Degeneration Qingyu Chen Yifan Peng T. Keenan S. Dharssi Elvira Agrón W. Wong E. Chew Zhiyong Lu BDL MedIm 44 45 0 02 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.5K 94,511 0 11 Oct 2018
Multi-Task Learning for Sequence Tagging: An Empirical Study Soravit Changpinyo Hexiang Hu Fei Sha 57 67 0 13 Aug 2018
End-to-End Multi-Task Learning with Attention Shikun Liu Edward Johns Andrew J. Davison CVBM 51 1,046 0 28 Mar 2018
Cross-type Biomedical Named Entity Recognition with Deep Multi-Task Learning Xuan Wang Yu Zhang Xiang Ren Yuhao Zhang Marinka Zitnik Jingbo Shang C. Langlotz Jiawei Han 43 251 0 30 Jan 2018
A Survey on Multi-Task Learning Yu Zhang Qiang Yang AIMat 535 2,217 0 25 Jul 2017
An Overview of Multi-Task Learning in Deep Neural Networks Sebastian Ruder CVBM 130 2,826 0 15 Jun 2017
Multitask learning and benchmarking with clinical time series data Hrayr Harutyunyan Hrant Khachatrian David C. Kale Greg Ver Steeg Aram Galstyan OOD AI4TS 161 874 0 22 Mar 2017
Identifying beneficial task relations for multi-task learning in deep neural networks Joachim Bingel Anders Søgaard 43 252 0 27 Feb 2017
When is multitask learning effective? Semantic sequence prediction under varying data conditions Héctor Martínez Alonso Barbara Plank 65 163 0 07 Dec 2016
Multi-task Sequence to Sequence Learning Minh-Thang Luong Quoc V. Le Ilya Sutskever Oriol Vinyals Lukasz Kaiser AIMat 101 807 0 19 Nov 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.5K 149,842 0 22 Dec 2014