v1v2v3v4 (latest)

Pre-trained Language Models in Biomedical Domain: A Systematic Survey

11 October 2021

Papers citing "Pre-trained Language Models in Biomedical Domain: A Systematic Survey"

50 / 223 papers shown

Title
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 147 854 0 14 Jun 2021
SciFive: a text-to-text transformer model for biomedical literature Long Phan J. Anibal H. Tran Shaurya Chanana Erol Bahadroglu Alec Peltekian G. Altan-Bonnet MedIm 49 151 0 28 May 2021
True Few-Shot Learning with Language Models Ethan Perez Douwe Kiela Kyunghyun Cho 137 439 0 24 May 2021
Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Training Jong Hak Moon HyunGyung Lee W. Shin Young-Hak Kim Edward Choi MedIm 76 160 0 24 May 2021
Semi-Supervised Variational Reasoning for Medical Dialogue Generation Dongdong Li Zhaochun Ren Pengjie Ren Zhumin Chen M. Fan Jun Ma Maarten de Rijke BDL DRL OffRL MedIm 88 50 0 13 May 2021
Improving BERT Model Using Contrastive Learning for Biomedical Relation Extraction P. Su Yifan Peng K. Vijay-Shanker SSL 52 36 0 28 Apr 2021
Improving Biomedical Pretrained Language Models with Knowledge Zheng Yuan Yijia Liu Chuanqi Tan Songfang Huang Fei Huang 58 92 0 21 Apr 2021
Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020 Ryan Turner David Eriksson M. McCourt J. Kiili Eero Laaksonen Zhen Xu Isabelle M Guyon BDL 63 302 0 20 Apr 2021
ELECTRAMed: a new pre-trained language representation model for biomedical NLP Giacomo Miolo Giulio Mantoan C. Orsenigo 121 24 0 19 Apr 2021
AMMU : A Survey of Transformer-based Biomedical Pretrained Language Models Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha LM&MA MedIm 93 170 0 16 Apr 2021
Does BERT Pretrained on Clinical Notes Reveal Sensitive Data? Eric P. Lehman Sarthak Jain Karl Pichotta Yoav Goldberg Byron C. Wallace OOD MIACV 66 121 0 15 Apr 2021
Sequence tagging for biomedical extractive question answering Wonjin Yoon Richard Jackson Aron Lagerberg Jaewoo Kang MedIm 58 27 0 15 Apr 2021
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce Song Xu Haoran Li Peng Yuan Yujia Wang Youzheng Wu Xiaodong He Ying Liu Bowen Zhou KELM 65 24 0 14 Apr 2021
MS2: Multi-Document Summarization of Medical Studies Jay DeYoung Iz Beltagy Madeleine van Zuylen Bailey Kuehl Lucy Lu Wang 69 113 0 13 Apr 2021
Discourse Probing of Pretrained Language Models Fajri Koto Jey Han Lau Tim Baldwin 70 53 0 13 Apr 2021
Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays Xiaosong Wang Ziyue Xu Leo K. Tam Dong Yang Daguang Xu ViT MedIm 57 24 0 30 Mar 2021
Multimodal Representation Learning via Maximization of Local Mutual Information Ruizhi Liao Daniel Moyer Miriam Cha Keegan Quigley Seth Berkowitz Steven Horng Polina Golland W. Wells SSL 64 42 0 08 Mar 2021
Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth Yihe Dong Jean-Baptiste Cordonnier Andreas Loukas 137 387 0 05 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 967 29,810 0 26 Feb 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 418 4,996 0 24 Feb 2021
A Cooperative Memory Network for Personalized Task-oriented Dialogue Systems with Incomplete User Profiles Jiahuan Pei Pengjie Ren Maarten de Rijke 49 24 0 16 Feb 2021
Unsupervised Extractive Summarization using Pointwise Mutual Information Vishakh Padmakumar He He 37 46 0 11 Feb 2021
Combining pre-trained language models and structured knowledge Pedro Colon-Hernandez Catherine Havasi Jason B. Alonso Matthew Huggins C. Breazeal KELM 70 48 0 28 Jan 2021
Transformer-Based Models for Question Answering on COVID19 Hillary Ngai Yoona Park John Chen Mahboobeh Parsapoor OOD 48 21 0 16 Jan 2021
BinaryBERT: Pushing the Limit of BERT Quantization Haoli Bai Wei Zhang Lu Hou Lifeng Shang Jing Jin Xin Jiang Qun Liu Michael Lyu Irwin King MQ 214 227 0 31 Dec 2020
Automated Lay Language Summarization of Biomedical Scientific Reviews Yue Guo Weijian Qiu Yizhong Wang T. Cohen 69 78 0 23 Dec 2020
Graph-Evolving Meta-Learning for Low-Resource Medical Dialogue Generation Shuai Lin Pan Zhou Xiaodan Liang Jianheng Tang Ruihui Zhao Ziliang Chen Liang Lin MedIm 77 55 0 22 Dec 2020
End-to-End QA on COVID-19: Domain Adaptation with Synthetic Training R. Reddy Bhavani Iyer Md Arafat Sultan Rong Zhang Avirup Sil Vittorio Castelli Radu Florian Salim Roukos OOD 54 19 0 02 Dec 2020
Profile Prediction: An Alignment-Based Pre-Training Task for Protein Sequence Models Pascal Sturmfels Jesse Vig Ali Madani Nazneen Rajani 59 25 0 01 Dec 2020
Experiments on transfer learning architectures for biomedical relation extraction Walid Hafiane Joël Legrand Y. Toussaint Adrien Coulet 16 6 0 24 Nov 2020
Medical Knowledge-enriched Textual Entailment Framework S. Yadav Vishal Pallagani A. Sheth AI4MH 11 8 0 10 Nov 2020
CODER: Knowledge infused cross-lingual medical term embedding for term normalization Zheng Yuan Zhengyun Zhao Haixia Sun Jiao Li Fei Wang Sheng Yu MedIm 63 97 0 05 Nov 2020
Investigation of BERT Model on Biomedical Relation Extraction Based on Revised Fine-tuning Mechanism P. Su K. Vijay-Shanker 53 20 0 01 Nov 2020
UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesaurus George Michalopoulos Yuanxin Wang H. Kaka Helen H. Chen Alexander Wong 72 125 0 20 Oct 2020
BioMegatron: Larger Biomedical Domain Language Model Hoo-Chang Shin Yang Zhang Evelina Bakhturina Raul Puri M. Patwary Mohammad Shoeybi Raghav Mani AI4CE 63 148 0 12 Oct 2020
MedICaT: A Dataset of Medical Images, Captions, and Textual References Sanjay Subramanian Lucy Lu Wang Sachin Mehta Ben Bogin Madeleine van Zuylen Sravanthi Parasa Sameer Singh Matt Gardner Hannaneh Hajishirzi MedIm 48 74 0 12 Oct 2020
Multi-Stage Pre-training for Low-Resource Domain Adaptation Rong Zhang Revanth Reddy Gangi Reddy Md Arafat Sultan Vittorio Castelli Anthony Ferritto Radu Florian Efsun Sarioglu Kayi Salim Roukos Avirup Sil T. Ward 48 44 0 12 Oct 2020
Probing Pretrained Language Models for Lexical Semantics Ivan Vulić Edoardo Ponti Robert Litschko Goran Glavaš Anna Korhonen KELM 74 246 0 12 Oct 2020
What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding Yu-An Wang Yun-Nung Chen SSL 53 95 0 10 Oct 2020
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition Yun He Ziwei Zhu Yin Zhang Qin Chen James Caverlee AI4MH 87 108 0 08 Oct 2020
COMETA: A Corpus for Medical Entity Linking in the Social Media Marco Basaldella Fangyu Liu Ehsan Shareghi Nigel Collier 55 86 0 07 Oct 2020
Contrastive Learning of Medical Visual Representations from Paired Images and Text Yuhao Zhang Hang Jiang Yasuhide Miura Christopher D. Manning C. Langlotz MedIm 147 766 0 02 Oct 2020
Unsupervised Pre-training for Biomedical Question Answering Vaishnavi Kommaraju K. Gunasekaran Kun Li Trapit Bansal Andrew McCallum Ivana Williams Ana-Maria Istrate SSL MedIm 39 18 0 27 Sep 2020
TernaryBERT: Distillation-aware Ultra-low Bit BERT Wei Zhang Lu Hou Yichun Yin Lifeng Shang Xiao Chen Xin Jiang Qun Liu MQ 93 211 0 27 Sep 2020
BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition Usman Naseem Matloob Khushi V. Reddy S. Rajendran Imran Razzak Jinman Kim 58 63 0 19 Sep 2020
Efficient Transformers: A Survey Yi Tay Mostafa Dehghani Dara Bahri Donald Metzler VLM 160 1,125 0 14 Sep 2020
Biomedical named entity recognition using BERT in the machine reading comprehension framework Cong Sun Zhihao Yang Lei Wang Yin Zhang Hongfei Lin Jian Wang 82 96 0 03 Sep 2020
A Comparison of Pre-trained Vision-and-Language Models for Multimodal Representation Learning across Medical Images and Reports Yikuan Li Hanyin Wang Yuan Luo 48 66 0 03 Sep 2020
Generating (Factual?) Narrative Summaries of RCTs: Experiments with Neural Multi-Document Summarization Byron C. Wallace Sayantani Saha Frank Soboczenski Iain J. Marshall HILM 50 79 0 25 Aug 2020
Conceptualized Representation Learning for Chinese Biomedical Text Mining Ningyu Zhang Qianghuai Jia Kangping Yin Liang Dong Feng Gao Nengwei Hua OOD 71 66 0 25 Aug 2020