Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

31 July 2020

Xiaodong Liu

Papers citing "Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing"

50 / 243 papers shown

Title
Exploring New Frontiers in Agricultural NLP: Investigating the Potential of Large Language Models for Food Applications Saed Rezayi Zheng Liu Zihao Wu Chandra Dhakal Bao Ge ... Gengchen Mai Ninghao Liu Chen Zhen Tianming Liu Sheng Li 28 32 0 20 Jun 2023
Class-Adaptive Self-Training for Relation Extraction with Incompletely Annotated Training Data Qingyu Tan Lu Xu Lidong Bing Hwee Tou Ng 18 4 0 16 Jun 2023
Extensive Evaluation of Transformer-based Architectures for Adverse Drug Events Extraction Simone Scaboro Beatrice Portelli Emmanuele Chersoni Enrico Santus Giuseppe Serra 24 8 0 08 Jun 2023
Multilingual Clinical NER: Translation or Cross-lingual Transfer? X. Fontaine Félix Gaschi Parisa Rastin Y. Toussaint 40 8 0 07 Jun 2023
Leveraging Knowledge Graph Embeddings to Enhance Contextual Representations for Relation Extraction F. Laleye Loïc Rakotoson S. Massip 21 1 0 07 Jun 2023
RadLing: Towards Efficient Radiology Report Understanding Rikhiya Ghosh Sanjeev Kumar Karn Manuela Danu Larisa Micu Ramya Vunikili Oladimeji Farri MedIm 29 6 0 04 Jun 2023
Understanding Breast Cancer Survival: Using Causality and Language Models on Multi-omics Data Mugariya Farooq Shahad Hardan Aigerim Zhumbhayeva Yu Zheng Preslav Nakov Kun Zhang CML 22 1 0 28 May 2023
Complementary and Integrative Health Lexicon (CIHLex) and Entity Recognition in the Literature Huixue Zhou R. Austin Sheng-Chieh Lu Greg M. Silverman Yuqi Zhou H. Kilicoglu Huan Xu Rui Zhang 195 1 0 27 May 2023
Large Language Models are Few-Shot Health Learners Xin Liu Daniel J. McDuff G. Kovács I. Galatzer-Levy Jacob Sunshine Jiening Zhan M. Poh Shun Liao P. Achille Shwetak N. Patel LM&MA AI4MH 39 103 0 24 May 2023
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding Yu Zhang Hao Cheng Zhihong Shen Xiaodong Liu Yejiang Wang Jianfeng Gao 32 14 0 23 May 2023
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables Xinyuan Lu Liangming Pan Qian Liu Preslav Nakov Min-Yen Kan LMTD 46 25 0 22 May 2023
Enhancing Small Medical Learners with Privacy-preserving Contextual Prompting Xinlu Zhang Shiyang Li Xianjun Yang Chenxin Tian Yao Qin Linda R. Petzold 28 9 0 22 May 2023
Appraising the Potential Uses and Harms of LLMs for Medical Systematic Reviews Hye Sun Yun Iain J. Marshall T. Trikalinos Byron C. Wallace 26 17 0 19 May 2023
MatSci-NLP: Evaluating Scientific Language Models on Materials Science Language Tasks Using Text-to-Schema Modeling Yurun Song Santiago Miret Bang Liu 33 30 0 14 May 2023
Improving Small Language Models on PubMedQA via Generative Data Augmentation Zhen Guo Peiqi Wang Yanwei Wang Shangdi Yu LM&MA MedIm 18 10 0 12 May 2023
GersteinLab at MEDIQA-Chat 2023: Clinical Note Summarization from Doctor-Patient Conversations through Fine-tuning and In-context Learning Xiangru Tang Andrew Tran Jeffrey Tan Mark B. Gerstein 29 7 0 08 May 2023
From Zero to Hero: Harnessing Transformers for Biomedical Named Entity Recognition in Zero- and Few-shot Contexts Milos Kosprdic Nikola Prodanović Adela Ljajić Bojana Bašaragin Nikola Milosevic MedIm 23 5 0 05 May 2023
A Biomedical Entity Extraction Pipeline for Oncology Health Records in Portuguese Hugo Sousa Arian Pasquali A. Jorge Catarina Sousa Santos Mário Amorim Lopes 28 1 0 18 Apr 2023
AGI for Agriculture Guoyu Lu Sheng Li Gengchen Mai Jin Sun Dajiang Zhu ... R. Xu Daniel Petti Changying Li Tianming Liu Changying Li AI4CE 48 17 0 12 Apr 2023
FrenchMedMCQA: A French Multiple-Choice Question Answering Dataset for Medical domain Yanis Labrak Adrien Bazoge Richard Dufour Mickael Rouvier Emmanuel Morin B. Daille P. Gourraud 27 30 0 09 Apr 2023
End-to-End Models for Chemical-Protein Interaction Extraction: Better Tokenization and Span-Based Pipeline Strategies Xu-Xia Ai Ramakanth Kavuluru 27 5 0 03 Apr 2023
DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains Yanis Labrak Adrien Bazoge Richard Dufour Mickael Rouvier Emmanuel Morin B. Daille P. Gourraud LM&MA 25 54 0 03 Apr 2023
Evaluating Large Language Models on a Highly-specialized Topic, Radiation Oncology Physics J. Holmes Zheng Liu Lian-Cheng Zhang Yuzhen Ding Terence T. Sio ... Jonathan B. Ashman Xiang Li Tianming Liu Jiajian Shen Wen Liu LM&MA AI4CE ELM 30 120 0 01 Apr 2023
GPT-4 can pass the Korean National Licensing Examination for Korean Medicine Doctors Dongyeop Jang Tae-Rim Yun Choong-Yeol Lee Young-Kyu Kwon Chang-Eop Kim ELM LM&MA 35 26 0 31 Mar 2023
End-to-End $n$ -ary Relation Extraction for Combination Drug Therapies Yuhang Jiang Ramakanth Kavuluru 32 7 0 29 Mar 2023
Lay Text Summarisation Using Natural Language Processing: A Narrative Literature Review Oliver Vinzelberg M. Jenkins Gordon Morison David McMinn Z. Tieges 37 6 0 24 Mar 2023
Natural language processing to automatically extract the presence and severity of esophagitis in notes of patients undergoing radiotherapy Shan Chen Marco Guevara N. Ramirez Arpi Murray J. Warner Hugo J. W. L. Aerts Timothy A. Miller G. Savova Raymond H. Mak Danielle S. Bitterman 31 12 0 24 Mar 2023
ChatGPT for Shaping the Future of Dentistry: The Potential of Multi-Modal Large Language Model Hanyao Huang Ou Zheng Dongdong Wang Jiayi Yin Zijin Wang ... H. Yin Chuan Xu Renjie Yang Q. Zheng B. Shi MedIm AI4MH AI4CE LM&MA 58 176 0 23 Mar 2023
Preoperative Prognosis Assessment of Lumbar Spinal Surgery for Low Back Pain and Sciatica Patients based on Multimodalities and Multimodal Learning Lichin Chen Jung-Nien Lai Hung-En Lin Hsien-Te Chen Kuo-Hsuan Hung Yu Tsao AI4CE 18 0 0 16 Mar 2023
Applying unsupervised keyphrase methods on concepts extracted from discharge sheets Hoda Memarzadeh Nasser Ghadiri Matthias Samwald Maryam Lotfi Shahreza 44 0 0 15 Mar 2023
FactReranker: Fact-guided Reranker for Faithful Radiology Report Summarization Qianqian Xie Jiayu Zhou Yifan Peng Fei Wang HILM MedIm 42 10 0 15 Mar 2023
Generating multiple-choice questions for medical question answering with distractors and cue-masking Damien Sileo Kanimozhi Uma Marie-Francine Moens 43 5 0 13 Mar 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 35 42 0 10 Mar 2023
Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Images Xiaoman Zhang Chaoyi Wu Ya Zhang Yanfeng Wang Weidi Xie MedIm 46 121 0 27 Feb 2023
Informing clinical assessment by contextualizing post-hoc explanations of risk prediction models in type-2 diabetes Shruthi Chari Prasanth Acharya Daniel Gruen Olivia R. Zhang Elif Eyigoz ... Oshani Seneviratne Fernando Jose Suarez Saiz Pablo Meyer Prithwish Chakraborty D. McGuinness 32 17 0 11 Feb 2023
Bioformer: an efficient transformer language model for biomedical text mining Li Fang Qingyu Chen Chih-Hsuan Wei Zhiyong Lu Kai Wang MedIm AI4CE 32 18 0 03 Feb 2023
ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Texts Minghao Xu Xinyu Yuan Santiago Miret Jian Tang AI4TS 32 95 0 28 Jan 2023
Context Matters: A Strategy to Pre-train Language Model for Science Education Zhengliang Liu Xinyue He Lei Liu Tianming Liu Xiaoming Zhai 14 40 0 27 Jan 2023
Knowledge-augmented Graph Neural Networks with Concept-aware Attention for Adverse Drug Event Detection Shaoxiong Ji Ya Gao Pekka Marttinen GNN 19 3 0 25 Jan 2023
An Experimental Study on Pretraining Transformers from Scratch for IR Carlos Lassance Hervé Déjean S. Clinchant 28 11 0 25 Jan 2023
Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing Shruthi Bannur Stephanie L. Hyland Qianchu Liu Fernando Pérez-García Maximilian Ilse ... Maria T. A. Wetscherek M. Lungren A. Nori Javier Alvarez-Valle Ozan Oktay 36 115 0 11 Jan 2023
Continual Contrastive Finetuning Improves Low-Resource Relation Extraction Wenxuan Zhou Sheng Zhang Tristan Naumann Muhao Chen Hoifung Poon 54 6 0 21 Dec 2022
Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search Shuai Wang Harrisen Scells Bevan Koopman Guido Zuccon 30 24 0 18 Dec 2022
Automated ICD Coding using Extreme Multi-label Long Text Transformer-based Models Leibo Liu O. Perez-Concha Anthony N. Nguyen Vicki Bennett Louisa R Jorm 40 18 0 12 Dec 2022
Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Survey Yuxin Wang Jieru Lin Zhiwei Yu Wei Hu Börje F. Karlsson 20 17 0 09 Dec 2022
Intermediate Entity-based Sparse Interpretable Representation Learning Diego Garcia-Olano Yasumasa Onoe Joydeep Ghosh Byron C. Wallace 19 2 0 03 Dec 2022
KGML-xDTD: A Knowledge Graph-based Machine Learning Framework for Drug Treatment Prediction and Mechanism Description Chunyu Ma Zhihan Zhou Han Liu D. Koslicki 21 16 0 30 Nov 2022
sEHR-CE: Language modelling of structured EHR data for efficient and generalizable patient cohort expansion Anna Munoz-Farre Harry Rose S. A. Cakiroglu 11 4 0 30 Nov 2022
AIONER: All-in-one scheme-based biomedical named entity recognition using deep learning Ling Luo Chih-Hsuan Wei Po-Ting Lai Robert Leaman Qingyu Chen Zhiyong Lu 25 29 0 30 Nov 2022
SPCXR: Self-supervised Pretraining using Chest X-rays Towards a Domain Specific Foundation Model Syed Muhammad Anwar Abhijeet Parida Sara Atito Muhammad Awais G. Nino Josef Kitler M. Linguraru ViT SSL OOD 29 6 0 23 Nov 2022