Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

31 July 2020

Xiaodong Liu

Papers citing "Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing"

50 / 241 papers shown

Title
Unifying Segment Anything in Microscopy with Multimodal Large Language Model Manyu Li Ruian He Zixian Zhang Weimin Tan Bo Yan VLM 12 0 0 16 May 2025
Disentangling Reasoning and Knowledge in Medical Large Language Models Rahul Thapa Qingyang Wu Kevin Wu Harrison Zhang Angela Zhang ... Joseph Boen Shriya Reddy Ben Athiwaratkun Shuaiwen Leon Song James Zou ELM AI4MH LM&MA LRM 25 0 0 16 May 2025
HAMLET: Healthcare-focused Adaptive Multilingual Learning Embedding-based Topic Modeling Hajar Sakai Sarah Lam 34 0 0 12 May 2025
Multimodal Survival Modeling in the Age of Foundation Models Steven Song Morgan Borjigin-Wang Irene Madejski Robert L. Grossman 26 0 0 12 May 2025
HiPerRAG: High-Performance Retrieval Augmented Generation for Scientific Insights Ozan Gokdemir Carlo Siebenschuh Alexander Brace Azton Wells Brian Hsu ... A. Anandkumar Ian Foster R. Stevens V. Vishwanath A. Ramanathan VLM 37 0 0 07 May 2025
Knowledge-augmented Pre-trained Language Models for Biomedical Relation Extraction Mario Sanger Ulf Leser 52 0 0 01 May 2025
Revisiting the MIMIC-IV Benchmark: Experiments Using Language Models for Electronic Health Records Jesus Lovon Thouria Ben-Haddi Jules Di Scala José G. Moreno L. Tamine 60 2 0 29 Apr 2025
Multimodal Large Language Models for Medicine: A Comprehensive Survey Jiarui Ye Hao Tang LM&MA 91 0 0 29 Apr 2025
Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Report Paul Kassianik Baturay Saglam Alexander Chen Blaine Nelson Anu Vellore ... Hyrum Anderson Kojin Oshiba Omar Santos Yaron Singer Amin Karbasi PILM 66 1 0 28 Apr 2025
ConTextual: Improving Clinical Text Summarization in LLMs with Context-preserving Token Filtering and Knowledge Graphs Fahmida Liza Piya Rahmatollah Beheshti 136 0 0 23 Apr 2025
The Rise of Small Language Models in Healthcare: A Comprehensive Survey Muskan Garg Shaina Raza Shebuti Rayana Xingyi Liu Sunghwan Sohn LM&MA AILaw 92 0 0 23 Apr 2025
Forecasting from Clinical Textual Time Series: Adaptations of the Encoder and Decoder Language Model Families Shahriar Noroozizadeh Sayantan Kumar Jeremy C. Weiss AI4TS 33 0 0 14 Apr 2025
REMEMBER: Retrieval-based Explainable Multimodal Evidence-guided Modeling for Brain Evaluation and Reasoning in Zero- and Few-shot Neurodegenerative Diagnosis Duy-Cat Can Quang-Huy Tang Huong Ha Binh T. Nguyen Oliver Y. Chén 31 0 0 12 Apr 2025
GLiNER-BioMed: A Suite of Efficient Models for Open Biomedical Named Entity Recognition Anthony Yazdani Ihor Stepanov Douglas Teodoro VLM AI4CE 44 0 0 01 Apr 2025
Advancing Medical Representation Learning Through High-Quality Data Negin Baghbanzadeh Adibvafa Fallahpour Yasaman Parhizkar Franklin Ogidi Shuvendu Roy ... Vahid Reza Khazaie Michael Colacci Ali Etemad Arash Afkanpour Elham Dolatabadi LM&MA 88 0 0 18 Mar 2025
CURIE: Evaluating LLMs On Multitask Scientific Long Context Understanding and Reasoning Hao Cui Zahra Shamsi Gowoon Cheon Xuejian Ma Shutong Li ... Eun-Ah Kim M. Brenner Viren Jain Sameera Ponda Subhashini Venugopalan ELM LRM 57 0 0 14 Mar 2025
The Shape of Attraction in UMAP: Exploring the Embedding Forces in Dimensionality Reduction Mohammad Tariqul Islam Jason W. Fleischer 226 0 0 12 Mar 2025
Language-Enhanced Representation Learning for Single-Cell Transcriptomics Yaorui Shi Jiaqi Yang Sihang Li Junfeng Fang Qing Guo Zhiyuan Liu Yang Zhang Yang Zhang 214 0 0 12 Mar 2025
Multi-Modal Foundation Models for Computational Pathology: A Survey Dong Li Guihong Wan Xintao Wu Xinyu Wu Xiaohui Chen Yi He Christine G. Lian Peter K. Sorger Yevgeniy R. Semenov Chen Zhao MedIm 48 0 0 12 Mar 2025
Tokenization is Sensitive to Language Variation Anna Wegmann Dong Nguyen David Jurgens 84 1 0 24 Feb 2025
CL-MFAP: A Contrastive Learning-Based Multimodal Foundation Model for Molecular Property Prediction and Antibiotic Screening Gen Zhou Sugitha Janarthanan Yutong Lu Pingzhao Hu 49 0 0 16 Feb 2025
Assessing the Impact of the Quality of Textual Data on Feature Representation and Machine Learning Models Tabinda Sarwar Antonio Jose Jimeno Yepes Lawrence Cavedon 69 0 0 12 Feb 2025
Comply: Learning Sentences with Complex Weights inspired by Fruit Fly Olfaction Alexei Figueroa Justus Westerhoff Golzar Atefi Dennis Fast B. Winter Felix Alexader Gers Alexander Loser Wolfang Nejdl 57 0 0 03 Feb 2025
Fairness Analysis of CLIP-Based Foundation Models for X-Ray Image Classification Xiangyu Sun Xiaoguang Zou Yuanquan Wu Guotai Wang S. Zhang MedIm VLM 73 0 0 31 Jan 2025
A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics Kai He Rui Mao Qika Lin Yucheng Ruan Xiang Lan Mengling Feng Min Zhang LM&MA AILaw 104 155 0 28 Jan 2025
BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity Zahra Gharaee Scott C. Lowe ZeMing Gong Pablo Millán Arias Nicholas Pellegrino ... Lila Kari Dirk Steinke Graham W. Taylor Paul Fieguth Angel X. Chang 56 8 0 28 Jan 2025
Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models Ran Xu Hejie Cui Yue Yu Xuan Kan Wenqi Shi Yuchen Zhuang Wei Jin Joyce C. Ho Carl Yang 69 14 0 28 Jan 2025
Enhancing Biomedical Relation Extraction with Directionality Po-Ting Lai Chih-Hsuan Wei Shubo Tian Robert Leaman Zhiyong Lu 44 0 0 23 Jan 2025
Academic case reports lack diversity: Assessing the presence and diversity of sociodemographic and behavioral factors related to Post COVID-19 Condition Juan Andres Medina Florez Shaina Raza Rashida Lynn Zahra Shakeri Brendan T. Smith Elham Dolatabadi 77 0 0 21 Jan 2025
Neuradicon: operational representation learning of neuroimaging reports Henry Watkins Robert J. Gray Adam Julius Y. Mah W. H. Pinaya ... Jorge M. Cardoso Sebastien Ourselin Geraint Rees Rolf Jaeger P. Nachev MedIm 206 1 0 20 Jan 2025
Natural Language-Assisted Multi-modal Medication Recommendation Jie Tan Yu Rong Kangfei Zhao Tian Bian Tingyang Xu Junzhou Huang Hong Cheng Helen Meng 58 1 0 13 Jan 2025
MedCT: A Clinical Terminology Graph for Generative AI Applications in Healthcare Ye Chen Dongdong Huang Haoyun Xu Cong Fu Lin Sheng Qingli Zhou Yuqiang Shen Kai Wang VLM MedIm 48 0 0 11 Jan 2025
BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs Sheng Zhang Yanbo Xu Naoto Usuyama Hanwen Xu J. Bagga ... Carlo Bifulco M. Lungren Tristan Naumann Sheng Wang Hoifung Poon LM&MA MedIm 154 208 0 10 Jan 2025
Information Extraction from Clinical Notes: Are We Ready to Switch to Large Language Models? Yan Hu X. Zuo Yujia Zhou Xueqing Peng J. Huang ... Ruey-Ling Weng Qingyu Chen Xiaoqian Jiang Kirk Roberts Hua Xu LM&MA 31 4 0 08 Jan 2025
Hengqin-RA-v1: Advanced Large Language Model for Diagnosis and Treatment of Rheumatoid Arthritis with Dataset based Traditional Chinese Medicine Yishen Liu Shengda Luo Zishao Zhong Tongtong Wu Jingyang Zhang Peiyao Ou Yong Liang Liang Liu Hudan Pan LM&MA 43 0 0 05 Jan 2025
TriG-NER: Triplet-Grid Framework for Discontinuous Named Entity Recognition R. Cabral Soyeon Caren Han Areej Alhassan R. Batista-Navarro Goran Nenadic Josiah Poon 36 0 0 04 Nov 2024
Enabling Scalable Evaluation of Bias Patterns in Medical LLMs Hamed Fayyaz Raphael Poulain Rahmatollah Beheshti 40 1 0 18 Oct 2024
MedINST: Meta Dataset of Biomedical Instructions Wenhan Han Meng Fang Zihan Zhang Yu Yin Zirui Song Ling-Hao Chen Mykola Pechenizkiy Qingyu Chen LM&MA 33 2 0 17 Oct 2024
DiMB-RE: Mining the Scientific Literature for Diet-Microbiome Associations Gibong Hong Veronica Hindle Nadine M. Veasley Hannah D. Holscher Halil Kilicoglu AI4CE 48 0 0 29 Sep 2024
Towards understanding evolution of science through language model series Junjie Dong Zhuoqi Lyu Qing Ke AI4TS 37 0 0 15 Sep 2024
Evaluating Pre-trained Convolutional Neural Networks and Foundation Models as Feature Extractors for Content-based Medical Image Retrieval A. Mahbod Nematollah Saeidi Sepideh Hatamikia Ramona Woitek VLM MedIm 31 2 0 14 Sep 2024
LUK: Empowering Log Understanding with Expert Knowledge from Large Language Models Lipeng Ma Weidong Yang Sihang Jiang Ben Fei Mingjie Zhou Shuhao Li Bo Xu Bo Xu Yanghua Xiao 66 0 0 03 Sep 2024
EEG-Language Modeling for Pathology Detection Sam Gijsen Kerstin Ritter 52 0 0 02 Sep 2024
RoVRM: A Robust Visual Reward Model Optimized via Auxiliary Textual Preference Data Chenglong Wang Yang Gan Yifu Huo Yongyu Mu Murun Yang ... Chunliang Zhang Tongran Liu Quan Du Di Yang Jingbo Zhu VLM 71 4 0 22 Aug 2024
ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understanding Yijia Xiao Edward Sun Yiqiao Jin Qifan Wang Wei Wang 47 10 0 21 Aug 2024
GOProteinGNN: Leveraging Protein Knowledge Graphs for Protein Representation Learning Dan Kalifa Uriel Singer Kira Radinsky 54 1 0 31 Jul 2024
DALL-M: Context-Aware Clinical Data Augmentation with LLMs Chihcheng Hsieh Catarina Moreira Isabel Blanco Nobre Sandra Costa Sousa Chun Ouyang M. Brereton Joaquim A. Jorge Jacinto C. Nascimento 54 0 0 11 Jul 2024
WSI-VQA: Interpreting Whole Slide Images by Generative Visual Question Answering Pingyi Chen Chenglu Zhu Sunyi Zheng Honglin Li Lin Yang 55 7 0 08 Jul 2024
Using LLMs to label medical papers according to the CIViC evidence model Markus Hisch Xing David Wang 47 0 0 05 Jul 2024
MU-Bench: A Multitask Multimodal Benchmark for Machine Unlearning Jiali Cheng Hadi Amiri BDL 45 3 0 21 Jun 2024