33

Overview of TREC 2025 Biomedical Generative Retrieval (BioGen) Track

Deepak Gupta
Dina Demner-Fushman
William Hersh
Steven Bedrick
Kirk Roberts
Main:12 Pages
5 Figures
Bibliography:2 Pages
12 Tables
Abstract

Recent advances in large language models (LLMs) have made significant progress across multiple biomedical tasks, including biomedical question answering, lay-language summarization of the biomedical literature, and clinical note summarization. These models have demonstrated strong capabilities in processing and synthesizing complex biomedical information and in generating fluent, human-like responses. Despite these advancements, hallucinations or confabulations remain key challenges when using LLMs in biomedical and other high-stakes domains. Inaccuracies may be particularly harmful in high-risk situations, such as medical question answering, making clinical decisions, or appraising biomedical research. Studies on the evaluation of the LLMs' abilities to ground generated statements in verifiable sources have shown that models perform significantly

View on arXiv
Comments on this paper