Currently, a considerable research effort is devoted to comparing LLMs to a group of human experts, where the term "expert" is often ill-defined or variable, at best, in a state of constantly updating LLM releases. Without proper safeguards in place, LLMs will threaten to cause harm to the established structure of safe delivery of patient care which has been carefully developed throughout history to keep the safety of the patient at the forefront. A key driver of LLM innovation is founded on community research efforts which, if continuing to operate under "humans versus LLMs" principles, will expedite this trend. Therefore, research efforts moving forward must focus on effectively characterizing the safe use of LLMs in clinical settings that persist across the rapid development of novel LLM models. In this communication, we demonstrate that rather than comparing LLMs to humans, there is a need to develop strategies enabling efficient work of humans with LLMs in an almost symbiotic manner.
View on arXiv@article{mccullum2025_2505.08902,
title={ Performance Gains of LLMs With Humans in a World of LLMs Versus Humans },
author={ Lucas McCullum and Pelagie Ami Agassi and Leo Anthony Celi and Daniel K. Ebner and Chrystinne Oliveira Fernandes and Rachel S. Hicklen and Mkliwa Koumbia and Lisa Soleymani Lehmann and David Restrepo },
journal={arXiv preprint arXiv:2505.08902},
year={ 2025 }
}