Multimodal ChatGPT for Medical Applications: an Experimental Study of GPT-4V

29 October 2023

Kai Zhang

Xiang Li

Papers citing "Multimodal ChatGPT for Medical Applications: an Experimental Study of GPT-4V"

27 / 27 papers shown

Title
3DAxisPrompt: Promoting the 3D Grounding and Reasoning in GPT-4o Dingning Liu Cheng Wang Peng Gao Renrui Zhang Xinzhu Ma Yuan Meng Zhihui Wang LRM 49 0 0 17 Mar 2025
Explainable, Multi-modal Wound Infection Classification from Images Augmented with Generated Captions Palawat Busaranuvong Emmanuel O. Agu Reza Saadati Fard Deepak Kumar Shefalika Gautam B. Tulu Diane Strong MedIm 62 0 0 27 Feb 2025
Can't See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs Wenxuan Wang Xiaoyuan Liu Kuiyi Gao Jen-tse Huang Youliang Yuan Pinjia He Shuai Wang Zhaopeng Tu 59 0 0 16 Feb 2025
How Good is ChatGPT at Audiovisual Deepfake Detection: A Comparative Study of ChatGPT, AI Models and Human Perception Sahibzada Adil Shahzad Ammarah Hashmi Yan-Tsung Peng Yu Tsao H. Wang 39 1 0 14 Nov 2024
Leveraging Multimodal Models for Enhanced Neuroimaging Diagnostics in Alzheimer's Disease Francesco Chiumento Mingming Liu LM&MA 48 0 0 12 Nov 2024
WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation João Matos Shan Chen Siena Placino Yingya Li Juan Carlos Climent Pardo ... Hugo J. W. L. Aerts Leo Anthony Celi A. I. Wong Danielle S. Bitterman Jack Gallifant 26 0 0 16 Oct 2024
Zodiac: A Cardiologist-Level LLM Framework for Multi-Agent Diagnostics Yuan Zhou Peng Zhang Mengya Song Alice Zheng Yiwen Lu Zhiheng Liu Yong Chen Zhaohan Xi LM&MA 33 1 0 02 Oct 2024
The Power of Combining Data and Knowledge: GPT-4o is an Effective Interpreter of Machine Learning Models in Predicting Lymph Node Metastasis of Lung Cancer Danqing Hu Bing Liu Xiaofeng Zhu Nan Wu AI4CE LM&MA 21 1 0 25 Jul 2024
AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description Junyu Xie Tengda Han Max Bain Arsha Nagrani Gül Varol Weidi Xie Andrew Zisserman VGen 39 8 0 22 Jul 2024
GPT-4V Cannot Generate Radiology Reports Yet Yuyang Jiang Chacha Chen Dang Nguyen Benjamin M. Mervak Chenhao Tan LM&MA 41 2 0 16 Jul 2024
Bora: Biomedical Generalist Video Generation Model Weixiang Sun Xiaocao You Ruizhe Zheng Zhengqing Yuan Xiang Li Lifang He Quanzheng Li Lichao Sun VGen MedIm 24 8 0 12 Jul 2024
HEMM: Holistic Evaluation of Multimodal Foundation Models Paul Pu Liang Akshay Goindani Talha Chafekar Leena Mathur Haofei Yu Ruslan Salakhutdinov Louis-Philippe Morency 41 10 0 03 Jul 2024
HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale Junying Chen Ruyi Ouyang Anningzhe Gao Shunian Chen Guiming Hardy Chen ... Zhenyang Cai Ke Ji Guangjun Yu Xiang Wan Benyou Wang MedIm LM&MA 51 32 0 27 Jun 2024
A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data Xinyi Wang Grazziela Figueredo Ruizhe Li W. Zhang Weitong Chen Xin Chen MedIm ViT 49 2 0 21 May 2024
Beyond Human Vision: The Role of Large Vision Language Models in Microscope Image Analysis Prateek Verma Minh-Hao Van Xintao Wu VLM 37 4 0 01 May 2024
LLMSense: Harnessing LLMs for High-level Reasoning Over Spatiotemporal Sensor Traces Xiaomin Ouyang Mani B. Srivastava LRM 34 18 0 28 Mar 2024
Bioinformatics and Biomedical Informatics with ChatGPT: Year One Review Jinge Wang Zien Cheng Qiuming Yao Li Liu Dong Xu Gangqing Hu LM&MA AI4CE 35 3 0 22 Mar 2024
On Large Visual Language Models for Medical Imaging Analysis: An Empirical Study Minh-Hao Van Prateek Verma Xintao Wu LM&MA 41 30 0 21 Feb 2024
Scaffolding Coordinates to Promote Vision-Language Coordination in Large Multi-Modal Models Xuanyu Lei Zonghan Yang Xinrui Chen Peng Li Yang Liu MLLM LRM 40 31 0 19 Feb 2024
Hidden Flaws Behind Expert-Level Accuracy of GPT-4 Vision in Medicine Qiao Jin Fangyuan Chen Yiliang Zhou Ziyang Xu Justin M. Cheung ... Alex Chen Josef A. Brejt Michael F. Chiang Yifan Peng Zhiyong Lu ELM MedIm LM&MA 26 36 0 16 Jan 2024
Benchmarking PathCLIP for Pathology Image Analysis Sunyi Zheng Xiaonan Cui Yuxuan Sun Jingxiong Li Honglin Li Yunlong Zhang Pingyi Chen Xueping Jing Zhaoxiang Ye Lin Yang VLM 24 7 0 05 Jan 2024
Image and Data Mining in Reticular Chemistry Using GPT-4V Zhiling Zheng Zhiguo He Omar Khattab Nakul Rampal Matei A. Zaharia C. Borgs J. Chayes O. Yaghi 21 1 0 09 Dec 2023
GlitchBench: Can large multimodal models detect video game glitches? Mohammad Reza Taesiri Tianjun Feng Anh Nguyen C. Bezemer MLLM VLM LRM 30 9 0 08 Dec 2023
BioLORD-2023: Semantic Textual Representations Fusing LLM and Clinical Knowledge Graph Insights François Remy Kris Demuynck Thomas Demeester 32 3 0 27 Nov 2023
Accuracy of a Vision-Language Model on Challenging Medical Cases Thomas A. Buckley James A. Diao Adam Rodman Arjun K. Manrai MedIm LM&MA 16 13 0 09 Nov 2023
MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use Yue Huang Jiawen Shi Yuan Li Chenrui Fan Siyuan Wu ... Yixin Liu Pan Zhou Yao Wan Neil Zhenqiang Gong Lichao Sun LLMAG 40 81 0 04 Oct 2023
DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4 Zheng-Long Liu Yue Huang Xiao-Xing Yu Lu Zhang Zihao Wu ... Dinggang Shen Quanzheng Li Tianming Liu Dajiang Zhu Xiang Li LM&MA MedIm 33 171 0 20 Mar 2023