M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models

31 March 2024

Tiejun Huang

ArXiv (abs)PDF HTML Github (318★)

Papers citing "M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models"

28 / 28 papers shown

Title
Domain Specific Benchmarks for Evaluating Multimodal Large Language Models Khizar Anjuma Muhammad Arbab Arshad Kadhim Hayawi Efstathios Polyzos A. Tariq ... Nishith Reddy Mannuru Ravi Varma Kumar Bevara Taslim Mahbub Muhammad Zeeshan Akram Sakib Shahriar ELM LRM 59 0 0 15 Jun 2025
3D-RAD: A Comprehensive 3D Radiology Med-VQA Dataset with Multi-Temporal Analysis and Diverse Diagnostic Tasks Xiaotang Gai Jiaxiang Liu Yichen Li Zijie Meng Jian Wu Zuozhu Liu VGen 22 0 0 11 Jun 2025
HSENet: Hybrid Spatial Encoding Network for 3D Medical Vision-Language Understanding Yanzhao Shi Xiaodan Zhang Junzhong Ji Haoning Jiang Chengxin Zheng Y. Wang Liangqiong Qu 91 0 0 11 Jun 2025
Foundation Models in Medical Imaging -- A Review and Outlook Vivien van Veldhuizen Vanessa Botha C. Lu Melis Erdal Cesur Kevin Groot Lipman ... Cees Snoek Lodewyk Wessels Ritse Mann Eric Marcus Jonas Teuwen MedIm VLM AI4CE 85 0 0 10 Jun 2025
Towards Scalable Language-Image Pre-training for 3D Medical Imaging Chenhui Zhao Yiwei Lyu Asadur Chowdury Edward Harake A. Kondepudi Akshay Rao X. Hou Honglak Lee Todd C. Hollon LM&MA MedIm 41 0 0 28 May 2025
Are Vision Language Models Ready for Clinical Diagnosis? A 3D Medical Benchmark for Tumor-centric Visual Question Answering Y. Chen Wenjie Xiao P. R. Bassi Xinze Zhou Sezgin Er Ibrahim Ethem Hamamci Zongwei Zhou Alan Yuille ELM 67 0 0 25 May 2025
Medical Large Vision Language Models with Multi-Image Visual Ability Xikai Yang Juzheng Miao Yuchen Yuan Jiaze Wang Qi Dou Jinpeng Li Pheng Ann Heng 38 0 0 25 May 2025
CT-Agent: A Multimodal-LLM Agent for 3D CT Radiology Question Answering Yuren Mao Wenyi Xu Yuyang Qin Yunjun Gao MedIm 79 0 0 22 May 2025
ViCTr: Vital Consistency Transfer for Pathology Aware Image Synthesis Onkar Susladkar Gayatri Deshmukh Yalcin Tur Gorkhem Durak Ulas Bagci MedIm 248 0 0 08 May 2025
UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretation Linshan Wu Yuxiang Nie Sunan He Jiaxin Zhuang Hao Chen ... V. Vardhanabhuti R. Chan Yifan Peng Pranav Rajpurkar Hao Chen LM&MA MedIm 196 0 0 30 Apr 2025
Multimodal Large Language Models for Medicine: A Comprehensive Survey Jiarui Ye Hao Tang LM&MA 189 0 0 29 Apr 2025
Enhancing Surgical Documentation through Multimodal Visual-Temporal Transformers and Generative AI Hugo Georgenthum Cristian Cosentino Fabrizio Marozzo Pietro Liò MedIm 443 0 0 28 Apr 2025
MedM-VL: What Makes a Good Medical LVLM? Yiming Shi Shaoshuai Yang Xun Zhu Haoyu Wang Miao Li Ji Wu VLM 151 1 0 06 Apr 2025
UMIT: Unifying Medical Imaging Tasks via Vision-Language Models Haiyang Yu Siyang Yi Ke Niu Minghan Zhuo Bin Li LM&MA 87 4 0 20 Mar 2025
Interactive Segmentation and Report Generation for CT Images Yannian Gu Wenhui Lei Hanyu Chen Xiaofan Zhang Shanghang Zhang 87 0 0 05 Mar 2025
From large language models to multimodal AI: A scoping review on the potential of generative AI in medicine Lukas Buess Matthias Keicher Nassir Navab Andreas Maier Soroosh Tayebi Arasteh LM&MA 339 2 0 13 Feb 2025
Brain-Adapter: Enhancing Neurological Disorder Analysis with Adapter-Tuning Multimodal Large Language Models Jing Zhang Xiaowei Yu Yanjun Lyu Lu Zhang Tong Chen Chao-Yang Cao Yan Zhuang Minheng Chen Tianming Liu D. Zhu 72 2 0 28 Jan 2025
RadGPT: Constructing 3D Image-Text Tumor Datasets P. R. Bassi Mehmet Can Yavuz Kang Wang Xiaoxi Chen Wenxuan Li S. Decherchi Andrea Cavalli Yang Yang Alan Yuille Zongwei Zhou LM&MA MedIm 130 2 0 08 Jan 2025
A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine Hanguang Xiao Feizhong Zhou Xianglong Liu Tianqi Liu Zhipeng Li Xin Liu Xiaoxuan Huang AILaw LM&MA LRM 163 30 0 31 Dec 2024
Large Language Model with Region-guided Referring and Grounding for CT Report Generation Zhaoyu Chen Yequan Bie Haibo Jin Hao Chen 449 1 0 23 Nov 2024
Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Model Yiming Shi Xun Zhu Ying Hu Chenyi Guo Miao Li Ji Wu 141 2 0 19 Nov 2024
Label Critic: Design Data Before Models P. R. Bassi Qilong Wu Wenxuan Li S. Decherchi Andrea Cavalli Alan Yuille Zongwei Zhou 90 0 0 05 Nov 2024
ViT3D Alignment of LLaMA3: 3D Medical Image Report Generation Siyou Li Beining Xu Yihao Luo Dong Nie Le Zhang 47 1 0 11 Oct 2024
FMBench: Benchmarking Fairness in Multimodal Large Language Models on Medical Tasks Peiran Wu Che Liu Chong Chen Jun Li Cosmin I. Bercea Rossella Arcucci 85 5 0 01 Oct 2024
A Survey on Multimodal Benchmarks: In the Era of Large AI Models Lin Li Guikun Chen Hanrong Shi Jun Xiao Long Chen 126 11 0 21 Sep 2024
A Survey on Evaluation of Multimodal Large Language Models Jiaxing Huang Jingyi Zhang LM&MA ELM LRM 120 26 0 28 Aug 2024
Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey Qika Lin Yifan Zhu Xin Mei Ling Huang Jingying Ma Kai He Zhen Peng Min Zhang Mengling Feng 111 23 0 23 Aug 2024
CT-AGRG: Automated Abnormality-Guided Report Generation from 3D Chest CT Volumes Theo Di Piazza 131 1 0 21 Aug 2024