Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA

v1v2v3v4v5 (latest)

Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA

30 May 2024

ArXiv (abs)PDF HTML

Papers citing "Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA"

9 / 9 papers shown

Title
Bringing CLIP to the Clinic: Dynamic Soft Labels and Negation-Aware Learning for Medical Analysis Hanbin Ko Chang-Min Park 26 0 0 28 May 2025
MedFrameQA: A Multi-Image Medical VQA Benchmark for Clinical Reasoning Suhao Yu Haojin Wang Juncheng Wu Cihang Xie Yuyin Zhou 77 1 0 22 May 2025
Structure Causal Models and LLMs Integration in Medical Visual Question Answering Zibo Xu Qiang Li Weizhi Nie Weijie Wang Anan Liu CML MedIm 102 0 0 05 May 2025
Localizing Before Answering: A Hallucination Evaluation Benchmark for Grounded Medical Multimodal LLMs Dung Nguyen Minh Khoi Ho Huy Ta T. Nguyen Qi Chen ... Zhibin Liao Minh-Son To Johan Verjans Phi Le Nguyen Vu Minh Hieu Phan 76 0 0 30 Apr 2025
Tonguescape: Exploring Language Models Understanding of Vowel Articulation Haruki Sakajo Yusuke Sakai Hidetaka Kamigaito Taro Watanabe 68 0 0 29 Jan 2025
Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoE Xun Zhu Ying Hu Fanbin Mo Miao Li Ji Wu 125 9 0 26 Sep 2024
WildHallucinations: Evaluating Long-form Factuality in LLMs with Real-World Entity Queries Wenting Zhao Tanya Goyal Yu Ying Chiu Liwei Jiang Benjamin Newman ... Khyathi Chandu Ronan Le Bras Claire Cardie Yuntian Deng Yejin Choi HILM 82 11 0 24 Jul 2024
A Survey on Trustworthiness in Foundation Models for Medical Image Analysis Congzhen Shi Ryan Rezai Jiaxi Yang Qi Dou Xiaoxiao Li MedIm 66 6 0 03 Jul 2024
Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks Jack Gallifant Shan Chen Pedro Moreira Nikolaj Munch Mingye Gao Jackson Pond Leo Anthony Celi Hugo J. W. L. Aerts Thomas Hartvigsen Danielle S. Bitterman 105 13 0 17 Jun 2024

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.