Teach Multimodal LLMs to Comprehend Electrocardiographic Images

Teach Multimodal LLMs to Comprehend Electrocardiographic Images

21 October 2024

Ruoqi Liu

Ping Zhang

ArXiv (abs)PDF HTML

Papers citing "Teach Multimodal LLMs to Comprehend Electrocardiographic Images"

14 / 14 papers shown

Title
What matters when building vision-language models? Hugo Laurençon Léo Tronchon Matthieu Cord Victor Sanh VLM 100 177 0 03 May 2024
MANTIS: Interleaved Multi-Image Instruction Tuning Dongfu Jiang Xuan He Huaye Zeng Cong Wei Max Ku Qian Liu Wenhu Chen VLM MLLM 100 125 0 02 May 2024
How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites Zhe Chen Weiyun Wang Hao Tian Shenglong Ye Zhangwei Gao ... Tong Lu Dahua Lin Yu Qiao Jifeng Dai Wenhai Wang MLLM VLM 133 642 0 25 Apr 2024
Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference Wei-Lin Chiang Lianmin Zheng Ying Sheng Anastasios Nikolas Angelopoulos Tianle Li ... Hao Zhang Banghua Zhu Michael I. Jordan Joseph E. Gonzalez Ion Stoica OSLM 160 599 0 07 Mar 2024
Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogram Yeongyeon Na Minje Park Yunwon Tae S. Joo 75 31 0 02 Feb 2024
MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI Xiang Yue Yuansheng Ni Kai Zhang Tianyu Zheng Ruoqi Liu ... Yibo Liu Wenhao Huang Huan Sun Yu-Chuan Su Wenhu Chen OSLM ELM VLM 268 960 0 27 Nov 2023
ECG-Image-Kit: A Synthetic Image Generation Toolbox to Facilitate Deep Learning-Based Electrocardiogram Digitization Kshama Kodthalu Shivashankara Deepanshi Afagh Mehri Shervedani Gari D. Clifford Matthew A. Reyna Reza Sameni MedIm 63 41 0 04 Jul 2023
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena Lianmin Zheng Wei-Lin Chiang Ying Sheng Siyuan Zhuang Zhanghao Wu ... Dacheng Li Eric Xing Haotong Zhang Joseph E. Gonzalez Ion Stoica ALM OSLM ELM 452 4,444 0 09 Jun 2023
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning Wenliang Dai Junnan Li Dongxu Li A. M. H. Tiong Junqi Zhao Weisheng Wang Boyang Albert Li Pascale Fung Steven C. H. Hoi MLLM VLM 142 2,098 0 11 May 2023
Visual Instruction Tuning Haotian Liu Chunyuan Li Qingyang Wu Yong Jae Lee SyDa VLM MLLM 571 4,925 0 17 Apr 2023
Frozen Language Model Helps ECG Zero-Shot Learning Jun Yu Li Che Liu Sibo Cheng Rossella Arcucci linda Qiao 79 64 0 22 Mar 2023
Large Language Models Encode Clinical Knowledge K. Singhal Shekoofeh Azizi T. Tu S. S. Mahdavi Jason W. Wei ... A. Rajkomar Joelle Barral Christopher Semturs Alan Karthikesalingam Vivek Natarajan LM&MA ELM AI4MH 161 2,381 0 26 Dec 2022
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 294 2,845 0 15 Jun 2021
Automatic diagnosis of the 12-lead ECG using a deep neural network Antônio H. Ribeiro Manoel Horta Ribeiro Gabriela M. M. Paixão D. Oliveira P. R. Gomes ... Carl R. Andersson P. Macfarlane W. Meira Jr. Thomas B. Schon A. L. Ribeiro 73 663 0 02 Apr 2019