Title
Fact-Aware Multimodal Retrieval Augmentation for Accurate Medical Radiology Report Generation Liwen Sun James Zhao Megan Han Chenyan Xiong MedIm 95 12 0 21 Jul 2024
Large-vocabulary forensic pathological analyses via prototypical cross-modal contrastive learning Chen Shen Chunfeng Lian Wanqing Zhang Fan Wang Jianhua Zhang ... Hongshu Mu Hao Wu Xinggong Liang Jianhua Ma Zhenyuan Wang 83 1 0 20 Jul 2024
LiteGPT: Large Vision-Language Model for Joint Chest X-ray Localization and Classification Task Khai-Nguyen Nguyen Ryan Zhang Ngoc Son Nguyen Tan-Hanh Pham Anh Dao Ba Hung Ngo Anh Totti Nguyen Truong-Son Hy MedIm LM&MA 74 4 0 16 Jul 2024
LEMoN: Label Error Detection using Multimodal Neighbors Haoran Zhang Aparna Balagopalan Nassim Oufattole Hyewon Jeong Yan Wu Jiacheng Zhu Marzyeh Ghassemi 103 0 0 10 Jul 2024
Light-weight Fine-tuning Method for Defending Adversarial Noise in Pre-trained Medical Vision-Language Models Xu Han Linghao Jin Xuezhe Ma Xiaofeng Liu AAML 65 3 0 02 Jul 2024
MMedAgent: Learning to Use Medical Tools with Multi-modal Agent Binxu Li Tiankai Yan Yuanting Pan Zhe Xu Jie Luo Ruiyang Ji Shilong Liu Haoyu Dong Zihao Lin Yixin Wang LM&MA 65 35 0 02 Jul 2024
FairMedFM: Fairness Benchmarking for Medical Imaging Foundation Models Ruinan Jin Zikang Xu Yuan Zhong Qiongsong Yao Qi Dou S. Kevin Zhou Xiaoxiao Li VLM 94 17 0 01 Jul 2024
PathGen-1.6M: 1.6 Million Pathology Image-text Pairs Generation through Multi-agent Collaboration Yuxuan Sun Yunlong Zhang Yixuan Si Chenglu Zhu Zhongyi Shui Kai Zhang Jingxiong Li Xingheng Lyu Tao Lin Lin Yang LM&MA VLM MedIm 89 12 0 28 Jun 2024
PathAlign: A vision-language model for whole slide images in histopathology Faruk Ahmed Andrew Sellergren Lin Yang Shawn Xu Boris Babenko ... S. Shetty Daniel Golden Yun-Hui Liu David F. Steiner Ellery Wulczyn LM&MA VLM 79 18 0 27 Jun 2024
Soft Masked Mamba Diffusion Model for CT to MRI Conversion Zhenbin Wang Lei Zhang Lituan Wang Zhenwei Zhang Mamba MedIm 67 7 0 22 Jun 2024
Biomedical Visual Instruction Tuning with Clinician Preference Alignment Hejie Cui Lingjun Mao Xin Liang Jieyu Zhang Hui Ren Quanzheng Li Xiang Li Carl Yang LM&MA 94 10 0 19 Jun 2024
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery Yu Zhang Xiusi Chen Bowen Jin Sheng Wang Shuiwang Ji Wei Wang Jiawei Han 115 41 0 16 Jun 2024
ProtoS-ViT: Visual foundation models for sparse self-explainable classifications Hugues Turbé Mina Bjelogrlic G. Mengaldo Christian Lovis ViT 73 7 0 14 Jun 2024
Advancing High Resolution Vision-Language Models in Biomedicine Zekai Chen Arda Pekis Kevin Brown MedIm LM&MA 51 5 0 12 Jun 2024
Merlin: A Vision Language Foundation Model for 3D Computed Tomography Louis Blankemeier Joseph Paul Cohen Ashwin Kumar Dave Van Veen Syed Jamal Safdar Gardezi ... Andrew L. Wentland C. Langlotz Jason Hom S. Gatidis Akshay S. Chaudhari LM&MA MedIm 84 39 0 10 Jun 2024
Dragonfly: Multi-Resolution Zoom Supercharges Large Visual-Language Model Kezhen Chen Rahul Thapa Rahul Chalamala Ben Athiwaratkun Shuaiwen Leon Song James Zou VLM 85 5 0 03 Jun 2024
DS@BioMed at ImageCLEFmedical Caption 2024: Enhanced Attention Mechanisms in Medical Caption Generation through Concept Detection Integration Nhi Ngoc-Yen Nguyen Le-Huy Tu Dieu-Phuong Nguyen Nhat-Tan Do Minh Triet Thai Bao-Thien Nguyen-Tat MedIm 73 2 0 01 Jun 2024
CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale ZeMing Gong Austin T. Wang Joakim Bruslund Haurum Scott C. Lowe Graham W. Taylor Angel X. Chang Angel X. Chang 86 7 0 27 May 2024
A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis Yue Yang Mona Gandhi Yufei Wang Yifan Wu Michael S. Yao Christopher Callison-Burch James C. Gee Mark Yatskar 112 4 0 23 May 2024
ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Dataset Johannes Ruckert Louise Bloch Raphael Brüngel Ahmad Idrissi-Yaghir Henning Schafer ... A. G. S. D. Herrera Henning Müller Peter A. Horn F. Nensa Christoph M. Friedrich 70 33 0 16 May 2024
Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare Xingyu Li Lu Peng Yuping Wang Weihua Zhang AI4CE MedIm LM&MA 107 10 0 10 May 2024
Low-Rank Knowledge Decomposition for Medical Foundation Models Yuhang Zhou Haolin Li Siyuan Du Jiangchao Yao Ya Zhang Yanfeng Wang 48 3 0 26 Apr 2024
VisionCLIP: An Med-AIGC based Ethical Language-Image Foundation Model for Generalizable Retina Image Analysis Hao Wei Bowen Liu Minqing Zhang Peilun Shi Wu Yuan VLM MedIm 69 3 0 16 Mar 2024
Large Model driven Radiology Report Generation with Clinical Quality Reinforcement Learning Zijian Zhou Miaojing Shi Meng Wei Oluwatosin O. Alabi Zijie Yue Tom Vercauteren LM&MA 68 7 0 11 Mar 2024
Demonstration of an Adversarial Attack Against a Multimodal Vision Language Model for Pathology Imaging Poojitha Thota Jai Prakash Veerla Partha Sai Guttikonda M. Nasr Shirin Nilizadeh Jacob M. Luber AAML 57 9 0 04 Jan 2024
Data-Centric Foundation Models in Computational Healthcare: A Survey Yunkun Zhang Jin Gao Zheling Tan Lingfeng Zhou Kexin Ding Mu Zhou Shaoting Zhang Dequan Wang AI4CE 102 25 0 04 Jan 2024
Large-scale Long-tailed Disease Diagnosis on Radiology Images Qiaoyu Zheng Weike Zhao Chaoyi Wu Xiaoman Zhang Lisong Dai Hengyu Guan Yuehua Li Ya Zhang Yanfeng Wang Weidi Xie LM&MA MedIm 100 8 0 26 Dec 2023
MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning Liang Peng Songyue Cai Zongqian Wu Huifang Shang Xiaofeng Zhu Xiaoxiao Li 72 12 0 22 Dec 2023
A Foundational Multimodal Vision Language AI Assistant for Human Pathology Ming Y. Lu Bowen Chen Drew F. K. Williamson Richard J. Chen Kenji Ikamura ... Ivy Liang L. Le Tong Ding Anil V. Parwani Faisal Mahmood MedIm LM&MA 57 21 0 13 Dec 2023
Medical Vision Language Pretraining: A survey Prashant Shrestha Sanskar Amgain Bidur Khanal Cristian A. Linte Binod Bhattarai VLM 80 17 0 11 Dec 2023
3D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology Asma Ben Abacha Alberto Santamaría-Pang Ho Hin Lee J. Merkow Qin Cai ... Julia Gong M. Lungren Thomas Lin Noel C. F. Codella Ivan Tarapov 57 5 0 23 Nov 2023
AcademicGPT: Empowering Academic Research Shufa Wei Xiaolong Xu Xianbiao Qi Xi Yin Jun Xia ... Chihao Dai Lihua Wang Xiaohui Liu Lei Zhang Yutao Xie LM&MA 71 3 0 21 Nov 2023
Training CLIP models on Data from Scientific Papers Calvin Metzger VLM CLIP 29 2 0 08 Nov 2023
Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review Mingze Yuan Peng Bao Jiajia Yuan Yunhao Shen Zi Chen ... Jie Zhao Yang Chen Li Zhang Lin Shen Bin Dong ELM LM&MA 91 14 0 03 Nov 2023
Foundational Models in Medical Imaging: A Comprehensive Survey and Future Vision Bobby Azad Reza Azad Sania Eskandari Afshin Bozorgpour Amirhossein Kazerouni I. Rekik Dorit Merhof VLM MedIm 136 67 0 28 Oct 2023
BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys Yu Gu Jianwei Yang Naoto Usuyama Chun-yue Li Sheng Zhang M. Lungren Jianfeng Gao Hoifung Poon MedIm 77 24 0 16 Oct 2023
Estimating Uncertainty in Multimodal Foundation Models using Public Internet Data Shiladitya Dutta Hongbo Wei L. Laan Ahmed Alaa 210 6 0 15 Oct 2023
When is a Foundation Model a Foundation Model Saghir Alfasly Peyman Nejat S. Hemati Jibran A. Khan Isaiah Lahr ... Aaron Mangold Lisa Boardman Vijay H. Shah Joaquin J. Garcia H. R. Tizhoosh MedIm 27 6 0 14 Sep 2023
An Empirical Analysis for Zero-Shot Multi-Label Classification on COVID-19 CT Scans and Uncurated Reports Ethan Dack Lorenzo Brigato Matthew McMurray Matthias Fontanellaz Thomas Frauenfelder ... Thomas Geiser M. Funke-Chambour Andreas Christe L. Ebner Stavroula Mougiakakou 63 2 0 04 Sep 2023
PECon: Contrastive Pretraining to Enhance Feature Alignment between CT and EHR Data for Improved Pulmonary Embolism Diagnosis Santosh Sanjeev Salwa K. Al Khatib Mai A. Shaaban Ibrahim Almakky Vijay Ram Papineni Mohammad Yaqub 50 1 0 27 Aug 2023
Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Models K. Poudel Manish Dhakal Prasiddha Bhandari Rabin Adhikari Safal Thapaliya Bishesh Khanal VLM 110 20 0 15 Aug 2023
Generative AI for Medical Imaging: extending the MONAI Framework W. H. Pinaya M. Graham E. Kerfoot Petru-Daniel Tudosiu J. Dafflon ... Andrew Feng Marc Modat P. Nachev Sebastien Ourselin M. Jorge Cardoso SyDa MedIm 85 70 0 27 Jul 2023
Towards Generalist Biomedical AI Tao Tu Shekoofeh Azizi Danny Driess M. Schaekermann Mohamed Amin ... Yossi Matias K. Singhal Peter R. Florence Alan Karthikesalingam Vivek Natarajan LM&MA MedIm AI4MH 96 271 0 26 Jul 2023
Towards a Visual-Language Foundation Model for Computational Pathology Ming Y. Lu Bowen Chen Drew F. K. Williamson Richard J. Chen Ivy Liang ... Andrew Zhang L. Le Georg Gerber Anil V. Parwani Faisal Mahmood VLM MedIm 79 46 0 24 Jul 2023
To pretrain or not to pretrain? A case study of domain-specific pretraining for semantic segmentation in histopathology Tushar Kataria Beatrice Knudsen Shireen Y. Elhabian VLM 71 7 0 06 Jul 2023
OphGLM: Training an Ophthalmology Large Language-and-Vision Assistant based on Instructions and Dialogue Weihao Gao Zhuo Deng Zhiyuan Niu Fuju Rong Chucheng Chen ... Fangjun Li Zhenjie Cao Zhaoyi Ma Wenbin Wei Lan Ma LM&MA 54 36 0 21 Jun 2023
Quilt-1M: One Million Image-Text Pairs for Histopathology Wisdom O. Ikezogwo M. S. Seyfioglu Fatemeh Ghezloo Dylan Stefan Chan Geva Fatwir Sheikh Mohammed Pavan Kumar Anand Ranjay Krishna Linda G. Shapiro CLIP VLM 286 125 0 20 Jun 2023
Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Images Ming Y. Lu Bowen Chen Andrew Zhang Drew F. K. Williamson Richard J. Chen Tong Ding L. Le Yung-Sung Chuang Faisal Mahmood VLM MedIm 179 102 0 13 Jun 2023
On the Challenges and Perspectives of Foundation Models for Medical Image Analysis Shaoting Zhang Dimitris N. Metaxas LM&MA VLM MedIm AI4CE 82 149 0 09 Jun 2023
Exploring the Versatility of Zero-Shot CLIP for Interstitial Lung Disease Classification Cara Van Uden Christian Blüthgen Maayane Attias M. Polacin H. Guo N. Simha Rishi Raj C. Langlotz VLM 28 2 0 01 Jun 2023