Quilt-1M: One Million Image-Text Pairs for Histopathology

20 June 2023

Wisdom O. Ikezogwo

M. S. Seyfioglu

Fatemeh Ghezloo

Dylan Stefan Chan Geva

Fatwir Sheikh Mohammed

Papers citing "Quilt-1M: One Million Image-Text Pairs for Histopathology"

50 / 76 papers shown

Title
MAKE: Multi-Aspect Knowledge-Enhanced Vision-Language Pretraining for Zero-shot Dermatological Assessment Siyuan Yan X. Li Ming Hu Yiwen Jiang Zhen Yu Zongyuan Ge MedIm VLM 21 0 0 14 May 2025
Multi-Modal Explainable Medical AI Assistant for Trustworthy Human-AI Collaboration Honglong Yang Shanshan Song Yi Qin Lehan Wang Haonan Wang Xinpeng Ding Qixiang Zhang Bodong Du X. Li LM&MA 31 0 0 11 May 2025
SimMIL: A Universal Weakly Supervised Pre-Training Framework for Multi-Instance Learning in Whole Slide Pathology Images Yicheng Song Tiancheng Lin Die Peng Su Yang Yi Xu MedIm 31 0 0 10 May 2025
VideoPath-LLaVA: Pathology Diagnostic Reasoning Through Video Instruction Tuning T. Vuong J. T. Kwak VGen 32 0 0 07 May 2025
Investigating Zero-Shot Diagnostic Pathology in Vision-Language Models with Efficient Prompt Design Vasudev Sharma Ahmed Alagha Abdelhakim Khellaf Vincent Quoc-Huy Trinh Mahdi S. Hosseini 38 0 0 30 Apr 2025
Multimodal Large Language Models for Medicine: A Comprehensive Survey Jiarui Ye Hao Tang LM&MA 84 0 0 29 Apr 2025
CLIP-KOA: Enhancing Knee Osteoarthritis Diagnosis with Multi-Modal Learning and Symmetry-Aware Loss Functions Yejin Jeong Donghun Lee 63 0 0 28 Apr 2025
Multi-Resolution Pathology-Language Pre-training Model with Text-Guided Visual Representation Shahad Albastaki Anabia Sohail I. I. Ganapathi B. Alawode Asim Khan Sajid Javed N. Werghi Mohammed Bennamoun Arif Mahmood 66 0 0 26 Apr 2025
VLM-based Prompts as the Optimal Assistant for Unpaired Histopathology Virtual Staining Zizhi Chen Xinyu Zhang Minghao Han Y. Liu Ziyun Qian Weifeng Zhang X. Zhang Jingwei Wei L. Zhang 29 0 0 22 Apr 2025
How Well Can General Vision-Language Models Learn Medicine By Watching Public Educational Videos? Rahul Thapa Andrew Li Qingyang Wu B. He Yuki Sahashi ... Angela Zhang Ben Athiwaratkun S. Song David Ouyang James Y. Zou LM&MA 45 0 0 19 Apr 2025
GECKO: Gigapixel Vision-Concept Contrastive Pretraining in Histopathology S. Kapse Pushpak Pati Srikar Yellapragada Srijan Das Rajarsi R. Gupta Joel H. Saltz Dimitris Samaras Prateek Prasanna VLM 43 0 0 01 Apr 2025
Derm1M: A Million-scale Vision-Language Dataset Aligned with Clinical Ontology Knowledge for Dermatology Siyuan Yan Ming Hu Yiwen Jiang X. Li Hao Fei P. Tschandl Harald Kittler Zongyuan Ge VLM 62 1 0 19 Mar 2025
Advancing Medical Representation Learning Through High-Quality Data Negin Baghbanzadeh Adibvafa Fallahpour Yasaman Parhizkar Franklin Ogidi Shuvendu Roy ... Vahid Reza Khazaie Michael Colacci Ali Etemad Arash Afkanpour Elham Dolatabadi LM&MA 83 0 0 18 Mar 2025
How Good is my Histopathology Vision-Language Foundation Model? A Holistic Benchmark Roba Al Majzoub H. Malik Muzammal Naseer Zaigham Zaheer Tariq Mahmood Salman Khan Fahad A Khan VLM 58 0 0 17 Mar 2025
Leveraging Vision-Language Embeddings for Zero-Shot Learning in Histopathology Images M. Rahaman Ewan K. A. Millar Erik H. W. Meijering VLM 62 0 0 13 Mar 2025
CrossFusion: A Multi-Scale Cross-Attention Convolutional Fusion Model for Cancer Survival Prediction Rustin Soraki Huayu Wang J. Elmore Linda G. Shapiro MedIm 45 0 0 03 Mar 2025
A Shared Encoder Approach to Multimodal Representation Learning Shuvendu Roy Franklin Ogidi Ali Etemad Elham Dolatabadi Arash Afkanpour 42 0 0 03 Mar 2025
Delving into Out-of-Distribution Detection with Medical Vision-Language Models Lie Ju Sijin Zhou Yukun Zhou Huimin Lu Zhuoting Zhu P. Keane Zongyuan Ge VLM 40 0 0 02 Mar 2025
Can We Simplify Slide-level Fine-tuning of Pathology Foundation Models? Jiawen Li Jiali Hu Qiehe Sun Renao Yan Minxi Ouyang Tian Guan Anjia Han Chao He Yonghong He MedIm 61 0 0 28 Feb 2025
VLEER: Vision and Language Embeddings for Explainable Whole Slide Image Representation Anh Tien Nguyen Keunho Byeon Kyungeun Kim Jin Tae Kwak 58 1 0 28 Feb 2025
From large language models to multimodal AI: A scoping review on the potential of generative AI in medicine Lukas Buess Matthias Keicher Nassir Navab Andreas K. Maier Soroosh Tayebi Arasteh LM&MA 120 0 0 13 Feb 2025
GAIA: A Global, Multi-modal, Multi-scale Vision-Language Dataset for Remote Sensing Image Analysis Angelos Zavras Dimitrios Michail Xiao Xiang Zhu Begum Demir Ioannis Papoutsis VLM 81 0 0 13 Feb 2025
PathFinder: A Multi-Modal Multi-Agent System for Medical Diagnostic Decision-Making Applied to Histopathology Fatemeh Ghezloo M. S. Seyfioglu Rustin Soraki Wisdom O. Ikezogwo Beibin Li Tejoram Vivekanandan J. Elmore Ranjay Krishna Linda G. Shapiro 86 3 0 13 Feb 2025
ViLa-MIL: Dual-scale Vision-Language Multiple Instance Learning for Whole Slide Image Classification Jiangbo Shi Chen Li Tieliang Gong Yefeng Zheng Huazhu Fu VLM 60 7 0 12 Feb 2025
BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity Zahra Gharaee Scott C. Lowe ZeMing Gong Pablo Millán Arias Nicholas Pellegrino ... Lila Kari Dirk Steinke Graham W. Taylor Paul Fieguth Angel X. Chang 44 7 0 28 Jan 2025
BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs Sheng Zhang Yanbo Xu Naoto Usuyama Hanwen Xu J. Bagga ... Carlo Bifulco M. Lungren Tristan Naumann Sheng Wang Hoifung Poon LM&MA MedIm 151 205 0 10 Jan 2025
From Histopathology Images to Cell Clouds: Learning Slide Representations with Hierarchical Cell Transformer Zijiang Yang Zhongwei Qiu Tiancheng Lin Hanqing Chao Wanxing Chang ... Dakai Jin K. Yan Le Lu Hui Jiang Yun Bian DiffM 67 0 0 21 Dec 2024
Efficient and Comprehensive Feature Extraction in Large Vision-Language Model for Clinical Pathology Analysis Shengxuming Zhang Weihan Li Tianhong Gao Jiacong Hu Haoming Luo Mingli Song Xiuming Zhang Mingli Song Zunlei Feng LM&MA 101 0 0 12 Dec 2024
Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions Kai Sun Siyan Xue F. Sun Haoran Sun Yu-Juan Luo ... Xinzhou Wang Lei Yang Shuo Jin Jun Yan Jiahong Dong AI4CE 74 2 0 03 Dec 2024
Aligning Knowledge Concepts to Whole Slide Images for Precise Histopathology Image Analysis Weiqin Zhao Ziyu Guo Yinshuang Fan Yuming Jiang Maximus C. F. Yeung Lequan Yu 69 3 0 27 Nov 2024
OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretraining Ming Hu Kun Yuan Yaling Shen Feilong Tang Xiaohao Xu ... Jin Ye N. Padoy Nassir Navab Junjun He Zongyuan Ge VLM CLIP 87 11 0 23 Nov 2024
Free Lunch in Pathology Foundation Model: Task-specific Model Adaptation with Concept-Guided Feature Enhancement Yanyan Huang Weiqin Zhao Yihang Chen Yu Fu Lequan Yu MedIm 35 2 0 15 Nov 2024
RaVL: Discovering and Mitigating Spurious Correlations in Fine-Tuned Vision-Language Models Maya Varma Jean-Benoit Delbrouck Zhihong Chen Akshay S. Chaudhari C. Langlotz VLM 44 6 0 06 Nov 2024
Large Language Model Benchmarks in Medical Tasks Lawrence K. Q. Yan Ming Li Y. Zhang Caitlyn Heqi Yin Cheng Fei ... Ziqian Bi Pohsun Feng Keyu Chen Junyu Liu Qian Niu LM&MA AI4MH 51 5 0 28 Oct 2024
Mini-InternVL: A Flexible-Transfer Pocket Multimodal Model with 5% Parameters and 90% Performance Zhangwei Gao Zhe Chen Erfei Cui Yiming Ren Weiyun Wang ... Lewei Lu Tong Lu Yu Qiao Jifeng Dai Wenhai Wang VLM 62 24 0 21 Oct 2024
Foundation Models for Slide-level Cancer Subtyping in Digital Pathology Pablo Meseguer Rocío del Amor Adrián Colomer Valery Naranjo MedIm 11 0 0 21 Oct 2024
MI-VisionShot: Few-shot adaptation of vision-language models for slide-level classification of histopathological images Pablo Meseguer Rocío del Amor Valery Naranjo VLM 24 0 0 21 Oct 2024
SemiHVision: Enhancing Medical Multimodal Models with a Semi-Human Annotated Dataset and Fine-Tuned Instruction Generation Junda Wang Yujan Ting Eric Z. Chen Hieu Tran Hong-ye Yu Weijing Huang Terrence Chen VLM LM&MA 40 1 0 19 Oct 2024
Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentation Kun Yuan V. Srivastav Nassir Navab N. Padoy 44 7 0 30 Sep 2024
Interpretable Vision-Language Survival Analysis with Ordinal Inductive Bias for Computational Pathology Pei Liu Luping Ji Jiaxiang Gou Bo Fu Mao Ye 21 2 0 14 Sep 2024
Few-shot Adaptation of Medical Vision-Language Models Fereshteh Shakeri Yunshi Huang Julio Silva-Rodríguez Houda Bahig An Tang Jose Dolz Ismail Ben Ayed VLM 34 2 0 05 Sep 2024
PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning Noor Hussein Fahad Shamshad Muzammal Naseer Karthik Nandakumar AAML 52 3 0 29 Aug 2024
A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Models Dibaloke Chanda Milan Aryal Nasim Yahya Soltani Masoud Ganji AI4CE VLM 34 7 0 23 Aug 2024
PA-LLaVA: A Large Language-Vision Assistant for Human Pathology Image Understanding Dawei Dai Yuanhui Zhang Long Xu Qianlan Yang Xiaojing Shen Shuyin Xia Guoyin Wang LM&MA VLM 24 6 0 18 Aug 2024
BAPLe: Backdoor Attacks on Medical Foundational Models using Prompt Learning Asif Hanif Fahad Shamshad Muhammad Awais Muzammal Naseer F. Khan Karthik Nandakumar Salman Khan Rao Muhammad Anwer MedIm AAML 33 3 0 14 Aug 2024
MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine Yunfei Xie Ce Zhou Lang Gao Juncheng Wu Xianhang Li ... Sheng Liu Lei Xing James Zou Cihang Xie Yuyin Zhou LM&MA MedIm 74 23 0 06 Aug 2024
Cost-effective Instruction Learning for Pathology Vision and Language Analysis Kaitao Chen Mianxin Liu Fang Yan Lei Ma Xiaoming Shi ... Xiaosong Wang Lifeng Zhu Zhe Wang Mu Zhou Shaoting Zhang 42 3 0 25 Jul 2024
Large-vocabulary forensic pathological analyses via prototypical cross-modal contrastive learning Chen Shen Chunfeng Lian Wanqing Zhang Fan Wang Jianhua Zhang ... Hongshu Mu Hao Wu Xinggong Liang Jianhua Ma Zhenyuan Wang 36 0 0 20 Jul 2024
$$\infty$-Brush: Controllable Large Image Synthesis with Diffusion Models in Infinite Dimensions$ $\infty$ -Brush: Controllable Large Image Synthesis with Diffusion Models in Infinite Dimensions Minh-Quan Le Alexandros Graikos Srikar Yellapragada Rajarsi R. Gupta Joel H. Saltz Dimitris Samaras 27 9 0 20 Jul 2024
Are We Ready for Out-of-Distribution Detection in Digital Pathology? Ji-Hun Oh Kianoush Falahkheirkhah Rohit Bhargava OODD 41 2 0 18 Jul 2024