MedCLIP: Contrastive Learning from Unpaired Medical Images and Text

18 October 2022

Jimeng Sun

Papers citing "MedCLIP: Contrastive Learning from Unpaired Medical Images and Text"

50 / 244 papers shown

Title
Hierarchical Text-to-Vision Self Supervised Alignment for Improved Histopathology Representation Learning Hasindri Watawana Kanchana Ranasinghe Tariq Mahmood Muzammal Naseer Salman Khan Fahad Shahbaz Khan SSL 43 4 0 21 Mar 2024
C-TPT: Calibrated Test-Time Prompt Tuning for Vision-Language Models via Text Feature Dispersion Hee Suk Yoon Eunseop Yoon Joshua Tian Jin Tee M. Hasegawa-Johnson Yingzhen Li C. Yoo VLM 62 23 0 21 Mar 2024
Enhancing Gait Video Analysis in Neurodegenerative Diseases by Knowledge Augmentation in Vision Language Model Diwei Wang Kun Yuan Candice Müller Frédéric Blanc N. Padoy Hyewon Seo 46 2 0 20 Mar 2024
MEDBind: Unifying Language and Multimodal Medical Data Embeddings Yuan Gao Sangwook Kim David E Austin Chris McIntosh 32 3 0 19 Mar 2024
Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images Chaoqin Huang Aofan Jiang Jinghao Feng Ya-Qin Zhang Xinchao Wang Yanfeng Wang MedIm 45 25 0 19 Mar 2024
Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning Chong Ma Hanqi Jiang Wenting Chen Yiwei Li Zihao Wu ... Dajiang Zhu Tuo Zhang Dinggang Shen Tianming Liu Xiang Li 23 0 0 19 Mar 2024
Improving Medical Multi-modal Contrastive Learning with Expert Annotations Yogesh Kumar Pekka Marttinen MedIm VLM 31 10 0 15 Mar 2024
RadCLIP: Enhancing Radiologic Image Analysis through Contrastive Language-Image Pre-training Zhixiu Lu Hailong Li Lili He VLM MedIm 40 0 0 15 Mar 2024
Mitigating Data Consistency Induced Discrepancy in Cascaded Diffusion Models for Sparse-view CT Reconstruction Hanyu Chen Zhixiu Hao Lin Guo Liying Xiao 41 1 0 14 Mar 2024
Robust COVID-19 Detection in CT Images with CLIP Li Lin Yamini Sri Krubha Zhenhuan Yang Cheng Ren Thuc Duy Le Irene Amerini Xin Wang Shu Hu 34 10 0 13 Mar 2024
FluoroSAM: A Language-aligned Foundation Model for X-ray Image Segmentation Benjamin Killeen Liam J. Wang Han-shen Zhang Mehran Armand Russell H. Taylor Dave Dreizin Greg Osgood Mathias Unberath MedIm 30 2 0 12 Mar 2024
Decomposing Disease Descriptions for Enhanced Pathology Detection: A Multi-Aspect Vision-Language Pre-training Framework Vu Minh Hieu Phan Yutong Xie Yuankai Qi Lingqiao Liu Liyang Liu Bowen Zhang Zhibin Liao Qi Wu Minh Nguyen Nhat To Johan W. Verjans 64 11 0 12 Mar 2024
Leveraging Foundation Models for Content-Based Medical Image Retrieval in Radiology Stefan Denner David Zimmerer Dimitrios Bounias Markus Bujotzek Shuhan Xiao Lisa Kausch Philipp Schader Tobias Penzkofer Paul F. Jäger Klaus Maier-Hein VLM MedIm 29 8 0 11 Mar 2024
A Concept-based Interpretable Model for the Diagnosis of Choroid Neoplasias using Multimodal Data Yifan Wu Yang Liu Yue Yang Michael S. Yao Wenli Yang ... Yueming Liu James C. Gee Xuan Yang Wenbin Wei Shi Gu 27 3 0 08 Mar 2024
MedFLIP: Medical Vision-and-Language Self-supervised Fast Pre-Training with Masked Autoencoder Lei Li Tianfang Zhang Xinglin Zhang Jiaqi Liu Bingqi Ma Yan-chun Luo Tao Chen MedIm 40 0 0 07 Mar 2024
Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review Iryna Hartsock Ghulam Rasool 49 62 0 04 Mar 2024
CARZero: Cross-Attention Alignment for Radiology Zero-Shot Classification Haoran Lai Qingsong Yao Zihang Jiang Rongsheng Wang Zhiyang He Xiaodong Tao S. Kevin Zhou MedIm 40 12 0 27 Feb 2024
Mind the Modality Gap: Towards a Remote Sensing Vision-Language Model via Cross-modal Alignment Angelos Zavras Dimitrios Michail Begüm Demir Ioannis Papoutsis VLM 35 11 0 15 Feb 2024
Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learning Fudan Zheng Jindong Cao Weijiang Yu Zhiguang Chen Nong Xiao Yutong Lu VLM MedIm 21 16 0 06 Feb 2024
Exploring the Transferability of a Foundation Model for Fundus Images: Application to Hypertensive Retinopathy Julio Silva-Rodríguez Jihed Chelbi Waziha Kabir H. Chakor Jose Dolz Ismail Ben Ayed Riadh Kobbi MedIm 51 0 0 27 Jan 2024
Free Form Medical Visual Question Answering in Radiology Abhishek Narayanan Rushabh Musthyala Rahul Sankar A. Nistala P. Singh Jacopo Cirrone 15 2 0 23 Jan 2024
Enhancing medical vision-language contrastive learning via inter-matching relation modelling Mingjian Li Mingyuan Meng M. Fulham David Dagan Feng Lei Bi Jinman Kim VLM 42 1 0 19 Jan 2024
Developing ChatGPT for Biology and Medicine: A Complete Review of Biomedical Question Answering Qing Li Lei Li Yu Li LM&MA AI4MH 41 6 0 15 Jan 2024
Application Of Vision-Language Models For Assessing Osteoarthritis Disease Severity B. Felfeliyan Yuyue Zhou Shrimanti Ghosh Jessica Küpper Shaobo Liu A. Hareendranathan Jacob L. Jaremko 46 0 0 12 Jan 2024
Data-Centric Foundation Models in Computational Healthcare: A Survey Yunkun Zhang Jin Gao Zheling Tan Lingfeng Zhou Kexin Ding Mu Zhou Shaoting Zhang Dequan Wang AI4CE 37 22 0 04 Jan 2024
MLIP: Medical Language-Image Pre-training with Masked Local Representation Learning Jiarun Liu Hong-Yu Zhou Cheng Li Weijian Huang Hao Yang Yong Liang Shanshan Wang VLM 53 4 0 03 Jan 2024
AliFuse: Aligning and Fusing Multi-modal Medical Data for Computer-Aided Diagnosis Qiuhui Chen Yi Hong MedIm 20 1 0 02 Jan 2024
Backdoor Attack on Unpaired Medical Image-Text Foundation Models: A Pilot Study on MedCLIP Ruinan Jin Chun-Yin Huang Chenyu You Xiaoxiao Li AAML MedIm 30 2 0 01 Jan 2024
Revisiting Few-Shot Object Detection with Vision-Language Models Anish Madan Neehar Peri Shu Kong Deva Ramanan VLM 32 6 0 22 Dec 2023
UniChest: Conquer-and-Divide Pre-training for Multi-Source Chest X-Ray Classification Tianjie Dai Ruipeng Zhang Feng Hong Jiangchao Yao Ya-Qin Zhang Yanfeng Wang 38 8 0 18 Dec 2023
CLIP in Medical Imaging: A Comprehensive Survey Zihao Zhao Yuxiao Liu Han Wu Yonghao Li Sheng Wang L. Teng Disheng Liu Zhiming Cui Qian Wang Dinggang Shen CLIP MedIm LM&MA VLM 28 2 0 12 Dec 2023
TransMed: Large Language Models Enhance Vision Transformer for Biomedical Image Classification Kaipeng Zheng Weiran Huang Lichao Sun LM&MA MedIm VLM 29 0 0 12 Dec 2023
Medical Vision Language Pretraining: A survey Prashant Shrestha Sanskar Amgain Bidur Khanal Cristian A. Linte Binod Bhattarai VLM 34 14 0 11 Dec 2023
PneumoLLM: Harnessing the Power of Large Language Model for Pneumoconiosis Diagnosis Meiyue Song Zhihua Yu Weiwen Zhang Jiarui Wang Yuting Lu ... Nikolaos I. Kanellakis Jiangfeng Liu Jing Wang Binglu Wang Juntao Yang LM&MA 28 0 0 06 Dec 2023
MedXChat: A Unified Multimodal Large Language Model Framework towards CXRs Understanding and Generation Ling Yang Zhanyu Wang Zhenghao Chen Xinyu Liang Luping Zhou LM&MA MedIm 56 6 0 04 Dec 2023
Spatially Covariant Image Registration with Text Prompts Xiang Chen Min Liu Rongguang Wang Renjiu Hu Dongdong Liu Gaolei Li Hang Zhang MedIm 35 9 0 27 Nov 2023
LT-ViT: A Vision Transformer for multi-label Chest X-ray classification Umar Marikkar Sara Atito Muhammad Awais Adam Mahdi MedIm ViT 40 8 0 13 Nov 2023
Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review Mingze Yuan Peng Bao Jiajia Yuan Yunhao Shen Zi Chen ... Jie Zhao Yang Chen Li Zhang Lin Shen Bin Dong ELM LM&MA 46 13 0 03 Nov 2023
Sam-Guided Enhanced Fine-Grained Encoding with Mixed Semantic Learning for Medical Image Captioning Zhenyu Zhang Benlu Wang Weijie Liang Yizhi Li Xuechen Guo Guanhong Wang Shiyan Li Gaoang Wang MedIm LM&MA 19 7 0 02 Nov 2023
Are Natural Domain Foundation Models Useful for Medical Image Classification? Joana Palés Huix Adithya Raju Ganeshan Johan Fredin Haslum Magnus P Soderberg Christos Matsoukas Kevin Smith OOD MedIm VLM 24 30 0 30 Oct 2023
Foundational Models in Medical Imaging: A Comprehensive Survey and Future Vision Bobby Azad Reza Azad Sania Eskandari Afshin Bozorgpour A. Kazerouni I. Rekik Dorit Merhof VLM MedIm 98 59 0 28 Oct 2023
Large Language Models can Share Images, Too! Young-Jun Lee Dokyong Lee Joo Won Sung Jonghwan Hyeon Ho-Jin Choi MLLM 24 2 0 23 Oct 2023
C^2M-DoT: Cross-modal consistent multi-view medical report generation with domain transfer network Ruizhi Wang Xiang-Fei Wang Jie Zhou Thomas Lukasiewicz Zhenghua Xu 32 1 0 09 Oct 2023
BioBridge: Bridging Biomedical Foundation Models via Knowledge Graphs Zifeng Wang Zichen Wang Balasubramaniam Srinivasan V. Ioannidis Huzefa Rangwala Rishita Anubhai AI4CE 29 15 0 05 Oct 2023
Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Models An Yan Yu-Xiang Wang Yiwu Zhong Zexue He Petros Karypis ... Chengyu Dong Amilcare Gentili Chun-Nan Hsu Jingbo Shang Julian McAuley 27 30 0 04 Oct 2023
Fewshot learning on global multimodal embeddings for earth observation tasks Matt Allen Francisco Dorr Joseph A. Gallego-Mejia Laura Martínez-Ferrer Anna Jungbluth F. Kalaitzis Raúl Ramos-Pollán 25 8 0 29 Sep 2023
A Survey on Image-text Multimodal Models Ruifeng Guo Jingxuan Wei Linzhuang Sun Khai Le-Duc Guiyong Chang Dawei Liu Sibo Zhang Zhengbing Yao Mingjun Xu Liping Bu VLM 31 5 0 23 Sep 2023
Enhancing Representation in Radiography-Reports Foundation Model: A Granular Alignment Algorithm Using Masked Contrastive Learning Weijian Huang Cheng Li Hao Yang Jiarun Liu Shanshan Wang MedIm 26 20 0 12 Sep 2023
An Empirical Analysis for Zero-Shot Multi-Label Classification on COVID-19 CT Scans and Uncurated Reports Ethan Dack Lorenzo Brigato Matthew McMurray Matthias Fontanellaz Thomas Frauenfelder ... Thomas Geiser M. Funke-Chambour Andreas Christe L. Ebner S. Mougiakakou 22 2 0 04 Sep 2023
Exploring the Transfer Learning Capabilities of CLIP in Domain Generalization for Diabetic Retinopathy Sanoojan Baliah F. Maani Santosh Sanjeev M. H. Khan 48 8 0 27 Aug 2023