MedCLIP: Contrastive Learning from Unpaired Medical Images and Text

18 October 2022

Jimeng Sun

Papers citing "MedCLIP: Contrastive Learning from Unpaired Medical Images and Text"

50 / 244 papers shown

Title
Adaptive Concept Bottleneck for Foundation Models Under Distribution Shifts Jihye Choi Jayaram Raghuram Yixuan Li Somesh Jha 108 4 0 18 Dec 2024
Unlocking the Potential of Weakly Labeled Data: A Co-Evolutionary Learning Framework for Abnormality Detection and Report Generation Jinghan Sun Dong-mei Wei Zhe Xu Donghuan Lu Hong Liu Hong Wang Sotirios A. Tsaftaris Steven G. McDonagh Yefeng Zheng Liansheng Wang MedIm 100 0 0 18 Dec 2024
Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignments Mingjian Li Mingyuan Meng Shuchang Ye David Dagan Feng Lei Bi Jinman Kim 84 0 0 18 Dec 2024
NoteContrast: Contrastive Language-Diagnostic Pretraining for Medical Text Prajwal Kailas Max Homilius Rahul C. Deo Calum A. MacRae 101 0 0 16 Dec 2024
Integrating MedCLIP and Cross-Modal Fusion for Automatic Radiology Report Generation Qianhao Han Junyi Liu Zengchang Qin Zheng Zheng MedIm 74 2 0 10 Dec 2024
DiffCLIP: Few-shot Language-driven Multimodal Classifier Jiaqing Zhang Mingxiang Cao Xue Yang Kai Jiang Yunsong Li VLM 82 0 0 10 Dec 2024
Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions Kai Sun Siyan Xue F. Sun Haoran Sun Yu-Juan Luo ... Xinzhou Wang Lei Yang Shuo Jin Jun Yan Jiahong Dong AI4CE 76 2 0 03 Dec 2024
Take Your Steps: Hierarchically Efficient Pulmonary Disease Screening via CT Volume Compression Qian Shao Kai Zhang Bang Du Zehan Li YiXuan Wu Qiyuan Chen Jian Wu J. Chen Honghao Gao Hongxia Xu 69 0 0 02 Dec 2024
LQ-Adapter: ViT-Adapter with Learnable Queries for Gallbladder Cancer Detection from Ultrasound Image Chetan Madan Mayuna Gupta Soumen Basu Pankaj Gupta Chetan Arora 88 0 0 30 Nov 2024
DoubleCCA: Improving Foundation Model Group Robustness with Random Sentence Embeddings Hong Liu Yitong Lu 73 0 0 25 Nov 2024
MulModSeg: Enhancing Unpaired Multi-Modal Medical Image Segmentation with Modality-Conditioned Text Embedding and Alternating Training Chengyin Li Hui Zhu Rafi Ibn Sultan H. Bagher-Ebadian Prashant Khanduri Chetty Indrin Kundan Thind Dongxiao Zhu MedIm 80 1 0 23 Nov 2024
TAPT: Test-Time Adversarial Prompt Tuning for Robust Inference in Vision-Language Models Xin Wang Kai-xiang Chen Jiaming Zhang Jingjing Chen Xingjun Ma AAML VPVLM VLM 83 1 0 20 Nov 2024
A Multimodal Approach Combining Structural and Cross-domain Textual Guidance for Weakly Supervised OCT Segmentation Jiaqi Yang Nitish Mehta Xiaoling Hu Cheng Chen Chia-Ling Tsai 69 0 0 19 Nov 2024
Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Model Yiming Shi Xun Zhu Ying Hu Chenyi Guo Miao Li Ji Wu 77 1 0 19 Nov 2024
Transmission Line Defect Detection Based on UAV Patrol Images and Vision-language Pretraining Ke Zhang Zhaoye Zheng Yurong Guo Jiacun Wang Jiyuan Yang Yangjie Xiao VLM 79 0 0 18 Nov 2024
D-Cube: Exploiting Hyper-Features of Diffusion Model for Robust Medical Classification Minhee Jang Juheon Son Thanaporn Viriyasaranon Junho Kim Jang-Hwan Choi MedIm 31 0 0 17 Nov 2024
HIST-AID: Leveraging Historical Patient Reports for Enhanced Multi-Modal Automatic Diagnosis Haoxu Huang Cem M. Deniz K. Cho S. Chopra Divyam Madaan 29 1 0 16 Nov 2024
Multilingual Vision-Language Pre-training for the Remote Sensing Domain João Daniel Silva João Magalhães D. Tuia Bruno Martins CLIP VLM 42 1 0 30 Oct 2024
BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays Yang Zhou Tan Li Hui Faith Yanyu Xu Sicong Leng Xinxing Xu Yong Liu Rick Siow Mong Goh SSL VLM LM&MA MedIm 40 0 0 29 Oct 2024
A Perspective for Adapting Generalist AI to Specialized Medical AI Applications and Their Challenges Z. Wang Hanyin Wang Benjamin P. Danek Ying Li Christina Mack Hoifung Poon Y. Wang Pranav Rajpurkar Jiashuo Sun LM&MA 35 1 0 28 Oct 2024
Image-aware Evaluation of Generated Medical Reports Gefen Dawidowicz Elad Hirsch A. Tal 32 1 0 22 Oct 2024
Resource-Efficient Medical Report Generation using Large Language Models Abdullah Ameer Hamza Seong Tae Kim LM&MA MedIm 21 0 0 21 Oct 2024
Deep Generative Models Unveil Patterns in Medical Images Through Vision-Language Conditioning Xiaodan Xing Junzhi Ning Yang Nan Guang Yang MedIm 27 0 0 17 Oct 2024
Data Adaptive Few-shot Multi Label Segmentation with Foundation Model Gurunath Reddy D. Shanbhag Deepa Anand 26 0 0 13 Oct 2024
VoxelPrompt: A Vision-Language Agent for Grounded Medical Image Analysis Andrew Hoopes V. Butoi John Guttag Adrian V. Dalca MedIm LM&MA 35 1 0 10 Oct 2024
LLaVA Needs More Knowledge: Retrieval Augmented Natural Language Generation with Knowledge Graph for Explaining Thoracic Pathologies Ameer Hamza Abdullah Yong Hyun Ahn Sungyoung Lee Seong Tae Kim 24 2 0 07 Oct 2024
UlcerGPT: A Multimodal Approach Leveraging Large Language and Vision Models for Diabetic Foot Ulcer Image Transcription Reza Basiri Ali Abedi Chau Nguyen Milos R. Popovic Shehroz S. Khan LM&MA MedIm 36 1 0 02 Oct 2024
Segment as You Wish -- Free-Form Language-Based Segmentation for Medical Images Longchao Da Rui Wang Xiaojian Xu Parminder Bhatia Taha A. Kass-Hout Hua Wei Cao Xiao VLM MedIm 46 2 0 02 Oct 2024
AgriCLIP: Adapting CLIP for Agriculture and Livestock via Domain-Specialized Cross-Model Alignment Umair Nawaz Muhammad Awais Hanan Gani Muzammal Naseer Fahad Khan Salman Khan Rao Muhammad Anwer VLM CLIP 42 2 0 02 Oct 2024
Universal Medical Image Representation Learning with Compositional Decoders Kaini Wang Ling Yang Siping Zhou Guangquan Zhou Wentao Zhang Bin Cui Shuo Li SSL MedIm 31 0 0 30 Sep 2024
See Detail Say Clear: Towards Brain CT Report Generation via Pathological Clue-driven Representation Learning Chengxin Zheng Junzhong Ji Yanzhao Shi Xiaodan Zhang Liangqiong Qu 3DV MedIm 24 3 0 29 Sep 2024
MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentation Taha Koleilat Hojat Asgariandehkordi H. Rivaz Yiming Xiao MedIm VLM 43 6 0 28 Sep 2024
Multi-modal Medical Image Fusion For Non-Small Cell Lung Cancer Classification Salma Hassan Hamad Al Hammadi Ibrahim Mohammed Muhammad Haris Khan 37 0 0 27 Sep 2024
ZALM3: Zero-Shot Enhancement of Vision-Language Alignment via In-Context Information in Multi-Turn Multimodal Medical Dialogue Zhangpu Li Changhong Zou Suxue Ma Zhicheng Yang Chen Du ... Xingzhi Sun Jing Xiao Kai Zhang Mei Han Mei Han LM&MA 46 1 0 26 Sep 2024
Multi-View and Multi-Scale Alignment for Contrastive Language-Image Pre-training in Mammography Yuexi Du John Onofrey Nicha Dvornek VLM 50 1 0 26 Sep 2024
Vision-Language Model Fine-Tuning via Simple Parameter-Efficient Modification Ming Li J. Zhong Chenxin Li Liuzhuozheng Li Nie Lin Masashi Sugiyama CLIP VLM 28 4 0 25 Sep 2024
CLSP: High-Fidelity Contrastive Language-State Pre-training for Agent State Representation Fuxian Huang Qi Zhang Shaopeng Zhai Jie Wang Tianyi Zhang Haoran Zhang Ming Zhou Yu Liu Yu Qiao CLIP AI4TS 34 0 0 24 Sep 2024
ViKL: A Mammography Interpretation Framework via Multimodal Aggregation of Visual-knowledge-linguistic Features Xin Wei Yaling Tao Changde Du Gangming Zhao Yizhou Yu Jinpeng Li 33 0 0 24 Sep 2024
SEE: Semantically Aligned EEG-to-Text Translation Yitian Tao Yan Liang Luoyu Wang Yongqing Li Qing Yang Han Zhang 31 1 0 14 Sep 2024
Evaluating Pre-trained Convolutional Neural Networks and Foundation Models as Feature Extractors for Content-based Medical Image Retrieval A. Mahbod Nematollah Saeidi Sepideh Hatamikia Ramona Woitek VLM MedIm 31 2 0 14 Sep 2024
Do Vision Foundation Models Enhance Domain Generalization in Medical Image Segmentation? Kerem Cekmeceli Meva Himmetoglu G. I. Tombak A. Susmelj Ertunc Erdil E. Konukoglu MedIm 35 2 0 12 Sep 2024
Sam2Rad: A Segmentation Model for Medical Images with Learnable Prompts Assefa Seyoum Wahd B. Felfeliyan Yuyue Zhou Shrimanti Ghosh Adam McArthur Jiechen Zhang Jacob L. Jaremko A. Hareendranathan VLM MedIm 45 1 0 10 Sep 2024
MAGDA: Multi-agent guideline-driven diagnostic assistance D. Bani-Harouni Nassir Navab Matthias Keicher LM&MA 36 2 1 10 Sep 2024
Exploring Foundation Models for Synthetic Medical Imaging: A Study on Chest X-Rays and Fine-Tuning Techniques Davide Clode da Silva Marina Musse Bernardes Nathalia Giacomini Ceretta Gabriel Vaz de Souza Gabriel Fonseca Silva Rafael Heitor Bordini S. Musse MedIm LM&MA 31 0 0 06 Sep 2024
Few-shot Adaptation of Medical Vision-Language Models Fereshteh Shakeri Yunshi Huang Julio Silva-Rodríguez Houda Bahig An Tang Jose Dolz Ismail Ben Ayed VLM 36 2 0 05 Sep 2024
PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning Noor Hussein Fahad Shamshad Muzammal Naseer Karthik Nandakumar AAML 54 3 0 29 Aug 2024
Text-guided Foundation Model Adaptation for Long-Tailed Medical Image Classification Sirui Li Li Lin Yijin Huang Pujin Cheng Xiaoying Tang MedIm 42 1 0 27 Aug 2024
Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey Qika Lin Yifan Zhu Xin Mei Ling Huang Jingying Ma Kai He Zhen Peng Erik Cambria Mengling Feng 42 18 0 23 Aug 2024
XDT-CXR: Investigating Cross-Disease Transferability in Zero-Shot Binary Classification of Chest X-Rays Umaima Rahman Abhishek Basu Muhammad Uzair Khattak Aniq Ur Rahman MedIm 38 0 0 21 Aug 2024
BAPLe: Backdoor Attacks on Medical Foundational Models using Prompt Learning Asif Hanif Fahad Shamshad Muhammad Awais Muzammal Naseer F. Khan Karthik Nandakumar Salman Khan Rao Muhammad Anwer MedIm AAML 46 3 0 14 Aug 2024