v1v2 (latest)

Contrastive Learning of Medical Visual Representations from Paired Images and Text

2 October 2020

Yuhao Zhang

Hang Jiang

Yasuhide Miura

Christopher D. Manning

C. Langlotz

MedIm

ArXiv (abs)PDF HTML

Papers citing "Contrastive Learning of Medical Visual Representations from Paired Images and Text"

50 / 459 papers shown

Title
Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning Chong Ma Hanqi Jiang Wenting Chen Yiwei Li Zihao Wu ... Dajiang Zhu Tuo Zhang Dinggang Shen Tianming Liu Xiang Li 39 1 0 19 Mar 2024
N-Modal Contrastive Losses with Applications to Social Media Data in Trimodal Space William Theisen Walter J. Scheirer 59 1 0 18 Mar 2024
Model Reprogramming Outperforms Fine-tuning on Out-of-distribution Data in Text-Image Encoders Andrew Geng Pin-Yu Chen OODD 85 1 0 16 Mar 2024
Benchmarking Zero-Shot Robustness of Multimodal Foundation Models: A Pilot Study Chenguang Wang Ruoxi Jia Xin Liu Dawn Song VLM 80 8 0 15 Mar 2024
Improving Medical Multi-modal Contrastive Learning with Expert Annotations Yogesh Kumar Pekka Marttinen MedIm VLM 88 11 0 15 Mar 2024
RadCLIP: Enhancing Radiologic Image Analysis through Contrastive Language-Image Pre-training Zhixiu Lu Hailong Li N. Parikh Jonathan R. Dillman Lili He MedIm VLM 129 1 0 15 Mar 2024
MeDSLIP: Medical Dual-Stream Language-Image Pre-training with Pathology-Anatomy Semantic Alignment Wenrui Fan M. N. I. Suvon Shuo Zhou Xianyuan Liu S. Alabed V. Osmani Andrew J Swift Chen Chen Haiping Lu MedIm VLM LM&MA 108 3 0 15 Mar 2024
Anatomical Structure-Guided Medical Vision-Language Pre-training Qingqiu Li Xiaohan Yan Jilan Xu Runtian Yuan Yuejie Zhang Rui Feng Quanli Shen Xiaobo Zhang Shujun Wang 97 6 0 14 Mar 2024
CLIP-BEVFormer: Enhancing Multi-View Image-Based BEV Detector with Ground Truth Flow Chenbin Pan Burhaneddin Yaman Senem Velipasalar Liu Ren 101 11 0 13 Mar 2024
Decomposing Disease Descriptions for Enhanced Pathology Detection: A Multi-Aspect Vision-Language Pre-training Framework Vu Minh Hieu Phan Yutong Xie Yuankai Qi Lingqiao Liu Liyang Liu Bowen Zhang Zhibin Liao Qi Wu Minh-Son To Johan Verjans 128 14 0 12 Mar 2024
Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancement Che Liu Zhongwei Wan Ouyang Cheng Anand Shah Wenjia Bai Rossella Arcucci 90 33 0 11 Mar 2024
MedFLIP: Medical Vision-and-Language Self-supervised Fast Pre-Training with Masked Autoencoder Lei Li Tianfang Zhang Xinglin Zhang Jiaqi Liu Bingqi Ma Yan-chun Luo Tao Chen MedIm 81 0 0 07 Mar 2024
Enhancing Conceptual Understanding in Multimodal Contrastive Learning through Hard Negative Samples Philipp J. Rösch Norbert Oswald Michaela Geierhos Jindrich Libovický 75 4 0 05 Mar 2024
Time Weaver: A Conditional Time Series Generation Model Sai Shankar Narasimhan Shubhankar Agarwal Oguzhan Akcin Sujay Sanghavi Sandeep Chinchali DiffM MedIm 118 21 0 05 Mar 2024
Multimodal Learned Sparse Retrieval with Probabilistic Expansion Control Thong Nguyen Mariya Hendriksen Andrew Yates Maarten de Rijke 83 6 0 27 Feb 2024
CARZero: Cross-Attention Alignment for Radiology Zero-Shot Classification Zihang Jiang Qingsong Yao Zihang Jiang Rongsheng Wang Zhiyang He Xiaodong Tao S. Kevin Zhou MedIm 96 16 0 27 Feb 2024
Closing the AI generalization gap by adjusting for dermatology condition distribution differences across clinical settings R. Rikhye Aaron Loh G. Hong Preeti Singh M. A. Smith ... P. Bui Yuan Liu Yun-Hui Liu Justin M. Ko Steven Lin 41 1 0 23 Feb 2024
Beyond DAGs: A Latent Partial Causal Model for Multimodal Learning Yuhang Liu Zhen Zhang Dong Gong Erdun Gao Biwei Huang Anton Van Den Hengel Kun Zhang Javen Qinfeng Shi Javen Qinfeng Shi 87 7 0 09 Feb 2024
Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learning Fudan Zheng Jindong Cao Weijiang Yu Zhiguang Chen Nong Xiao Yutong Lu VLM MedIm 53 20 0 06 Feb 2024
MLIP: Enhancing Medical Visual Representation with Divergence Encoder and Knowledge-guided Contrastive Learning Zhe Li Laurence T. Yang Bocheng Ren Xin Nie Zhangyang Gao Cheng Tan Stan Z. Li VLM 75 16 0 03 Feb 2024
Next Visit Diagnosis Prediction via Medical Code-Centric Multimodal Contrastive EHR Modelling with Hierarchical Regularisation Heejoon Koo 115 3 0 22 Jan 2024
Enhancing the vision-language foundation model with key semantic knowledge-emphasized report refinement Cheng Li Weijian Huang Hao Yang Jiarun Liu Shanshan Wang MedIm 90 4 0 21 Jan 2024
Enhancing medical vision-language contrastive learning via inter-matching relation modelling Mingjian Li Mingyuan Meng M. Fulham David Dagan Feng Lei Bi Jinman Kim VLM 144 1 0 19 Jan 2024
Exploring scalable medical image encoders beyond text supervision Fernando Pérez-García Harshita Sharma Sam Bond-Taylor Kenza Bouzid Valentina Salvatelli ... Maria T. A. Wetscherek Noel C. F. Codella Stephanie L. Hyland Javier Alvarez-Valle Ozan Oktay LM&MA MedIm 139 9 0 19 Jan 2024
Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data Yuhui Zhang Elaine Sui Serena Yeung-Levy 85 10 0 16 Jan 2024
MICA: Towards Explainable Skin Lesion Diagnosis via Multi-Level Image-Concept Alignment Yequan Bie Luyang Luo Hao Chen 79 15 0 16 Jan 2024
Application Of Vision-Language Models For Assessing Osteoarthritis Disease Severity B. Felfeliyan Yuyue Zhou Shrimanti Ghosh Jessica Küpper Shaobo Liu A. Hareendranathan Jacob L. Jaremko 68 0 0 12 Jan 2024
Data-Centric Foundation Models in Computational Healthcare: A Survey Yunkun Zhang Jin Gao Zheling Tan Lingfeng Zhou Kexin Ding Mu Zhou Shaoting Zhang Dequan Wang AI4CE 113 25 0 04 Jan 2024
Multi-modal vision-language model for generalizable annotation-free pathology localization and clinical diagnosis Hao Yang Hong-Yu Zhou Zhihuan Li Yuanxu Gao Zhihuan Li ... Song Wu Tao Tan Hairong Zheng Kang Zhang Shanshan Wang 48 1 0 04 Jan 2024
MLIP: Medical Language-Image Pre-training with Masked Local Representation Learning Jiarun Liu Hong-Yu Zhou Cheng Li Weijian Huang Hao Yang Yong Liang Shanshan Wang VLM 105 6 0 03 Jan 2024
Enhancing Representation in Medical Vision-Language Foundation Models via Multi-Scale Information Extraction Techniques Weijian Huang Cheng Li Hong-Yu Zhou Jiarun Liu Hao Yang Yong Liang Guangming Shi Hairong Zheng Shanshan Wang 65 2 0 03 Jan 2024
Multimodal self-supervised learning for lesion localization Hao Yang Hong-Yu Zhou Cheng Li Weijian Huang Jiarun Liu Yong Liang Shanshan Wang SSL 65 3 0 03 Jan 2024
Freeze the backbones: A Parameter-Efficient Contrastive Approach to Robust Medical Vision-Language Pre-training Jiuming Qin Che Liu Sibo Cheng Yike Guo Rossella Arcucci VLM MedIm 45 6 0 02 Jan 2024
Leveraging Open-Vocabulary Diffusion to Camouflaged Instance Segmentation Tuan-Anh Vu Duc Thanh Nguyen Qing Guo Binh-Son Hua N. Chung Ivor W. Tsang Sai-Kit Yeung DiffM 78 3 0 29 Dec 2023
Masked Contrastive Reconstruction for Cross-modal Medical Image-Report Retrieval Zeqiang Wei Kai Jin Xiuzhuang Zhou MedIm 70 5 0 26 Dec 2023
Joint Self-Supervised and Supervised Contrastive Learning for Multimodal MRI Data: Towards Predicting Abnormal Neurodevelopment Zhiyuan Li Hailong Li Anca L. Ralescu Jonathan R. Dillman M. Altaye Kim M. Cecil N. Parikh Lili He 68 2 0 22 Dec 2023
ECAMP: Entity-centered Context-aware Medical Vision Language Pre-training Rongsheng Wang Qingsong Yao Zihang Jiang Zhiyang He Xiaodong Tao Zihang Jiang S.Kevin Zhou MedIm VLM 110 6 0 20 Dec 2023
Synergistic Anchored Contrastive Pre-training for Few-Shot Relation Extraction Da Luo Yanglei Gan Rui Hou Run Lin Qiao Liu Yuxiang Cai Wannian Gao 77 6 0 19 Dec 2023
UniDCP: Unifying Multiple Medical Vision-language Tasks via Dynamic Cross-modal Learnable Prompts Chenlu Zhan Yufei Zhang Yu Lin Gaoang Wang Hongwei Wang VLM MedIm 87 5 0 18 Dec 2023
UniChest: Conquer-and-Divide Pre-training for Multi-Source Chest X-Ray Classification Tianjie Dai Ruipeng Zhang Feng Hong Jiangchao Yao Ya Zhang Yanfeng Wang 114 13 0 18 Dec 2023
CLDR: Contrastive Learning Drug Response Models from Natural Language Supervision Kun Li Wenbin Hu MedIm 54 1 0 17 Dec 2023
Event-Based Contrastive Learning for Medical Time Series Hyewon Jeong Nassim Oufattole Matthew B. A. McDermott Aparna Balagopalan P. Chandak Marzyeh Ghassemi Collin M. Stultz 88 6 0 16 Dec 2023
Text-Guided Face Recognition using Multi-Granularity Cross-Modal Contrastive Learning Md Golam Moula Mehedi Hasan S. Sami Nasser M. Nasrabadi 65 6 0 14 Dec 2023
Fine-Grained Image-Text Alignment in Medical Imaging Enables Explainable Cyclic Image-Report Generation Wenting Chen Linlin Shen Jingyang Lin Jiebo Luo Xiang Li Yixuan Yuan MedIm 88 12 0 13 Dec 2023
Foundation Models in Robotics: Applications, Challenges, and the Future Roya Firoozi Johnathan Tucker Stephen Tian Anirudha Majumdar Jiankai Sun ... Brian Ichter Danny Driess Jiajun Wu Cewu Lu Mac Schwager LM&Ro AI4CE LRM VLM 108 161 0 13 Dec 2023
A Foundational Multimodal Vision Language AI Assistant for Human Pathology Ming Y. Lu Bowen Chen Drew F. K. Williamson Richard J. Chen Kenji Ikamura ... Ivy Liang L. Le Tong Ding Anil V. Parwani Faisal Mahmood MedIm LM&MA 86 23 0 13 Dec 2023
CLIP in Medical Imaging: A Comprehensive Survey Zihao Zhao Yuxiao Liu Han Wu Yonghao Li Sheng Wang L. Teng Disheng Liu Zhiming Cui Qian Wang Dinggang Shen CLIP MedIm LM&MA VLM 156 43 0 12 Dec 2023
Multimodal Pretraining of Medical Time Series and Notes Ryan N. King Tianbao Yang Bobak J. Mortazavi 59 14 0 11 Dec 2023
Medical Vision Language Pretraining: A survey Prashant Shrestha Sanskar Amgain Bidur Khanal Cristian A. Linte Binod Bhattarai VLM 94 17 0 11 Dec 2023
G2D: From Global to Dense Radiography Representation Learning via Vision-Language Pre-training Che Liu Ouyang Cheng Sibo Cheng Anand Shah Wenjia Bai Rossella Arcucci VLM MedIm 105 10 0 03 Dec 2023