Contrastive Learning of Medical Visual Representations from Paired Images and Text

2 October 2020

Yuhao Zhang

Hang Jiang

Yasuhide Miura

Christopher D. Manning

C. Langlotz

MedIm

ArXiv PDF HTML

Papers citing "Contrastive Learning of Medical Visual Representations from Paired Images and Text"

50 / 445 papers shown

Title
Closing the AI generalization gap by adjusting for dermatology condition distribution differences across clinical settings R. Rikhye Aaron Loh G. Hong Preeti Singh M. A. Smith ... P. Bui Yuan Liu Yun-Hui Liu Justin M. Ko Steven Lin 27 1 0 23 Feb 2024
Beyond DAGs: A Latent Partial Causal Model for Multimodal Learning Yuhang Liu Zhen Zhang Dong Gong Erdun Gao Biwei Huang Anton Van Den Hengel Kun Zhang Javen Qinfeng Shi Javen Qinfeng Shi 49 7 0 09 Feb 2024
Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learning Fudan Zheng Jindong Cao Weijiang Yu Zhiguang Chen Nong Xiao Yutong Lu VLM MedIm 29 16 0 06 Feb 2024
MLIP: Enhancing Medical Visual Representation with Divergence Encoder and Knowledge-guided Contrastive Learning Zhe Li Laurence T. Yang Bocheng Ren Xin Nie Zhangyang Gao Cheng Tan Stan Z. Li VLM 15 12 0 03 Feb 2024
Next Visit Diagnosis Prediction via Medical Code-Centric Multimodal Contrastive EHR Modelling with Hierarchical Regularisation Heejoon Koo 34 3 0 22 Jan 2024
Enhancing the vision-language foundation model with key semantic knowledge-emphasized report refinement Cheng Li Weijian Huang Hao Yang Jiarun Liu Shanshan Wang MedIm 34 4 0 21 Jan 2024
Enhancing medical vision-language contrastive learning via inter-matching relation modelling Mingjian Li Mingyuan Meng M. Fulham David Dagan Feng Lei Bi Jinman Kim VLM 48 1 0 19 Jan 2024
Exploring scalable medical image encoders beyond text supervision Fernando Pérez-García Harshita Sharma Sam Bond-Taylor Kenza Bouzid Valentina Salvatelli ... Maria T. A. Wetscherek Noel C. F. Codella Stephanie L. Hyland Javier Alvarez-Valle Ozan Oktay LM&MA MedIm 50 9 0 19 Jan 2024
Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data Yuhui Zhang Elaine Sui Serena Yeung-Levy 39 9 0 16 Jan 2024
MICA: Towards Explainable Skin Lesion Diagnosis via Multi-Level Image-Concept Alignment Yequan Bie Luyang Luo Hao Chen 38 14 0 16 Jan 2024
Application Of Vision-Language Models For Assessing Osteoarthritis Disease Severity B. Felfeliyan Yuyue Zhou Shrimanti Ghosh Jessica Küpper Shaobo Liu A. Hareendranathan Jacob L. Jaremko 46 0 0 12 Jan 2024
Data-Centric Foundation Models in Computational Healthcare: A Survey Yunkun Zhang Jin Gao Zheling Tan Lingfeng Zhou Kexin Ding Mu Zhou Shaoting Zhang Dequan Wang AI4CE 39 22 0 04 Jan 2024
Multi-modal vision-language model for generalizable annotation-free pathology localization and clinical diagnosis Hao Yang Hong-Yu Zhou Zhihuan Li Yuanxu Gao Zhihuan Li ... Song Wu Tao Tan Hairong Zheng Kang Zhang Shanshan Wang 34 1 0 04 Jan 2024
MLIP: Medical Language-Image Pre-training with Masked Local Representation Learning Jiarun Liu Hong-Yu Zhou Cheng Li Weijian Huang Hao Yang Yong Liang Shanshan Wang VLM 53 4 0 03 Jan 2024
Enhancing Representation in Medical Vision-Language Foundation Models via Multi-Scale Information Extraction Techniques Weijian Huang Cheng Li Hong-Yu Zhou Jiarun Liu Hao Yang Yong Liang Guangming Shi Hairong Zheng Shanshan Wang 38 2 0 03 Jan 2024
Multimodal self-supervised learning for lesion localization Hao Yang Hong-Yu Zhou Cheng Li Weijian Huang Jiarun Liu Yong Liang Shanshan Wang SSL 32 3 0 03 Jan 2024
Freeze the backbones: A Parameter-Efficient Contrastive Approach to Robust Medical Vision-Language Pre-training Jiuming Qin Che Liu Sibo Cheng Yike Guo Rossella Arcucci VLM MedIm 28 5 0 02 Jan 2024
Leveraging Open-Vocabulary Diffusion to Camouflaged Instance Segmentation Tuan-Anh Vu Duc Thanh Nguyen Qing Guo Binh-Son Hua N. Chung Ivor W. Tsang Sai-Kit Yeung DiffM 37 3 0 29 Dec 2023
Masked Contrastive Reconstruction for Cross-modal Medical Image-Report Retrieval Zeqiang Wei Kai Jin Xiuzhuang Zhou MedIm 24 5 0 26 Dec 2023
Joint Self-Supervised and Supervised Contrastive Learning for Multimodal MRI Data: Towards Predicting Abnormal Neurodevelopment Zhiyuan Li Hailong Li Anca L. Ralescu Jonathan R. Dillman M. Altaye Kim M. Cecil N. Parikh Lili He 34 2 0 22 Dec 2023
ECAMP: Entity-centered Context-aware Medical Vision Language Pre-training Rongsheng Wang Qingsong Yao Haoran Lai Zhiyang He Xiaodong Tao Zihang Jiang S.Kevin Zhou VLM MedIm 55 6 0 20 Dec 2023
Synergistic Anchored Contrastive Pre-training for Few-Shot Relation Extraction Da Luo Yanglei Gan Rui Hou Run Lin Qiao Liu Yuxiang Cai Wannian Gao 21 5 0 19 Dec 2023
UniDCP: Unifying Multiple Medical Vision-language Tasks via Dynamic Cross-modal Learnable Prompts Chenlu Zhan Yufei Zhang Yu Lin Gaoang Wang Hongwei Wang VLM MedIm 37 5 0 18 Dec 2023
UniChest: Conquer-and-Divide Pre-training for Multi-Source Chest X-Ray Classification Tianjie Dai Ruipeng Zhang Feng Hong Jiangchao Yao Ya Zhang Yanfeng Wang 38 8 0 18 Dec 2023
CLDR: Contrastive Learning Drug Response Models from Natural Language Supervision Kun Li Wenbin Hu MedIm 20 1 0 17 Dec 2023
Event-Based Contrastive Learning for Medical Time Series Hyewon Jeong Nassim Oufattole Matthew B. A. McDermott Aparna Balagopalan P. Chandak Marzyeh Ghassemi Collin M. Stultz 23 4 0 16 Dec 2023
Text-Guided Face Recognition using Multi-Granularity Cross-Modal Contrastive Learning Md Golam Moula Mehedi Hasan S. Sami Nasser M. Nasrabadi 31 4 0 14 Dec 2023
Fine-Grained Image-Text Alignment in Medical Imaging Enables Explainable Cyclic Image-Report Generation Wenting Chen Linlin Shen Jingyang Lin Jiebo Luo Xiang Li Yixuan Yuan MedIm 26 10 0 13 Dec 2023
Foundation Models in Robotics: Applications, Challenges, and the Future Roya Firoozi Johnathan Tucker Stephen Tian Anirudha Majumdar Jiankai Sun ... Brian Ichter Danny Driess Jiajun Wu Cewu Lu Mac Schwager LM&Ro AI4CE LRM VLM 37 142 0 13 Dec 2023
A Foundational Multimodal Vision Language AI Assistant for Human Pathology Ming Y. Lu Bowen Chen Drew F. K. Williamson Richard J. Chen Kenji Ikamura ... Ivy Liang L. Le Tong Ding Anil V. Parwani Faisal Mahmood MedIm LM&MA 26 20 0 13 Dec 2023
CLIP in Medical Imaging: A Comprehensive Survey Zihao Zhao Yuxiao Liu Han Wu Yonghao Li Sheng Wang L. Teng Disheng Liu Zhiming Cui Qian Wang Dinggang Shen CLIP MedIm LM&MA VLM 31 43 0 12 Dec 2023
Multimodal Pretraining of Medical Time Series and Notes Ryan N. King Tianbao Yang Bobak J. Mortazavi 27 12 0 11 Dec 2023
Medical Vision Language Pretraining: A survey Prashant Shrestha Sanskar Amgain Bidur Khanal Cristian A. Linte Binod Bhattarai VLM 34 14 0 11 Dec 2023
G2D: From Global to Dense Radiography Representation Learning via Vision-Language Pre-training Che Liu Ouyang Cheng Sibo Cheng Anand Shah Wenjia Bai Rossella Arcucci VLM MedIm 35 8 0 03 Dec 2023
A Generalizable Deep Learning System for Cardiac MRI R. Shad C. Zakka Dhamanpreet Kaur R. Fong R. Filice ... Victor Ferrari Euan A. Ashley Michael A. Acker Curt P. Langlotz W. Hiesinger MedIm 57 1 0 01 Dec 2023
TLDR: Text Based Last-layer Retraining for Debiasing Image Classifiers Juhyeon Park Seokhyeon Jeong Taesup Moon 41 1 0 30 Nov 2023
Continual Self-supervised Learning: Towards Universal Multi-modal Medical Data Representation Learning Yiwen Ye Yutong Xie Jianpeng Zhang Ziyang Chen Qi Wu Yong-quan Xia CLL 34 14 0 29 Nov 2023
Unified Medical Image Pre-training in Language-Guided Common Semantic Space Xiaoxuan He Yifan Yang Xinyang Jiang Xufang Luo Haoji Hu Siyun Zhao Dongsheng Li Yuqing Yang Lili Qiu 46 1 0 24 Nov 2023
3D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology Asma Ben Abacha Alberto Santamaría-Pang Ho Hin Lee J. Merkow Qin Cai ... Julia Gong M. Lungren Thomas Lin Noel C. F. Codella Ivan Tarapov 31 5 0 23 Nov 2023
Multimodal Machine Learning in Image-Based and Clinical Biomedicine: Survey and Prospects Elisa Warner Joonsan Lee William Hsu T. Syeda-Mahmood Charles Kahn Olivier Gevaert Arvind Rao LM&MA 24 6 0 04 Nov 2023
Robust Fine-Tuning of Vision-Language Models for Domain Generalization Kevin Vogt-Lowell Noah Lee Theodoros Tsiligkaridis Marc Vaillant VLM 39 4 0 03 Nov 2023
Sam-Guided Enhanced Fine-Grained Encoding with Mixed Semantic Learning for Medical Image Captioning Zhenyu Zhang Benlu Wang Weijie Liang Yizhi Li Xuechen Guo Guanhong Wang Shiyan Li Gaoang Wang MedIm LM&MA 24 7 0 02 Nov 2023
Are Natural Domain Foundation Models Useful for Medical Image Classification? Joana Palés Huix Adithya Raju Ganeshan Johan Fredin Haslum Magnus P Soderberg Christos Matsoukas Kevin Smith OOD MedIm VLM 24 30 0 30 Oct 2023
Fine tuning Pre trained Models for Robustness Under Noisy Labels Sumyeong Ahn Sihyeon Kim Jongwoo Ko SeYoung Yun AAML NoLa 35 5 0 24 Oct 2023
IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-training Che Liu Sibo Cheng Miaojing Shi Anand Shah Wenjia Bai Rossella Arcucci 24 26 0 11 Oct 2023
Utilizing Synthetic Data for Medical Vision-Language Pre-training: Bypassing the Need for Real Images Che Liu Anand Shah Wenjia Bai Rossella Arcucci MedIm 40 12 0 10 Oct 2023
Multi-domain improves out-of-distribution and data-limited scenarios for medical image analysis Ece Ozkan Xavier Boix OOD 28 0 0 10 Oct 2023
Data efficient deep learning for medical image analysis: A survey Suruchi Kumari Pravendra Singh 40 12 0 10 Oct 2023
C^2M-DoT: Cross-modal consistent multi-view medical report generation with domain transfer network Ruizhi Wang Xiang-Fei Wang Jie Zhou Thomas Lukasiewicz Zhenghua Xu 32 1 0 09 Oct 2023
Generalized Neural Collapse for a Large Number of Classes Jiachen Jiang Jinxin Zhou Peng Wang Qing Qu Dustin Mixon Chong You Zhihui Zhu AI4CE 34 24 0 09 Oct 2023