Contrastive Learning of Medical Visual Representations from Paired Images and Text

2 October 2020

Yuhao Zhang

Hang Jiang

Yasuhide Miura

Christopher D. Manning

C. Langlotz

MedIm

ArXiv PDF HTML

Papers citing "Contrastive Learning of Medical Visual Representations from Paired Images and Text"

50 / 445 papers shown

Title
Three Towers: Flexible Contrastive Learning with Pretrained Image Models Jannik Kossen Mark Collier Basil Mustafa Tianlin Li Xiaohua Zhai Lucas Beyer Andreas Steiner Jesse Berent Rodolphe Jenatton Efi Kokiopoulou VLM 45 11 0 26 May 2023
Text-to-Motion Retrieval: Towards Joint Understanding of Human Motion Data and Natural Language Nicola Messina J. Sedmidubský Fabrizio Falchi Tomávs Rebok EGVM 34 10 0 25 May 2023
T2TD: Text-3D Generation Model based on Prior Knowledge Guidance Weizhi Nie Ruidong Chen Weijie Wang Bruno Lepri N. Sebe 35 4 0 25 May 2023
Clinically Labeled Contrastive Learning for OCT Biomarker Classification Kiran Kokilepersaud Stephanie Trejo Corona Mohit Prabhushankar Ghassan Al-Regib C. Wykoff 23 13 0 24 May 2023
Meta-learning For Vision-and-language Cross-lingual Transfer Hanxu Hu Frank Keller VLM 31 1 0 24 May 2023
S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captions Sangwoo Mo Minkyu Kim Kyungmin Lee Jinwoo Shin VLM CLIP 44 21 0 23 May 2023
Connecting Multi-modal Contrastive Representations Zehan Wang Yang Zhao Xize Cheng Haifeng Huang Jiageng Liu ... Lin Li Yongqiang Wang Aoxiong Yin Ziang Zhang Zhou Zhao 30 22 0 22 May 2023
Not All Semantics are Created Equal: Contrastive Self-supervised Learning with Automatic Temperature Individualization Zimeng Qiu Quanqi Hu Zhuoning Yuan Denny Zhou Lijun Zhang Tianbao Yang 34 17 0 19 May 2023
How to Train Your CheXDragon: Training Chest X-Ray Models for Transfer to Novel Tasks and Healthcare Systems Cara Van Uden Jeremy Irvin Mars Huang N. Dean J. Carr A. Ng C. Langlotz OOD 32 1 0 13 May 2023
Multi-task Paired Masking with Alignment Modeling for Medical Vision-Language Pre-training Kecheng Zhang Jing Zhang Jun Yu Han Jiang Jianping Fan Qing-An Huang Weidong Han MedIm 38 29 0 13 May 2023
An Inverse Scaling Law for CLIP Training Xianhang Li Zeyu Wang Cihang Xie VLM CLIP 48 55 0 11 May 2023
CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representations Gengchen Mai Ni Lao Yutong He Jiaming Song Stefano Ermon 86 58 0 01 May 2023
Molecule-Morphology Contrastive Pretraining for Transferable Molecular Representation Cuong Q. Nguyen Dante A. Pertusi K. Branson AI4CE 16 12 0 27 Apr 2023
Sample-Specific Debiasing for Better Image-Text Models Peiqi Wang Yingcheng Liu Ching-Yun Ko W. Wells Seth Berkowitz Steven Horng Polina Golland SSL MedIm 22 1 0 25 Apr 2023
Is Cross-modal Information Retrieval Possible without Training? Hyunjin Choi HyunJae Lee Seongho Joe Youngjune Gwon 17 0 0 20 Apr 2023
Multimodal Representation Learning of Cardiovascular Magnetic Resonance Imaging Jielin Qiu Peide Huang Makiya Nakashima Jae-Hyeok Lee Jiacheng Zhu ... Byung-Hak Kim Debbie Kwon Douglas Weber Ding Zhao David Chen SSL 27 5 0 16 Apr 2023
MvCo-DoT:Multi-View Contrastive Domain Transfer Network for Medical Report Generation Ruizhi Wang Xiang-Fei Wang Zhenghua Xu Wenting Xu Junyang Chen Thomas Lukasiewicz 21 5 0 15 Apr 2023
CamDiff: Camouflage Image Augmentation via Diffusion Model Xuejiao Luo Shuo Wang Zongwei Wu Daniel Gehrig Yun Cheng Deng-Ping Fan Luc Van Gool DiffM 36 19 0 11 Apr 2023
ELVIS: Empowering Locality of Vision Language Pre-training with Intra-modal Similarity Sumin Seo Jaewoong Shin Jaewoo Kang Tae Soo Kim Thijs Kooi 32 1 0 11 Apr 2023
CAVL: Learning Contrastive and Adaptive Representations of Vision and Language Shentong Mo Jingfei Xia Ihor Markevych CLIP VLM 16 1 0 10 Apr 2023
AToMiC: An Image/Text Retrieval Test Collection to Support Multimedia Content Creation Jheng-Hong Yang Carlos Lassance Rafael Sampaio de Rezende Krishna Srinivasan Miriam Redi S. Clinchant Jimmy J. Lin 42 12 0 04 Apr 2023
SPAN: Learning Similarity between Scene Graphs and Images with Transformers Yuren Cong Wentong Liao Bodo Rosenhahn M. Yang 35 6 0 02 Apr 2023
Self-Supervised Multimodal Learning: A Survey Yongshuo Zong Oisin Mac Aodha Timothy M. Hospedales SSL 24 43 0 31 Mar 2023
Trade-offs in Fine-tuned Diffusion Models Between Accuracy and Interpretability Mischa Dombrowski Hadrien Reynaud Johanna P. Müller Matthew Baugh Bernhard Kainz MedIm 24 6 0 31 Mar 2023
Vision-Language Modelling For Radiological Imaging and Reports In The Low Data Regime Rhydian Windsor A. Jamaludin T. Kadir Andrew Zisserman VLM 27 11 0 30 Mar 2023
Sigmoid Loss for Language Image Pre-Training Xiaohua Zhai Basil Mustafa Alexander Kolesnikov Lucas Beyer CLIP VLM 36 960 0 27 Mar 2023
WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation Jongheon Jeong Yang Zou Taewan Kim Dongqing Zhang Avinash Ravichandran O. Dabeer VLM 75 186 0 26 Mar 2023
Local Contrastive Learning for Medical Image Recognition S. A. Rizvi Ruixiang Tang X. Jiang X. Ma X. Hu 33 6 0 24 Mar 2023
Xplainer: From X-Ray Observations to Explainable Zero-Shot Diagnosis Chantal Pellegrini Matthias Keicher Ege Özsoy Petra Jirásková R. Braren Nassir Navab MedIm 15 20 0 23 Mar 2023
MEDIMP: 3D Medical Images with clinical Prompts from limited tabular data for renal transplantation Léo Milecki Vicky Kalogeiton Sylvain Bodard D. Anglicheau J. Correas M. Timsit Maria Vakalopoulou MedIm 22 4 0 22 Mar 2023
cTBLS: Augmenting Large Language Models with Conversational Tables Anirudh S. Sundar Larry Heck LMTD 23 7 0 21 Mar 2023
CLIP-ReIdent: Contrastive Training for Player Re-Identification Konrad Habel Fabian Deuser Norbert Oswald 11 9 0 21 Mar 2023
LIMITR: Leveraging Local Information for Medical Image-Text Representation Gefen Dawidowicz Elad Hirsch A. Tal 31 15 0 21 Mar 2023
Large AI Models in Health Informatics: Applications, Challenges, and the Future Jianing Qiu Lin Li Jiankai Sun Jiachuan Peng Peilun Shi ... Bo Xiao Wu Yuan Ningli Wang Dong Xu Benny Lo AI4MH LM&MA 42 127 0 21 Mar 2023
MXM-CLR: A Unified Framework for Contrastive Learning of Multifold Cross-Modal Representations Ye Wang Bo‐Shu Jiang C. Zou Rui Ma 32 5 0 20 Mar 2023
Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generation Mingjie Li Bingqian Lin Zicong Chen Haokun Lin Xiaodan Liang Xiaojun Chang MedIm 25 108 0 18 Mar 2023
Identifiability Results for Multimodal Contrastive Learning Imant Daunhawer Alice Bizeul Emanuele Palumbo Alexander Marx Julia E. Vogt 37 38 0 16 Mar 2023
Understanding and Constructing Latent Modality Structures in Multi-modal Representation Learning Qian Jiang Changyou Chen Han Zhao Liqun Chen Q. Ping S. D. Tran Yi Xu Belinda Zeng Trishul Chilimbi 49 39 0 10 Mar 2023
Enhancing Activity Prediction Models in Drug Discovery with the Ability to Understand Human Language Philipp Seidl Andreu Vall Sepp Hochreiter G. Klambauer 65 37 0 06 Mar 2023
ConTEXTual Net: A Multimodal Vision-Language Model for Segmentation of Pneumothorax Zachary Huemann Xin Tie Junjie Hu Tyler Bradshaw 17 14 0 02 Mar 2023
Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Images Xiaoman Zhang Chaoyi Wu Ya Zhang Yanfeng Wang Weidi Xie MedIm 44 121 0 27 Feb 2023
Knowledge-infused Contrastive Learning for Urban Imagery-based Socioeconomic Prediction Yu Liu Xin Zhang Jingtao Ding Yanxin Xi Yong Li 19 34 0 25 Feb 2023
Test-Time Distribution Normalization for Contrastively Learned Vision-language Models Yi Zhou Juntao Ren Fengyu Li Ramin Zabih Ser-Nam Lim VLM 34 14 0 22 Feb 2023
Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts Zhihong Chen Shizhe Diao Benyou Wang Guanbin Li Xiang Wan MedIm 25 29 0 17 Feb 2023
Multi-modal Machine Learning in Engineering Design: A Review and Future Directions Binyang Song Ruilin Zhou Faez Ahmed AI4CE 37 40 0 14 Feb 2023
NYCU-TWO at Memotion 3: Good Foundation, Good Teacher, then you have Good Meme Analysis Yu-Chien Tang Kuang-Da Wang Ting-Yun Ou Wenjie Peng 14 2 0 13 Feb 2023
A Review of Predictive and Contrastive Self-supervised Learning for Medical Images Wei-Chien Wang Euijoon Ahn Da-wei Feng Jinman Kim MedIm 27 27 0 10 Feb 2023
Diagnosing and Rectifying Vision Models using Language Yuhui Zhang Jeff Z. HaoChen Shih-Cheng Huang Kuan-Chieh Jackson Wang James Zou Serena Yeung 37 45 0 08 Feb 2023
Effective Robustness against Natural Distribution Shifts for Models with Different Training Data Zhouxing Shi Nicholas Carlini Ananth Balashankar Ludwig Schmidt Cho-Jui Hsieh Alex Beutel Yao Qin OOD 23 9 0 02 Feb 2023
Advancing Radiograph Representation Learning with Masked Record Modeling Hong-Yu Zhou Chenyu Lian Lian-cheng Wang Yizhou Yu MedIm 38 55 0 30 Jan 2023