Contrastive Learning of Medical Visual Representations from Paired Images and Text

2 October 2020

Yuhao Zhang

Hang Jiang

Yasuhide Miura

Christopher D. Manning

C. Langlotz

MedIm

ArXiv PDF HTML

Papers citing "Contrastive Learning of Medical Visual Representations from Paired Images and Text"

45 / 445 papers shown

Title
Joint Learning of Localized Representations from Medical Images and Reports Philipp Muller Georgios Kaissis Cong Zou Daniel Munich 140 81 0 06 Dec 2021
Overcoming the Domain Gap in Neural Action Representations Semih Günel Florian Aymanns S. Honari Pavan Ramdya Pascal Fua 31 3 0 02 Dec 2021
Sound-Guided Semantic Image Manipulation Seung Hyun Lee Wonseok Roh Wonmin Byeon Sang Ho Yoon Chanyoung Kim Jinkyu Kim Sangpil Kim DiffM 30 43 0 30 Nov 2021
An implementation of the "Guess who?" game using CLIP Arnau Martí-Sarri V. Rodríguez-Fernández CLIP MLLM VLM 28 0 0 30 Nov 2021
Overcoming the Domain Gap in Contrastive Learning of Neural Action Representations Semih Günel Florian Aymanns S. Honari Pavan Ramdya Pascal Fua SSL 36 0 0 29 Nov 2021
LAFITE: Towards Language-Free Training for Text-to-Image Generation Yufan Zhou Ruiyi Zhang Changyou Chen Chunyuan Li Chris Tensmeyer Tong Yu Jiuxiang Gu Jinhui Xu Tong Sun VLM 35 163 0 27 Nov 2021
ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Genetics Aiham Taleb Matthias Kirchler Remo Monti C. Lippert SSL MedIm 36 54 0 26 Nov 2021
Combined Scaling for Zero-shot Transfer Learning Hieu H. Pham Zihang Dai Golnaz Ghiasi Kenji Kawaguchi Hanxiao Liu ... Yi-Ting Chen Minh-Thang Luong Yonghui Wu Mingxing Tan Quoc V. Le VLM 17 194 0 19 Nov 2021
LiT: Zero-Shot Transfer with Locked-image text Tuning Xiaohua Zhai Tianlin Li Basil Mustafa Andreas Steiner Daniel Keysers Alexander Kolesnikov Lucas Beyer VLM 48 543 0 15 Nov 2021
Deep AUC Maximization for Medical Image Classification: Challenges and Opportunities Tianbao Yang 30 3 0 01 Nov 2021
Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm Yangguang Li Feng Liang Lichen Zhao Yufeng Cui Wanli Ouyang Jing Shao F. Yu Junjie Yan VLM CLIP 50 446 0 11 Oct 2021
Pre-trained Language Models in Biomedical Domain: A Systematic Survey Benyou Wang Qianqian Xie Jiahuan Pei Zhihong Chen Prayag Tiwari Zhao Li Jie Fu LM&MA AI4CE 37 163 0 11 Oct 2021
SCEHR: Supervised Contrastive Learning for Clinical Risk Prediction using Electronic Health Records Chengxi Zang Fei Wang 25 15 0 11 Oct 2021
Contrastive Video-Language Segmentation Chen Liang Yawei Luo Yu Wu Yi Yang VLM VOS 9 1 0 29 Sep 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 64 691 0 04 Sep 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 348 2,271 0 02 Sep 2021
Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning Christos Theodoropoulos James Henderson Andrei Catalin Coman Marie-Francine Moens 27 15 0 02 Sep 2021
LocTex: Learning Data-Efficient Visual Representations from Localized Textual Supervision Zhijian Liu Simon Stent Jie Li John Gideon Song Han VLM 25 10 0 26 Aug 2021
Unsupervised Local Discrimination for Medical Images Huai Chen Renzhen Wang Xiuying Wang Jieyu Li Qu Fang Hui Li Jianhao Bai Qing Peng Deyu Meng Lisheng Wang SSL 20 7 0 21 Aug 2021
Semi-weakly Supervised Contrastive Representation Learning for Retinal Fundus Images Boon Peng Yap B. Ng SSL 36 3 0 04 Aug 2021
Exploiting the relationship between visual and textual features in social networks for image classification with zero-shot deep learning Luis Lucas David Tomás Jose Garcia-Rodriguez VLM CLIP 13 5 0 08 Jul 2021
Challenges for machine learning in clinical translation of big data imaging studies Nicola K. Dinsdale Emma Bluemke V. Sundaresan M. Jenkinson Stephen Smith Ana I. L. Namburete AI4CE 37 41 0 07 Jul 2021
Poisoning and Backdooring Contrastive Learning Nicholas Carlini Andreas Terzis 46 156 0 17 Jun 2021
MERLOT: Multimodal Neural Script Knowledge Models Rowan Zellers Ximing Lu Jack Hessel Youngjae Yu J. S. Park Jize Cao Ali Farhadi Yejin Choi VLM LRM 24 372 0 04 Jun 2021
Recent advances and clinical applications of deep learning in medical image analysis Xuxin Chen Ximing Wang Kecheng Zhang K. Fung T. Thai K. Moore Robert S. Mannel Hong Liu B. Zheng Y. Qiu OOD 18 572 0 27 May 2021
AC-CovidNet: Attention Guided Contrastive CNN for Recognition of Covid-19 in Chest X-Ray Images Anirudh Ambati S. Dubey OOD 27 6 0 21 May 2021
Data-Efficient Language-Supervised Zero-Shot Learning with Self-Distillation Rui Cheng Bichen Wu Peizhao Zhang Peter Vajda Joseph E. Gonzalez CLIP VLM 21 31 0 18 Apr 2021
Exploring Visual Engagement Signals for Representation Learning Menglin Jia Zuxuan Wu A. Reiter Claire Cardie Serge Belongie Ser-Nam Lim 21 13 0 15 Apr 2021
Patient Contrastive Learning: a Performant, Expressive, and Practical Approach to ECG Modeling N. Diamant Erik Reinertsen S. Song Aaron D Aguirre Collin M. Stultz P. Batra 29 40 0 09 Apr 2021
Modern Hopfield Networks for Few- and Zero-Shot Reaction Template Prediction Philipp Seidl Philipp Renz N. Dyubankova Paulo Neves Jonas Verhoeven Marwin H. S. Segler J. Wegner Sepp Hochreiter G. Klambauer 33 17 0 07 Apr 2021
Contrastive Learning of Single-Cell Phenotypic Representations for Treatment Classification A. Perakis A. Gorji Samriddhi Jain K. Chaitanya Simone Rizza E. Konukoglu SSL 21 33 0 30 Mar 2021
Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays Xiaosong Wang Ziyue Xu Leo K. Tam Dong Yang Daguang Xu ViT MedIm 22 23 0 30 Mar 2021
Let Your Heart Speak in its Mother Tongue: Multilingual Captioning of Cardiac Signals Dani Kiyasseh T. Zhu David A. Clifton 27 0 0 19 Mar 2021
Multimodal Representation Learning via Maximization of Local Mutual Information Ruizhi Liao Daniel Moyer Miriam Cha Keegan Quigley Seth Berkowitz Steven Horng Polina Golland W. Wells SSL 21 41 0 08 Mar 2021
Medical Imaging and Machine Learning R. Shad John P. Cunningham Euan A. Ashley C. Langlotz W. Hiesinger 18 41 0 02 Mar 2021
Predicting post-operative right ventricular failure using video-based deep learning R. Shad Nicolas Quach R. Fong P. Kasinpila C. Bowles ... Y. Woo J. Teuteberg John P. Cunningham C. Langlotz W. Hiesinger 22 40 0 28 Feb 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 174 27,772 0 26 Feb 2021
MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretation Yen Nhi Truong Vu Richard Wang N. Balachandar Can Liu A. Ng Pranav Rajpurkar 21 81 0 21 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 337 3,708 0 11 Feb 2021
Big Self-Supervised Models Advance Medical Image Classification Shekoofeh Azizi Basil Mustafa Fiona Ryan Zach Beaver Jan Freyberg ... Alan Karthikesalingam Simon Kornblith Ting-Li Chen Vivek Natarajan Mohammad Norouzi SSL 39 504 0 13 Jan 2021
Pneumonia Detection on Chest X-ray using Radiomic Features and Contrastive Learning Yan Han Chongyan Chen Ahmed H. Tewfik Ying Ding Yifan Peng LM&MA 38 39 0 12 Jan 2021
Contrastive Learning Improves Critical Event Prediction in COVID-19 Patients Tingyi Wanyan Hossein Honarvar S. Jaladanki Chengxi Zang Nidhi Naik ... Marinka Zitnik Ariful Azad Fei Wang Ying Ding Benjamin S. Glicksberg 21 0 0 11 Jan 2021
CROCS: Clustering and Retrieval of Cardiac Signals Based on Patient Disease Class, Sex, and Age Dani Kiyasseh T. Zhu David A. Clifton 25 9 0 28 Nov 2020
Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation Yasuhide Miura Yuhao Zhang Emily Bao Tsai C. Langlotz Dan Jurafsky MedIm 160 156 0 20 Oct 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 279 3,375 0 09 Mar 2020