v1v2 (latest)

Contrastive Learning of Medical Visual Representations from Paired Images and Text

2 October 2020

Yuhao Zhang

Hang Jiang

Yasuhide Miura

Christopher D. Manning

C. Langlotz

MedIm

ArXiv (abs)PDF HTML

Papers citing "Contrastive Learning of Medical Visual Representations from Paired Images and Text"

50 / 459 papers shown

Title
Quilt-1M: One Million Image-Text Pairs for Histopathology Wisdom O. Ikezogwo M. S. Seyfioglu Fatemeh Ghezloo Dylan Stefan Chan Geva Fatwir Sheikh Mohammed Pavan Kumar Anand Ranjay Krishna Linda G. Shapiro CLIP VLM 343 125 0 20 Jun 2023
RemoteCLIP: A Vision Language Foundation Model for Remote Sensing Fan Liu Delong Chen Zhan-Rong Guan Xiaocong Zhou Jiale Zhu Qiaolin Ye Liyong Fu Jun Zhou VLM 170 224 0 19 Jun 2023
Generation of Radiology Findings in Chest X-Ray by Leveraging Collaborative Knowledge Manuela Danu George Marica Sanjeev Kumar Karn Bogdan Georgescu Awais Mansoor ... Lucian Mihai Itu C. Suciu Sasa Grbic Oladimeji Farri Dorin Comaniciu MedIm 64 8 0 18 Jun 2023
M3PT: A Multi-Modal Model for POI Tagging Jingsong Yang Guanzhou Han Deqing Yang Jingping Liu Yanghua Xiao Xiang Xu Baohua Wu Shenghua Ni 93 3 0 16 Jun 2023
Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Images Ming Y. Lu Bowen Chen Andrew Zhang Drew F. K. Williamson Richard J. Chen Tong Ding L. Le Yung-Sung Chuang Faisal Mahmood VLM MedIm 208 102 0 13 Jun 2023
Retrieval-Enhanced Contrastive Vision-Text Models Ahmet Iscen Mathilde Caron Alireza Fathi Cordelia Schmid CLIP VLM 111 28 0 12 Jun 2023
Augmenting Zero-Shot Detection Training with Image Labels Katharina Kornmeier Ulla Scheler P. Herrmann ObjD VLM 49 1 0 12 Jun 2023
Multi-modal Pre-training for Medical Vision-language Understanding and Generation: An Empirical Study with A New Benchmark Li Xu Bo Liu Ameer Hamza Khan Lu Fan Xiao-Ming Wu LM&MA 65 9 0 10 Jun 2023
On the Challenges and Perspectives of Foundation Models for Medical Image Analysis Shaoting Zhang Dimitris N. Metaxas LM&MA VLM MedIm AI4CE 106 154 0 09 Jun 2023
Generative Text-Guided 3D Vision-Language Pretraining for Unified Medical Image Segmentation Yinda Chen Che Liu Wei-Ping Huang Sibo Cheng Rossella Arcucci Zhiwei Xiong VLM MedIm 70 50 0 07 Jun 2023
On the Generalization of Multi-modal Contrastive Learning Qi Zhang Yifei Wang Yisen Wang 79 26 0 07 Jun 2023
Exploring the Versatility of Zero-Shot CLIP for Interstitial Lung Disease Classification Cara Van Uden Christian Blüthgen Maayane Attias M. Polacin H. Guo N. Simha Rishi Raj C. Langlotz VLM 45 2 0 01 Jun 2023
Continual Learning for Abdominal Multi-Organ and Tumor Segmentation Yixiao Zhang Xinyi Li Huimiao Chen Alan Yuille Yaoyao Liu Zongwei Zhou CLL 102 36 0 01 Jun 2023
Additional Positive Enables Better Representation Learning for Medical Images Dewen Zeng Yawen Wu Xinrong Hu Xiaowei Xu Jingtong Hu Yiyu Shi SSL 72 1 0 31 May 2023
Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Bias Zhongwei Wan Che Liu Mi Zhang Jie Fu Benyou Wang Sibo Cheng Lei Ma César Quilodrán-Casas Rossella Arcucci 106 77 0 31 May 2023
BiomedGPT: A Unified and Generalist Biomedical Generative Pre-trained Transformer for Vision, Language, and Multimodal Tasks Kai Zhang Jun Yu Eashan Adhikarla Rong Zhou Zhilin Yan ... Xun Chen Yong Chen Quanzheng Li Hongfang Liu Lichao Sun LM&MA MedIm 103 185 0 26 May 2023
Three Towers: Flexible Contrastive Learning with Pretrained Image Models Jannik Kossen Mark Collier Basil Mustafa Tianlin Li Xiaohua Zhai Lucas Beyer Andreas Steiner Jesse Berent Rodolphe Jenatton Efi Kokiopoulou VLM 67 13 0 26 May 2023
Text-to-Motion Retrieval: Towards Joint Understanding of Human Motion Data and Natural Language Nicola Messina J. Sedmidubský Fabrizio Falchi Tomávs Rebok EGVM 61 12 0 25 May 2023
T2TD: Text-3D Generation Model based on Prior Knowledge Guidance Weizhi Nie Ruidong Chen Weijie Wang Bruno Lepri N. Sebe 74 6 0 25 May 2023
Clinically Labeled Contrastive Learning for OCT Biomarker Classification Kiran Kokilepersaud Stephanie Trejo Corona Mohit Prabhushankar Ghassan Al-Regib C. Wykoff 77 13 0 24 May 2023
Meta-learning For Vision-and-language Cross-lingual Transfer Hanxu Hu Frank Keller VLM 78 2 0 24 May 2023
S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captions Sangwoo Mo Minkyu Kim Kyungmin Lee Jinwoo Shin VLM CLIP 128 25 0 23 May 2023
Connecting Multi-modal Contrastive Representations Zehan Wang Yang Zhao Xize Cheng Haifeng Huang Jiageng Liu ... Lin Li Yongqiang Wang Aoxiong Yin Ziang Zhang Zhou Zhao 60 25 0 22 May 2023
Not All Semantics are Created Equal: Contrastive Self-supervised Learning with Automatic Temperature Individualization Zimeng Qiu Quanqi Hu Zhuoning Yuan Denny Zhou Lijun Zhang Tianbao Yang 97 21 0 19 May 2023
How to Train Your CheXDragon: Training Chest X-Ray Models for Transfer to Novel Tasks and Healthcare Systems Cara Van Uden Jeremy Irvin Mars Huang N. Dean J. Carr A. Ng C. Langlotz OOD 56 1 0 13 May 2023
Multi-task Paired Masking with Alignment Modeling for Medical Vision-Language Pre-training Kecheng Zhang Shuai Liu Jun Yu Han Jiang Jianping Fan Qing-An Huang Weidong Han MedIm 78 33 0 13 May 2023
An Inverse Scaling Law for CLIP Training Xianhang Li Zeyu Wang Cihang Xie VLM CLIP 115 58 0 11 May 2023
CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representations Gengchen Mai Ni Lao Yutong He Jiaming Song Stefano Ermon 130 63 0 01 May 2023
Molecule-Morphology Contrastive Pretraining for Transferable Molecular Representation Cuong Q. Nguyen Dante A. Pertusi K. Branson AI4CE 37 13 0 27 Apr 2023
Sample-Specific Debiasing for Better Image-Text Models Peiqi Wang Yingcheng Liu Ching-Yun Ko W. Wells Seth Berkowitz Steven Horng Polina Golland SSL MedIm 111 1 0 25 Apr 2023
Is Cross-modal Information Retrieval Possible without Training? Hyunjin Choi HyunJae Lee Seongho Joe Youngjune Gwon 40 1 0 20 Apr 2023
Multimodal Representation Learning of Cardiovascular Magnetic Resonance Imaging Jielin Qiu Peide Huang Makiya Nakashima Jae-Hyeok Lee Jiacheng Zhu ... Byung-Hak Kim Debbie Kwon Douglas Weber Ding Zhao David Chen SSL 70 6 0 16 Apr 2023
MvCo-DoT:Multi-View Contrastive Domain Transfer Network for Medical Report Generation Ruizhi Wang Xiang-Fei Wang Zhenghua Xu Wenting Xu Junyang Chen Thomas Lukasiewicz 52 6 0 15 Apr 2023
CamDiff: Camouflage Image Augmentation via Diffusion Model Xuejiao Luo Shuo Wang Zongwei Wu Daniel Gehrig Yun Cheng Deng-Ping Fan Luc Van Gool DiffM 81 19 0 11 Apr 2023
ELVIS: Empowering Locality of Vision Language Pre-training with Intra-modal Similarity Sumin Seo Jaewoong Shin Jaewoo Kang Tae Soo Kim Thijs Kooi 45 1 0 11 Apr 2023
CAVL: Learning Contrastive and Adaptive Representations of Vision and Language Shentong Mo Jingfei Xia Ihor Markevych CLIP VLM 55 1 0 10 Apr 2023
AToMiC: An Image/Text Retrieval Test Collection to Support Multimedia Content Creation Jheng-Hong Yang Carlos Lassance Rafael Sampaio de Rezende Krishna Srinivasan Miriam Redi Stéphane Clinchant Jimmy J. Lin 83 12 0 04 Apr 2023
SPAN: Learning Similarity between Scene Graphs and Images with Transformers Yuren Cong Wentong Liao Bodo Rosenhahn M. Yang 102 6 0 02 Apr 2023
Self-Supervised Multimodal Learning: A Survey Yongshuo Zong Oisin Mac Aodha Timothy M. Hospedales SSL 125 50 0 31 Mar 2023
Trade-offs in Fine-tuned Diffusion Models Between Accuracy and Interpretability Mischa Dombrowski Hadrien Reynaud Johanna P. Müller Matthew Baugh Bernhard Kainz MedIm 57 7 0 31 Mar 2023
Vision-Language Modelling For Radiological Imaging and Reports In The Low Data Regime Rhydian Windsor A. Jamaludin T. Kadir Andrew Zisserman VLM 73 11 0 30 Mar 2023
Sigmoid Loss for Language Image Pre-Training Xiaohua Zhai Basil Mustafa Alexander Kolesnikov Lucas Beyer CLIP VLM 298 1,206 0 27 Mar 2023
WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation Jongheon Jeong Yang Zou Taewan Kim Dongqing Zhang Avinash Ravichandran Onkar Dabeer VLM 138 210 0 26 Mar 2023
Local Contrastive Learning for Medical Image Recognition S. A. Rizvi Ruixiang Tang X. Jiang X. Ma X. Hu 93 6 0 24 Mar 2023
Xplainer: From X-Ray Observations to Explainable Zero-Shot Diagnosis Chantal Pellegrini Matthias Keicher Ege Özsoy Petra Jirásková R. Braren Nassir Navab MedIm 53 22 0 23 Mar 2023
MEDIMP: 3D Medical Images with clinical Prompts from limited tabular data for renal transplantation Léo Milecki Vicky Kalogeiton Sylvain Bodard D. Anglicheau J. Correas M. Timsit Maria Vakalopoulou MedIm 67 4 0 22 Mar 2023
cTBLS: Augmenting Large Language Models with Conversational Tables Anirudh S. Sundar Larry Heck LMTD 65 9 0 21 Mar 2023
CLIP-ReIdent: Contrastive Training for Player Re-Identification Konrad Habel Fabian Deuser Norbert Oswald 42 12 0 21 Mar 2023
LIMITR: Leveraging Local Information for Medical Image-Text Representation Gefen Dawidowicz Elad Hirsch A. Tal 78 15 0 21 Mar 2023
Large AI Models in Health Informatics: Applications, Challenges, and the Future Jianing Qiu Lin Li Jiankai Sun Jiachuan Peng Peilun Shi ... Bo Xiao Wu Yuan Ningli Wang Dong Xu Benny Lo AI4MH LM&MA 114 140 0 21 Mar 2023