v1v2 (latest)

Contrastive Learning of Medical Visual Representations from Paired Images and Text

2 October 2020

Yuhao Zhang

Hang Jiang

Yasuhide Miura

Christopher D. Manning

C. Langlotz

MedIm

ArXiv (abs)PDF HTML

Papers citing "Contrastive Learning of Medical Visual Representations from Paired Images and Text"

50 / 459 papers shown

Title
A Generalizable Deep Learning System for Cardiac MRI R. Shad C. Zakka Dhamanpreet Kaur R. Fong R. Filice ... Victor Ferrari Euan A. Ashley Michael A. Acker Curt P. Langlotz W. Hiesinger MedIm 86 2 0 01 Dec 2023
TLDR: Text Based Last-layer Retraining for Debiasing Image Classifiers Juhyeon Park Seokhyeon Jeong Taesup Moon 90 1 0 30 Nov 2023
Continual Self-supervised Learning: Towards Universal Multi-modal Medical Data Representation Learning Yiwen Ye Yutong Xie Jianpeng Zhang Ziyang Chen Qi Wu Yong-quan Xia CLL 64 18 0 29 Nov 2023
Unified Medical Image Pre-training in Language-Guided Common Semantic Space Xiaoxuan He Yifan Yang Xinyang Jiang Xufang Luo Haoji Hu Siyun Zhao Dongsheng Li Yuqing Yang Lili Qiu 78 2 0 24 Nov 2023
3D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology Asma Ben Abacha Alberto Santamaría-Pang Ho Hin Lee J. Merkow Qin Cai ... Julia Gong M. Lungren Thomas Lin Noel C. F. Codella Ivan Tarapov 63 5 0 23 Nov 2023
Multimodal Machine Learning in Image-Based and Clinical Biomedicine: Survey and Prospects Elisa Warner Joonsan Lee William Hsu Tanveer Syeda-Mahmood Charles Kahn Olivier Gevaert Arvind Rao LM&MA 91 11 0 04 Nov 2023
Robust Fine-Tuning of Vision-Language Models for Domain Generalization Kevin Vogt-Lowell Noah Lee Theodoros Tsiligkaridis Marc Vaillant VLM 85 4 0 03 Nov 2023
Sam-Guided Enhanced Fine-Grained Encoding with Mixed Semantic Learning for Medical Image Captioning Zhenyu Zhang Benlu Wang Weijie Liang Yizhi Li Xuechen Guo Guanhong Wang Shiyan Li Gaoang Wang MedIm LM&MA 34 9 0 02 Nov 2023
Are Natural Domain Foundation Models Useful for Medical Image Classification? Joana Palés Huix Adithya Raju Ganeshan Johan Fredin Haslum Magnus P Soderberg Christos Matsoukas Kevin Smith OOD MedIm VLM 87 34 0 30 Oct 2023
Fine tuning Pre trained Models for Robustness Under Noisy Labels Sumyeong Ahn Sihyeon Kim Jongwoo Ko SeYoung Yun AAML NoLa 121 8 0 24 Oct 2023
IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-training Che Liu Sibo Cheng Miaojing Shi Anand Shah Wenjia Bai Rossella Arcucci 94 27 0 11 Oct 2023
Utilizing Synthetic Data for Medical Vision-Language Pre-training: Bypassing the Need for Real Images Che Liu Anand Shah Wenjia Bai Rossella Arcucci MedIm 113 14 0 10 Oct 2023
Multi-domain improves out-of-distribution and data-limited scenarios for medical image analysis Ece Ozkan Xavier Boix OOD 46 0 0 10 Oct 2023
Data efficient deep learning for medical image analysis: A survey Suruchi Kumari Pravendra Singh 93 12 0 10 Oct 2023
C^2M-DoT: Cross-modal consistent multi-view medical report generation with domain transfer network Ruizhi Wang Xiang-Fei Wang Jie Zhou Thomas Lukasiewicz Zhenghua Xu 71 1 0 09 Oct 2023
Generalized Neural Collapse for a Large Number of Classes Jiachen Jiang Jinxin Zhou Peng Wang Qing Qu Dustin Mixon Chong You Zhihui Zhu AI4CE 82 28 0 09 Oct 2023
Dynamic Multi-Domain Knowledge Networks for Chest X-ray Report Generation Weihua Liu Youyuan Xue Chaochao Lin Said Boumaraf MedIm 44 0 0 08 Oct 2023
Continual Contrastive Spoken Language Understanding Umberto Cappellazzo Enrico Fini Muqiao Yang Daniele Falavigna Alessio Brutti Bhiksha Raj CLL 69 1 0 04 Oct 2023
Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP Zixiang Chen Yihe Deng Yuanzhi Li Quanquan Gu VLM 104 12 0 02 Oct 2023
PRIME: Prioritizing Interpretability in Failure Mode Extraction Keivan Rezaei Mehrdad Saberi Mazda Moayeri Soheil Feizi 80 8 0 29 Sep 2023
CWCL: Cross-Modal Transfer with Continuously Weighted Contrastive Loss R. S. Srinivasa Jaejin Cho Chouchang Yang Yashas Malur Saidutta Ching Hua Lee Yilin Shen Hongxia Jin VLM 63 10 0 26 Sep 2023
Exploiting CLIP-based Multi-modal Approach for Artwork Classification and Retrieval Alberto Baldrati Marco Bertini Tiberio Uricchio A. Bimbo CLIP VLM 35 1 0 21 Sep 2023
MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Learning via Interactive Perception Gyan Tatiya Jonathan M Francis Ho-Hsiang Wu Yonatan Bisk Jivko Sinapov 94 1 0 15 Sep 2023
UniBrain: Universal Brain MRI Diagnosis with Hierarchical Knowledge-enhanced Pre-training Jiayu Lei Lisong Dai Haoyun Jiang Chaoyi Wu Xiaoman Zhang ... Weidi Xie Yanyong Zhang Yuehua Li Ya Zhang Yanfeng Wang 71 11 0 13 Sep 2023
Enhancing Representation in Radiography-Reports Foundation Model: A Granular Alignment Algorithm Using Masked Contrastive Learning Weijian Huang Cheng Li Hao Yang Jiarun Liu Shanshan Wang MedIm 66 26 0 12 Sep 2023
InstructDiffusion: A Generalist Modeling Interface for Vision Tasks Zigang Geng Binxin Yang Tiankai Hang Chen Li Shuyang Gu ... Jianmin Bao Zheng Zhang Han Hu DongDong Chen Baining Guo DiffM VLM 118 107 0 07 Sep 2023
Distribution-Aware Prompt Tuning for Vision-Language Models Eulrang Cho Jooyeon Kim Hyunwoo J. Kim VPVLM VLM 59 23 0 06 Sep 2023
An Empirical Analysis for Zero-Shot Multi-Label Classification on COVID-19 CT Scans and Uncurated Reports Ethan Dack Lorenzo Brigato Matthew McMurray Matthias Fontanellaz Thomas Frauenfelder ... Thomas Geiser M. Funke-Chambour Andreas Christe L. Ebner Stavroula Mougiakakou 78 2 0 04 Sep 2023
Unified Pre-training with Pseudo Texts for Text-To-Image Person Re-identification Zhiyin Shao Xinyu Zhang Changxing Ding Jian Wang Jingdong Wang 95 19 0 04 Sep 2023
Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following Ziyu Guo Renrui Zhang Xiangyang Zhu Yiwen Tang Xianzheng Ma ... Ke Chen Peng Gao Xianzhi Li Hongsheng Li Pheng-Ann Heng MLLM 107 144 0 01 Sep 2023
Learning multi-modal generative models with permutation-invariant encoders and tighter variational bounds Marcel Hirt Domenico Campolo Victoria Leong Juan-Pablo Ortega DRL 89 0 0 01 Sep 2023
Exploring the Transfer Learning Capabilities of CLIP in Domain Generalization for Diabetic Retinopathy Sanoojan Baliah F. Maani Santosh Sanjeev M. H. Khan 68 8 0 27 Aug 2023
PECon: Contrastive Pretraining to Enhance Feature Alignment between CT and EHR Data for Improved Pulmonary Embolism Diagnosis Santosh Sanjeev Salwa K. Al Khatib Mai A. Shaaban Ibrahim Almakky Vijay Ram Papineni Mohammad Yaqub 66 1 0 27 Aug 2023
ViLLA: Fine-Grained Vision-Language Representation Learning from Real-World Data M. Varma Jean-Benoit Delbrouck Sarah Hooper Akshay S. Chaudhari C. Langlotz VLM CoGe 70 7 0 22 Aug 2023
A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision Julio Silva-Rodríguez H. Chakor Riadh Kobbi Jose Dolz Ismail Ben Ayed VLM MedIm 245 46 0 15 Aug 2023
Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Models K. Poudel Manish Dhakal Prasiddha Bhandari Rabin Adhikari Safal Thapaliya Bishesh Khanal VLM 144 20 0 15 Aug 2023
Seeing in Flowing: Adapting CLIP for Action Recognition with Motion Prompts Learning Qianqian Wang Junlong Du Ke Yan Shouhong Ding VLM 72 18 0 09 Aug 2023
ELIXR: Towards a general purpose X-ray artificial intelligence system through alignment of large language models and radiology vision encoders Shawn Xu Ling Yang Christopher J. Kelly M. Sieniek Timo Kohlberger ... Shruthi Prabhakara Daniel Golden Rory Pilgrim Krish Eswaran Andrew Sellergren LM&MA MedIm 100 55 0 02 Aug 2023
Sat2Cap: Mapping Fine-Grained Textual Descriptions from Satellite Images Aayush Dhakal Adeel Ahmad Subash Khanal Srikumar Sastry Hannah Kerner Nathan Jacobs 71 13 0 29 Jul 2023
Towards a Visual-Language Foundation Model for Computational Pathology Ming Y. Lu Bowen Chen Drew F. K. Williamson Richard J. Chen Ivy Liang ... Andrew Zhang L. Le Georg Gerber Anil V. Parwani Faisal Mahmood VLM MedIm 110 46 0 24 Jul 2023
PRIOR: Prototype Representation Joint Learning from Medical Images and Reports Pujin Cheng Li Lin Junyan Lyu Yijin Huang Wenhan Luo Xiaoying Tang MedIm 134 51 0 24 Jul 2023
Learning Navigational Visual Representations with Semantic Map Supervision Yicong Hong Yang Zhou Ruiyi Zhang Franck Dernoncourt Trung Bui Stephen Gould Hao Tan SSL 87 22 0 23 Jul 2023
Identifying Interpretable Subspaces in Image Representations Neha Kalibhat S. Bhardwaj Bayan Bruss Hamed Firooz Maziar Sanjabi Soheil Feizi FAtt 99 28 0 20 Jul 2023
M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimization Che Liu Sibo Cheng Chong Chen Mengyun Qiao Weitong Zhang Anand Shah Wenjia Bai Rossella Arcucci VLM 121 58 0 17 Jul 2023
A scoping review on multimodal deep learning in biomedical images and texts Zhaoyi Sun Mingquan Lin Qingqing Zhu Qianqian Xie Fei Wang Zhiyong Lu Yifan Peng 97 19 0 14 Jul 2023
Knowledge Boosting: Rethinking Medical Contrastive Vision-Language Pre-Training Xiaofei Chen Yuting He Cheng Xue Rongjun Ge Shuo Li Guanyu Yang VLM MedIm 85 13 0 14 Jul 2023
Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution Mostafa Dehghani Basil Mustafa Josip Djolonga Jonathan Heek Matthias Minderer ... Avital Oliver Piotr Padlewski A. Gritsenko Mario Luvcić N. Houlsby ViT 193 119 0 12 Jul 2023
Unified Medical Image-Text-Label Contrastive Learning With Continuous Prompt Yuhao Wang VLM MedIm 57 1 0 12 Jul 2023
FILM: How can Few-Shot Image Classification Benefit from Pre-Trained Language Models? Zihao Jiang Yunkai Dang Dong Pang Huishuai Zhang Weiran Huang VLM 89 2 0 09 Jul 2023
Dental CLAIRES: Contrastive LAnguage Image REtrieval Search for Dental Research Tanjida Kabir Luyao Chen Muhammad Walji Luca Giancardo Xiaoqian Jiang Shayan Shams 29 0 0 27 Jun 2023