Multimodal Contrastive Training for Visual Representation Learning

26 April 2021

Papers citing "Multimodal Contrastive Training for Visual Representation Learning"

34 / 34 papers shown

Title
R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts Zhongyang Li Ziyue Li Dinesh Manocha MoE 53 0 0 27 Feb 2025
Stealthy Backdoor Attack in Self-Supervised Learning Vision Encoders for Large Vision Language Models Zhaoyi Liu Huan Zhang AAML 86 0 0 25 Feb 2025
Code and Pixels: Multi-Modal Contrastive Pre-training for Enhanced Tabular Data Analysis Kankana Roy Lars Krämer Sebastian Domaschke Malik Haris Roland Aydin Fabian Isensee Martin Held 48 0 0 13 Jan 2025
Keypoint Aware Masked Image Modelling Madhava Krishna Convin.AI 75 0 0 03 Jan 2025
An Information Criterion for Controlled Disentanglement of Multimodal Data Chenyu Wang Sharut Gupta Xinyi Zhang Sana Tonekaboni Stefanie Jegelka Tommi Jaakkola Caroline Uhler DRL 42 1 0 31 Oct 2024
Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentation Kun Yuan V. Srivastav Nassir Navab N. Padoy 59 7 0 30 Sep 2024
What to align in multimodal contrastive learning? Benoit Dufumier J. Castillo-Navarro D. Tuia Jean-Philippe Thiran 36 3 0 11 Sep 2024
Towards Precision Healthcare: Robust Fusion of Time Series and Image Data Ali Rasekh Reza Heidari Amir Hosein Haji Mohammad Rezaie Parsa Sharifi Sedeh Zahra Ahmadi Prasenjit Mitra Wolfgang Nejdl AI4TS 31 2 0 24 May 2024
Harmony: A Joint Self-Supervised and Weakly-Supervised Framework for Learning General Purpose Visual Representations Mohammed Baharoon Jonathan Klein D. L. Michels SSL VLM 44 0 0 23 May 2024
FACTUAL: A Novel Framework for Contrastive Learning Based Robust SAR Image Classification Xu Wang Tian Ye Rajgopal Kannan Viktor Prasanna AAML 40 1 0 04 Apr 2024
Separating common from salient patterns with Contrastive Representation Learning Robin Louiset Edouard Duchesnay Antoine Grigis Pietro Gori SSL DRL 46 1 0 19 Feb 2024
Multimodal Visual-Tactile Representation Learning through Self-Supervised Contrastive Pre-Training Vedant Dave Fotios Lygerakis Elmar Rueckert SSL 35 18 0 22 Jan 2024
How do Cross-View and Cross-Modal Alignment Affect Representations in Contrastive Learning? Thomas M. Hehn Julian F. P. Kooij D. Gavrila SSL 26 0 0 23 Nov 2022
ContextCLIP: Contextual Alignment of Image-Text pairs on CLIP visual representations Chanda Grover Indra Deep Mastan Debayan Gupta VLM CLIP 24 4 0 14 Nov 2022
Beyond Instance Discrimination: Relation-aware Contrastive Self-supervised Learning Yifei Zhang Chang-rui Liu Yu Zhou Weiping Wang QiXiang Ye Xiangyang Ji SSL ISeg BDL 26 6 0 02 Nov 2022
Unsupervised Cross-Modality Domain Adaptation for Vestibular Schwannoma Segmentation and Koos Grade Prediction based on Semi-Supervised Contrastive Learning Luyi Han Yunzhi Huang T. Tan R. Mann 27 7 0 09 Oct 2022
ERNIE-ViL 2.0: Multi-view Contrastive Learning for Image-Text Pre-training Bin Shan Weichong Yin Yu Sun Hao Tian Hua Wu Haifeng Wang VLM 27 19 0 30 Sep 2022
SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning Wei Han Hui Chen Zhen Hai Soujanya Poria Lidong Bing 66 16 0 12 Sep 2022
Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection Gaoang Wang Yibing Zhan Xinchao Wang Min-Gyoo Song K. Nahrstedt 27 11 0 24 Jul 2022
e-CLIP: Large-Scale Vision-Language Representation Learning in E-commerce Wonyoung Shin Jonghun Park Taekang Woo Yongwoo Cho Kwangjin Oh Hwanjun Song VLM 35 16 0 01 Jul 2022
Stain Based Contrastive Co-training for Histopathological Image Analysis Bodong Zhang Beatrice Knudsen Deepika Sirohi Alessandro Ferrero Tolga Tasdizen SSL 31 5 0 24 Jun 2022
CyCLIP: Cyclic Contrastive Language-Image Pretraining Shashank Goel Hritik Bansal S. Bhatia Ryan A. Rossi Vishwa Vinay Aditya Grover CLIP VLM 184 134 0 28 May 2022
VLCDoC: Vision-Language Contrastive Pre-Training Model for Cross-Modal Document Classification Souhail Bakkali Zuheng Ming Mickael Coustaty Marccal Rusinol O. R. Terrades VLM 54 30 0 24 May 2022
Brainish: Formalizing A Multimodal Language for Intelligence and Consciousness Paul Pu Liang 30 4 0 14 Apr 2022
CLMLF:A Contrastive Learning and Multi-Layer Fusion Method for Multimodal Sentiment Detection Zhen Li Bing Xu Conghui Zhu Tiejun Zhao 46 71 0 12 Apr 2022
MVP: Multimodality-guided Visual Pre-training Longhui Wei Lingxi Xie Wen-gang Zhou Houqiang Li Qi Tian 37 106 0 10 Mar 2022
Deep Unsupervised Contrastive Hashing for Large-Scale Cross-Modal Text-Image Retrieval in Remote Sensing Georgii Mikriukov Mahdyar Ravanbakhsh Begüm Demir 29 39 0 20 Jan 2022
SLIP: Self-supervision meets Language-Image Pre-training Norman Mu Alexander Kirillov David Wagner Saining Xie VLM CLIP 63 481 0 23 Dec 2021
Overcoming the Domain Gap in Neural Action Representations Semih Günel Florian Aymanns S. Honari Pavan Ramdya Pascal Fua 33 3 0 02 Dec 2021
Extract Free Dense Labels from CLIP Chong Zhou Chen Change Loy Bo Dai VLM CLIP 54 456 0 02 Dec 2021
Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labeling Dat T. Huynh Jason Kuen Zhe-nan Lin Jiuxiang Gu Ehsan Elhamifar ISeg VLM 30 84 0 24 Nov 2021
Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm Yangguang Li Feng Liang Lichen Zhao Yufeng Cui Wanli Ouyang Jing Shao F. Yu Junjie Yan VLM CLIP 50 448 0 11 Oct 2021
SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation Xin Wang Yasheng Wang Fei Mi Pingyi Zhou Yao Wan Xiao Liu Li Li Hao Wu Jin Liu Xin Jiang 39 113 0 10 Aug 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 281 3,378 0 09 Mar 2020