Skin Lesion Phenotyping via Nested Multi-modal Contrastive Learning

29 May 2025

Dionysis Christopoulos

Sotiris Spanos

Eirini Baltzi

Valsamis Ntouskos

Konstantinos Karantzalos

ArXiv PDF HTML

Papers citing "Skin Lesion Phenotyping via Nested Multi-modal Contrastive Learning"

30 / 30 papers shown

Title
CoMP: Continual Multimodal Pre-training for Vision Foundation Models Yuxiao Chen L. Meng Wujian Peng Zuxuan Wu Yu-Gang Jiang VLM 109 1 0 24 Mar 2025
TRACE: Transformer-based Risk Assessment for Clinical Evaluation Dionysis Christopoulos Sotiris Spanos Valsamis Ntouskos Konstantinos Karantzalos MedIm 100 1 0 13 Nov 2024
Continual Self-supervised Learning: Towards Universal Multi-modal Medical Data Representation Learning Yiwen Ye Yutong Xie Jianpeng Zhang Ziyang Chen Qi Wu Yong-quan Xia CLL 41 16 0 29 Nov 2023
Towards Concept-based Interpretability of Skin Lesion Diagnosis using Vision-Language Models Cristiano Patrício Luís F. Teixeira João C. Neves 29 7 0 24 Nov 2023
Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-Series Yihe Wang Yu Han Haishuai Wang Xiang Zhang AI4TS 54 48 0 21 Oct 2023
Subclass-balancing Contrastive Learning for Long-tailed Recognition Chengkai Hou Jieyu Zhang Hong Wang Dinesh Manocha 48 22 0 28 Jun 2023
DINOv2: Learning Robust Visual Features without Supervision Maxime Oquab Timothée Darcet Théo Moutakanni Huy Q. Vo Marc Szafraniec ... Hervé Jégou Julien Mairal Patrick Labatut Armand Joulin Piotr Bojanowski VLM CLIP SSL 233 3,205 0 14 Apr 2023
Hierarchical discriminative learning improves visual representations of biomedical microscopy Cheng Jiang X. Hou A. Kondepudi Asadur Chowdury C. Freudiger D. Orringer Honglak Lee Todd C. Hollon 55 13 0 02 Mar 2023
Towards Geospatial Foundation Models via Continual Pretraining Matías Mendieta Boran Han Xingjian Shi Yi Zhu Chen Chen VLM AI4CE 58 69 0 09 Feb 2023
TFormer: A throughout fusion transformer for multi-modal skin lesion diagnosis Yilan Zhang Feng-ying Xie Jianqing Chen MedIm 28 34 0 21 Nov 2022
ASIF: Coupled Data Turns Unimodal Models to Multimodal Without Training Antonio Norelli Marco Fumero Valentino Maiorca Luca Moschella Emanuele Rodolà Francesco Locatello VLM 89 35 0 04 Oct 2022
A survey, review, and future trends of skin lesion segmentation and classification M. Hasan Md. Asif Ahamad Choon Hwai Yap Guang Yang 50 89 0 25 Aug 2022
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers Zhiliang Peng Li Dong Hangbo Bao QiXiang Ye Furu Wei 38 314 0 12 Aug 2022
Discrete Key-Value Bottleneck Frederik Trauble Anirudh Goyal Nasim Rahaman Michael C. Mozer Kenji Kawaguchi Yoshua Bengio Bernhard Schölkopf CLL 31 23 0 22 Jul 2022
Use All The Labels: A Hierarchical Multi-Label Contrastive Learning Framework Shu Zhen Zhang Ran Xu Caiming Xiong Chetan Ramaiah SSL 36 69 0 27 Apr 2022
Improving language models by retrieving from trillions of tokens Sebastian Borgeaud A. Mensch Jordan Hoffmann Trevor Cai Eliza Rutherford ... Simon Osindero Karen Simonyan Jack W. Rae Erich Elsen Laurent Sifre KELM RALM 127 1,056 0 08 Dec 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 352 7,600 0 11 Nov 2021
Revisiting Deep Learning Models for Tabular Data Yu. V. Gorishniy Ivan Rubachev Valentin Khrulkov Artem Babenko LMTD 75 720 0 22 Jun 2021
Continual Mixed-Language Pre-Training for Extremely Low-Resource Neural Machine Translation Zihan Liu Genta Indra Winata Pascale Fung VLM CLL 50 52 0 09 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 531 5,920 0 29 Apr 2021
Self-Supervised Pretraining Improves Self-Supervised Pretraining Colorado Reed Xiangyu Yue Aniruddha Nrusimha Sayna Ebrahimi Vivek Vijaykumar ... Shanghang Zhang Devin Guillory Sean L. Metzger Kurt Keutzer Trevor Darrell 39 108 0 23 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 537 28,659 0 26 Feb 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 233 6,657 0 23 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 172 40,217 0 22 Oct 2020
Don't Stop Pretraining: Adapt Language Models to Domains and Tasks Suchin Gururangan Ana Marasović Swabha Swayamdipta Kyle Lo Iz Beltagy Doug Downey Noah A. Smith VLM AI4CE CLL 93 2,380 0 23 Apr 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 154 18,523 0 13 Feb 2020
Decoupling Representation and Classifier for Long-Tailed Recognition Bingyi Kang Saining Xie Marcus Rohrbach Zhicheng Yan Albert Gordo Jiashi Feng Yannis Kalantidis OODD 151 1,203 0 21 Oct 2019
Multimodal Multitask Representation Learning for Pathology Biobank Metadata Prediction W. Weng Yuannan Cai Angela Lin Fraser Tan Po-Hsuan Cameron Chen 24 19 0 17 Sep 2019
Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss Kaidi Cao Colin Wei Adrien Gaidon Nikos Arechiga Tengyu Ma 64 1,583 0 18 Jun 2019
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 200 10,152 0 10 Jul 2018