PM2: A New Prompting Multi-modal Model Paradigm for Few-shot Medical Image Classification

13 April 2024

Papers citing "PM2: A New Prompting Multi-modal Model Paradigm for Few-shot Medical Image Classification"

31 / 31 papers shown

Title
A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models Julio Silva-Rodríguez Sina Hajimiri Ismail Ben Ayed Jose Dolz VLM 56 34 0 20 Dec 2023
LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matching D. M. Nguyen Hoang Nguyen Nghiem Tuong Diep Tan Ngoc Pham T. Cao ... Nhat Ho Shadi Albarqouni P. Xie Daniel Sonntag Mathias Niepert VLM MedIm 76 51 0 20 Jun 2023
Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models Zhiqiu Lin Samuel Yu Zhiyi Kuang Deepak Pathak Deva Ramana VLM 103 113 0 16 Jan 2023
A New Perspective to Boost Vision Transformer for Medical Image Classification Yuexiang Li Yawen Huang Nanjun He Kai Ma Yefeng Zheng ViT MedIm 43 3 0 03 Jan 2023
MaPLe: Multi-modal Prompt Learning Muhammad Uzair Khattak H. Rasheed Muhammad Maaz Salman Khan Fahad Shahbaz Khan VPVLM VLM 251 565 0 06 Oct 2022
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks Junke Wang Dongdong Chen Zuxuan Wu Chong Luo Luowei Zhou Yucheng Zhao Yujia Xie Ce Liu Yu-Gang Jiang Lu Yuan MLLM VLM 75 152 0 15 Sep 2022
Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification Jiangtao Xie Fei Long Jiaming Lv Qilong Wang P. Li 68 167 0 09 Apr 2022
Unified Contrastive Learning in Image-Text-Label Space Jianwei Yang Chunyuan Li Pengchuan Zhang Bin Xiao Ce Liu Lu Yuan Jianfeng Gao VLM SSL 120 226 0 07 Apr 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 148 1,624 0 23 Mar 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 128 1,348 0 10 Mar 2022
Self Pre-training with Masked Autoencoders for Medical Image Classification and Segmentation Lei Zhou Huidong Liu Joseph Bae Junjun He Dimitris Samaras Prateek Prasanna MedIm ViT 46 68 0 10 Mar 2022
FLAVA: A Foundational Language And Vision Alignment Model Amanpreet Singh Ronghang Hu Vedanuj Goswami Guillaume Couairon Wojciech Galuba Marcus Rohrbach Douwe Kiela CLIP VLM 91 707 0 08 Dec 2021
Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling Renrui Zhang Rongyao Fang Wei Zhang Peng Gao Kunchang Li Jifeng Dai Yu Qiao Hongsheng Li VLM 265 400 0 06 Nov 2021
Temporal-attentive Covariance Pooling Networks for Video Recognition Zilin Gao Qilong Wang Bingbing Zhang Q. Hu P. Li 60 25 0 27 Oct 2021
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 281 1,040 0 09 Oct 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 492 2,396 0 02 Sep 2021
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision Zirui Wang Jiahui Yu Adams Wei Yu Zihang Dai Yulia Tsvetkov Yuan Cao VLM MLLM 122 796 0 24 Aug 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 200 3,971 0 28 Jul 2021
SoT: Delving Deeper into Classification Head for Transformer Jiangtao Xie Rui Zeng Qilong Wang Ziqi Zhou P. Li ViT 48 12 0 22 Apr 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 443 3,842 0 11 Feb 2021
Momentum Contrastive Learning for Few-Shot COVID-19 Diagnosis from Chest CT Images Xiaocong Chen Lina Yao Tao Zhou Jinming Dong Yu Zhang 60 170 0 16 Jun 2020
Improved Few-Shot Visual Classification Peyman Bateni Raghav Goyal Vaden Masrani Frank Wood Leonid Sigal VLM 66 231 0 07 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 199 12,074 0 13 Nov 2019
BACH: Grand Challenge on Breast Cancer Histology Images Guilherme Aresta Teresa Araújo S. Kwok Sai Saketh Chennamsetty P. MohammedSafwanK. ... L. Boulmane A. Campilho C. Eloy A. Polónia Paulo Aguiar 405 569 0 13 Aug 2018
Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysis Veronika Cheplygina Marleen de Bruijne J. Pluim 74 748 0 17 Apr 2018
Towards Faster Training of Global Covariance Pooling Networks by Iterative Matrix Square Root Normalization P. Li Jiangtao Xie Qilong Wang Zilin Gao 56 256 0 04 Dec 2017
Deep Learning for Medical Image Analysis Mina Rezaei Haojin Yang Christoph Meinel 73 2,060 0 17 Aug 2017
Is Second-order Information Helpful for Large-scale Visual Recognition? P. Li Jiangtao Xie Qilong Wang W. Zuo FAtt 52 251 0 23 Mar 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 823 11,899 0 09 Mar 2017
A Survey on Deep Learning in Medical Image Analysis G. Litjens Thijs Kooi B. Bejnordi A. Setio F. Ciompi Mohsen Ghafoorian Jeroen van der Laak Bram van Ginneken C. I. Sánchez OOD 654 10,779 0 19 Feb 2017
Bilinear CNNs for Fine-grained Visual Recognition Tsung-Yu Lin Aruni RoyChowdhury Subhransu Maji 130 1,875 0 29 Apr 2015