v1v2 (latest)

When Does Visual Prompting Outperform Linear Probing for Vision-Language Models? A Likelihood Perspective

3 September 2024

Hsi-Ai Tsao

Lei Hsiung

Pin-Yu Chen

Tsung-Yi Ho

VPVLM

LRM

VLM

ArXiv (abs)PDF HTML Github (3★)

Papers citing "When Does Visual Prompting Outperform Linear Probing for Vision-Language Models? A Likelihood Perspective"

20 / 20 papers shown

Title
Understanding and Improving Visual Prompting: A Label-Mapping Perspective Aochuan Chen Yuguang Yao Pin-Yu Chen Yihua Zhang Sijia Liu VPVLM VLM 102 81 0 21 Nov 2022
Neural Clamping: Joint Input Perturbation and Temperature Scaling for Neural Network Calibration Yu Tang Pin-Yu Chen Tsung-Yi Ho 69 5 0 23 Sep 2022
Exploring Visual Prompts for Adapting Large-Scale Models Hyojin Bahng Ali Jahanian S. Sankaranarayanan Phillip Isola VLM VPVLM LRM 68 271 0 31 Mar 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 153 1,627 0 23 Mar 2022
Model Reprogramming: Resource-Efficient Cross-Domain Machine Learning Pin-Yu Chen VLM 146 64 0 22 Feb 2022
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 453 21,439 0 25 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 955 29,436 0 26 Feb 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 659 41,103 0 22 Oct 2020
Transfer Learning without Knowing: Reprogramming Black-box Machine Learning Models with Scarce Data and Limited Resources Yun-Yun Tsai Pin-Yu Chen Tsung-Yi Ho AAML MLAU BDL 74 99 0 17 Jul 2020
LEEP: A New Measure to Evaluate Transferability of Learned Representations Cuong V Nguyen Tal Hassner Matthias Seeger Cédric Archambeau 80 218 0 27 Feb 2020
Transferability and Hardness of Supervised Classification Tasks Anh Tran Cuong V Nguyen Tal Hassner 175 167 0 21 Aug 2019
Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC) Noel Codella V. Rotemberg P. Tschandl M. E. Celebi Stephen W. Dusza ... Aadi Kalloo Konstantinos Liopyris Michael Marchetti Harald Kittler Allan Halpern 107 1,189 0 09 Feb 2019
A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks Kimin Lee Kibok Lee Honglak Lee Jinwoo Shin OODD 187 2,051 0 10 Jul 2018
Exploring the Limits of Weakly Supervised Pretraining D. Mahajan Ross B. Girshick Vignesh Ramanathan Kaiming He Manohar Paluri Yixuan Li Ashwin R. Bharambe Laurens van der Maaten VLM 188 1,368 0 02 May 2018
Functional Map of the World Gordon A. Christie Neil Fendley James Wilson R. Mukherjee VGen 73 393 0 21 Nov 2017
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification P. Helber B. Bischke Andreas Dengel Damian Borth 137 1,820 0 31 Aug 2017
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks Dan Hendrycks Kevin Gimpel UQCV 164 3,454 0 07 Oct 2016
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.7K 39,547 0 01 Sep 2014
Describing Textures in the Wild Mircea Cimpoi Subhransu Maji Iasonas Kokkinos S. Mohamed Andrea Vedaldi 3DV 138 2,674 0 14 Nov 2013
UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild K. Soomro Amir Zamir M. Shah CLIP VGen 155 6,162 0 03 Dec 2012