v1v2 (latest)

Visual Prompt Tuning

23 March 2022

Ser-Nam Lim

Papers citing "Visual Prompt Tuning"

50 / 1,088 papers shown

Title
Consolidator: Mergeable Adapter with Grouped Connections for Visual Adaptation Tianxiang Hao Hui Chen Yuchen Guo Guiguang Ding 132 16 0 30 Apr 2023
Instruction-ViT: Multi-Modal Prompts for Instruction Learning in ViT Zhe Xiao Yuzhong Chen Lu Zhang Jun Yao Zihao Wu ... Yixuan Yuan Dinggang Shen Dajiang Zhu Tianming Liu Xi Jiang VLM MLLM 138 17 0 29 Apr 2023
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model Peng Gao Jiaming Han Renrui Zhang Ziyi Lin Shijie Geng ... Pan Lu Conghui He Xiangyu Yue Hongsheng Li Yu Qiao MLLM 118 588 0 28 Apr 2023
Customized Segment Anything Model for Medical Image Segmentation Kaiwen Zhang Dong Liu MedIm VLM 159 308 0 26 Apr 2023
FVP: Fourier Visual Prompting for Source-Free Unsupervised Domain Adaptation of Medical Image Segmentation Yan Wang Jian Cheng Yixin Chen Shuai Shao Lanyun Zhu Zhenzhou Wu Tianming Liu Haogang Zhu OOD MedIm 126 26 0 26 Apr 2023
PVP: Pre-trained Visual Parameter-Efficient Tuning Zhao Song Ke Yang Naiyang Guan Junjie Zhu Peng Qiao Qingyong Hu VPVLM VLM 66 3 0 26 Apr 2023
Learnable Ophthalmology SAM Zhongxi Qiu Yan Hu Heng Li Jiang-Dong Liu VLM MedIm 90 26 0 26 Apr 2023
Hint-Aug: Drawing Hints from Foundation Vision Transformers Towards Boosted Few-Shot Parameter-Efficient Tuning Zhongzhi Yu Shang Wu Y. Fu Shunyao Zhang Yingyan Lin 78 6 0 25 Apr 2023
Distilling from Similar Tasks for Transfer Learning on a Budget Kenneth Borup Cheng Perng Phoo Bharath Hariharan 86 3 0 24 Apr 2023
Med-Tuning: A New Parameter-Efficient Tuning Framework for Medical Volumetric Segmentation Jiachen Shen Wenxuan Wang Chen Chen Jianbo Jiao Jing Liu Yan Zhang Shanshan Song Jiangyun Li 98 1 0 21 Apr 2023
Visual Instruction Tuning Haotian Liu Chunyuan Li Qingyang Wu Yong Jae Lee SyDa VLM MLLM 579 4,942 0 17 Apr 2023
Progressive Visual Prompt Learning with Contrastive Feature Re-formation C. Xu Yuhan Zhu Haocheng Shen Fengyuan Shi Boheng Chen Yixuan Liao Xiaoxin Chen Limin Wang VLM 100 21 0 17 Apr 2023
One-shot and Partially-Supervised Cell Image Segmentation Using Small Visual Prompt S. Kato Kazuhiro Hotta VLM 50 0 0 17 Apr 2023
Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models Yaohua Zha Jinpeng Wang Tao Dai Bin Chen Zhi Wang Shutao Xia VLM 115 48 0 14 Apr 2023
Preserving Locality in Vision Transformers for Class Incremental Learning Bowen Zheng Da-Wei Zhou Han-Jia Ye De-Chuan Zhan CLL 69 5 0 14 Apr 2023
What does CLIP know about a red circle? Visual prompt engineering for VLMs Aleksandar Shtedritski Christian Rupprecht Andrea Vedaldi VLM MLLM 106 162 0 13 Apr 2023
DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning Enze Xie Lewei Yao Han Shi Zhili Liu Daquan Zhou Zhaoqiang Liu Jiawei Li Zhenguo Li 74 81 0 13 Apr 2023
Lossless Adaptation of Pretrained Vision Models For Robotic Manipulation Mohit Sharma Claudio Fantacci Yuxiang Zhou Skanda Koppula N. Heess Jonathan Scholz Y. Aytar VLM 107 31 0 13 Apr 2023
Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning Kaiyou Song Jin Xie Shanyi Zhang Zimeng Luo 86 31 0 13 Apr 2023
TransHP: Image Classification with Hierarchical Prompting Wenhao Wang Yifan Sun W. Li Yi Yang 95 17 0 13 Apr 2023
Efficient Multimodal Fusion via Interactive Prompting Yaowei Li Ruijie Quan Linchao Zhu Yezhou Yang 82 45 0 13 Apr 2023
[CLS] Token is All You Need for Zero-Shot Semantic Segmentation Letian Wu Wenya Zhang Tengping Jiang Wankou Yang Xin Jin Wenjun Zeng VLM 91 4 0 13 Apr 2023
RGB-T Tracking Based on Mixed Attention Yang Luo Xiqing Guo Ming Dong Jin-xia Yu 104 16 0 09 Apr 2023
Vita-CLIP: Video and text adaptive CLIP via Multimodal Prompting Syed Talal Wasim Muzammal Naseer Salman Khan Fahad Shahbaz Khan M. Shah VLM VPVLM 114 79 0 06 Apr 2023
Few-shot Semantic Image Synthesis with Class Affinity Transfer Marlene Careil Jakob Verbeek Stéphane Lathuilière DiffM 72 4 0 05 Apr 2023
Towards Efficient Task-Driven Model Reprogramming with Foundation Models Shoukai Xu Jiangchao Yao Ran Luo Shuhai Zhang Zihao Lian Mingkui Tan Bo Han Yaowei Wang 95 6 0 05 Apr 2023
Strong Baselines for Parameter Efficient Few-Shot Fine-tuning S. Basu Daniela Massiceti S. Hu Soheil Feizi VLM 85 34 0 04 Apr 2023
EPVT: Environment-aware Prompt Vision Transformer for Domain Generalization in Skin Lesion Recognition Siyuan Yan Chih-Chen Liu Zhen Yu Lie Ju Dwarikanath Mahapatrainst Victoria Mar Monika Janda Peter Soyer Z. Ge ViT MedIm VLM 97 9 0 04 Apr 2023
Open-Vocabulary Semantic Segmentation with Decoupled One-Pass Network Cong Han Yujie Zhong Dengjie Li Kai Han Lin Ma VLM SSeg 96 34 0 03 Apr 2023
Associating Spatially-Consistent Grouping with Text-supervised Semantic Segmentation Yabo Zhang Zihao Wang Jun Hao Liew Jingjia Huang Manyu Zhu Jiashi Feng W. Zuo VLM 52 4 0 03 Apr 2023
Vision-Language Models for Vision Tasks: A Survey Jingyi Zhang Jiaxing Huang Sheng Jin Shijian Lu VLM 165 551 0 03 Apr 2023
Task-Oriented Multi-Modal Mutual Leaning for Vision-Language Models Sifan Long Zhen Zhao Junkun Yuan Zichang Tan Jiangjiang Liu Luping Zhou Sheng-sheng Wang Jingdong Wang VLM 113 3 0 30 Mar 2023
AutoAD: Movie Description in Context Tengda Han Max Bain Arsha Nagrani Gül Varol Weidi Xie Andrew Zisserman VGen 77 35 0 29 Mar 2023
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention Renrui Zhang Jiaming Han Chris Liu Peng Gao Aojun Zhou Xiangfei Hu Shilin Yan Pan Lu Hongsheng Li Yu Qiao MLLM 176 787 0 28 Mar 2023
Learning Federated Visual Prompt in Null Space for MRI Reconstruction Chun-Mei Feng Bangjun Li Xinxing Xu Yong Liu Huazhu Fu W. Zuo FedML 99 47 0 28 Mar 2023
Learning Expressive Prompting With Residuals for Vision Transformers Rajshekhar Das Yonatan Dukler Avinash Ravichandran A. Swaminathan VLM VPVLM 71 22 0 27 Mar 2023
Troika: Multi-Path Cross-Modal Traction for Compositional Zero-Shot Learning Siteng Huang Biao Gong Yutong Feng Min Zhang Yiliang Lv Donglin Wang CoGe 89 11 0 27 Mar 2023
What Can Human Sketches Do for Object Detection? Pinaki Nath Chowdhury A. Bhunia Aneeshan Sain Subhadeep Koley Tao Xiang Yi-Zhe Song ObjD 90 33 0 27 Mar 2023
Universal Few-shot Learning of Dense Prediction Tasks with Visual Token Matching Donggyun Kim Jinwoo Kim Seongwoong Cho Chong Luo Seunghoon Hong VLM 104 24 0 27 Mar 2023
BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning Changdae Oh Hyeji Hwang Hee-young Lee Yongtaek Lim Geunyoung Jung Jiyoung Jung Hosik Choi Kyungwoo Song VLM VPVLM 139 62 0 26 Mar 2023
Prompt Tuning based Adapter for Vision-Language Model Adaption Jingchen Sun Jiayu Qin Zihao Lin Changyou Chen VPVLM MLLM VLM 42 6 0 24 Mar 2023
Remind of the Past: Incremental Learning with Analogical Prompts Zhiheng Ma Xiaopeng Hong Beinan Liu Yabin Wang Pinyue Guo Huiyun Li CLL 84 1 0 24 Mar 2023
The effectiveness of MAE pre-pretraining for billion-scale pretraining Mannat Singh Quentin Duval Kalyan Vasudev Alwala Haoqi Fan Vaibhav Aggarwal ... Piotr Dollár Christoph Feichtenhofer Ross B. Girshick Rohit Girdhar Ishan Misra LRM 182 71 0 23 Mar 2023
CLIP for All Things Zero-Shot Sketch-Based Image Retrieval, Fine-Grained or Not Aneeshan Sain A. Bhunia Pinaki Nath Chowdhury Subhadeep Koley Tao Xiang Yi-Zhe Song VLM 98 84 0 23 Mar 2023
Visual-Language Prompt Tuning with Knowledge-guided Context Optimization Hantao Yao Rui Zhang Changsheng Xu VLM VPVLM 204 227 0 23 Mar 2023
Exploring Visual Prompts for Whole Slide Image Classification with Multiple Instance Learning Yi Lin Zhongchen Zhao Zhengjie Zhu Lisheng Wang Kwang-Ting Cheng Hao Chen VLM 89 1 0 23 Mar 2023
CORA: Adapting CLIP for Open-Vocabulary Detection with Region Prompting and Anchor Pre-Matching Xiaoshi Wu Feng Zhu Rui Zhao Hongsheng Li VLM 64 126 0 23 Mar 2023
Exploring the Benefits of Visual Prompting in Differential Privacy Yizhe Li Yu-Lin Tsai Xuebin Ren Chia-Mu Yu Pin-Yu Chen AAML VPVLM 78 20 0 22 Mar 2023
Prompt-MIL: Boosting Multi-Instance Learning Schemes via Task-specific Prompt Tuning Jingwei Zhang S. Kapse Ke Ma Prateek Prasanna Joel H. Saltz Maria Vakalopoulou Dimitris Samaras VLM 141 18 0 21 Mar 2023
CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation Seokju Cho Heeseong Shin Sung‐Jin Hong Anurag Arnab Paul Hongsuck Seo Seung Wook Kim VLM 106 115 0 21 Mar 2023