Understanding and Improving Visual Prompting: A Label-Mapping Perspective

21 November 2022

Papers citing "Understanding and Improving Visual Prompting: A Label-Mapping Perspective"

50 / 63 papers shown

Title
Promoting SAM for Camouflaged Object Detection via Selective Key Point-based Guidance Guoying Liang Su Yang 26 0 0 14 May 2025
RepCali: High Efficient Fine-tuning Via Representation Calibration in Latent Space for Pre-trained Language Models Fujun Zhang Xiangdong Su 29 0 0 13 May 2025
Token Coordinated Prompt Attention is Needed for Visual Prompting Zichen Liu Xu Zou Gang Hua Jiahuan Zhou 34 0 0 05 May 2025
E-InMeMo: Enhanced Prompting for Visual In-Context Learning Jiahao Zhang Bowen Wang Hong Liu Liangzhi Li Yuta Nakashima Hajime Nagahara VLM 101 0 0 25 Apr 2025
VP-NTK: Exploring the Benefits of Visual Prompting in Differentially Private Data Synthesis Chia-Yi Hsu Jia-You Chen Yu-Lin Tsai Chih-Hsun Lin Pin-Yu Chen Chia-Mu Yu Chun-ying Huang 50 0 0 20 Mar 2025
Iterative Prompt Relocation for Distribution-Adaptive Visual Prompt Tuning Chikai Shang Mengke Li Yiqun Zhang Zhen Chen Jinlin Wu Fangqing Gu Yang Lu Yiu-ming Cheung VLM 71 0 0 10 Mar 2025
LoR-VP: Low-Rank Visual Prompting for Efficient Vision Model Adaptation Can Jin Ying Li Mingyu Zhao Shiyu Zhao Z. Wang Xiaoxiao He Ligong Han Tong Che Dimitris N. Metaxas VPVLM VLM 115 1 0 02 Feb 2025
Parameter-Efficient Fine-Tuning for Foundation Models Dan Zhang Tao Feng Lilong Xue Yuandong Wang Yuxiao Dong J. Tang 39 7 0 23 Jan 2025
Differentiable Prompt Learning for Vision Language Models Zhenhan Huang Tejaswini Pedapati Pin-Yu Chen Jianxi Gao VLM 28 0 0 03 Jan 2025
VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks Jiannan Wu Muyan Zhong Sen Xing Zeqiang Lai Zhaoyang Liu ... Lewei Lu Tong Lu Ping Luo Yu Qiao Jifeng Dai MLLM VLM LRM 96 48 0 03 Jan 2025
Forget Vectors at Play: Universal Input Perturbations Driving Machine Unlearning in Image Classification Changchang Sun Ren Wang Yihua Zhang Jinghan Jia Jiancheng Liu Gaowen Liu Sijia Liu Yan Yan AAML MU 93 0 0 21 Dec 2024
Bayesian-guided Label Mapping for Visual Reprogramming C. Cai Zesheng Ye Lei Feng Jianzhong Qi Feng Liu 29 2 0 31 Oct 2024
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies L. Wang Sheng Chen Linnan Jiang Shu Pan Runze Cai Sen Yang Fei Yang 46 3 0 24 Oct 2024
Proactive Schemes: A Survey of Adversarial Attacks for Social Good Vishal Asnani Xi Yin Xiaoming Liu AAML 34 1 0 24 Sep 2024
Benchmarking VLMs' Reasoning About Persuasive Atypical Images Sina Malakouti Aysan Aghazadeh Ashmit Khandelwal Adriana Kovashka VLM 37 2 0 16 Sep 2024
Visual Prompting in Multimodal Large Language Models: A Survey Junda Wu Zhehao Zhang Yu Xia Xintong Li Zhaoyang Xia ... Subrata Mitra Dimitris N. Metaxas Lina Yao Jingbo Shang Julian McAuley VLM LRM 48 12 0 05 Sep 2024
When Does Visual Prompting Outperform Linear Probing for Vision-Language Models? A Likelihood Perspective Hsi-Ai Tsao Lei Hsiung Pin-Yu Chen Tsung-Yi Ho VPVLM LRM VLM 26 0 0 03 Sep 2024
Parameter-Efficient Fine-Tuning via Circular Convolution Aochuan Chen Jiashun Cheng Zijing Liu Ziqi Gao Fugee Tsung Yu Li Jia Li 56 2 0 27 Jul 2024
Adapt PointFormer: 3D Point Cloud Analysis via Adapting 2D Visual Transformers Mengke Li Da Li Guoqing Yang Yiu-ming Cheung Hui Huang 3DPC 46 2 0 18 Jul 2024
Encapsulating Knowledge in One Prompt Qi Li Runpeng Yu Xinchao Wang VLM KELM 44 3 0 16 Jul 2024
Robust Adaptation of Foundation Models with Black-Box Visual Prompting Changdae Oh Gyeongdeok Seo Geunyoung Jung Zhi-Qi Cheng Hosik Choi Jiyoung Jung Kyungwoo Song VLM 36 1 0 04 Jul 2024
Sample-specific Masks for Visual Reprogramming-based Prompting C. Cai Zesheng Ye Lei Feng Jianzhong Qi Feng Liu 36 4 0 05 Jun 2024
Are You Copying My Prompt? Protecting the Copyright of Vision Prompt for VPaaS via Watermark Huali Ren Anli Yan Chong-zhi Gao Hongyang Yan Zhenxin Zhang Jin Li VLM AAML 30 4 0 24 May 2024
Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transformers Shengyuan Yang Jiawang Bai Kuofeng Gao Yong-Liang Yang Yiming Li Shu-Tao Xia AAML SILM 30 5 0 17 May 2024
MoVL:Exploring Fusion Strategies for the Domain-Adaptive Application of Pretrained Models in Medical Imaging Tasks Haijiang Tian Jingkun Yue Xiaohong Liu Guoxing Yang Zeyu Jiang Guangyu Wang VLM MedIm 30 0 0 13 May 2024
TED: Accelerate Model Training by Internal Generalization Jinying Xiao Ping Li Jie Nie VLM 21 0 0 06 May 2024
Understanding Retrieval-Augmented Task Adaptation for Vision-Language Models Yifei Ming Yixuan Li VLM 28 7 0 02 May 2024
The Power of Few: Accelerating and Enhancing Data Reweighting with Coreset Selection Mohammad Jafari Yimeng Zhang Yihua Zhang Sijia Liu 33 2 0 18 Mar 2024
On the low-shot transferability of [V]-Mamba Diganta Misra Jay Gala Antonio Orvieto Mamba 37 1 0 15 Mar 2024
CoLLaVO: Crayon Large Language and Vision mOdel Byung-Kwan Lee Beomchan Park Chae Won Kim Yonghyun Ro VLM MLLM 24 16 0 17 Feb 2024
ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphs Yuhan Li Peisong Wang Zhixun Li Jeffrey Xu Yu Jia Li 19 39 0 17 Feb 2024
All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretraining Haihong Zhao Aochuan Chen Xiangguo Sun Hong Cheng Jia Li 38 33 0 15 Feb 2024
Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey Yi Xin Jianjiang Yang Haodi Zhou Junlong Du Junlong Du Yue Fan Qing Li Qing Li Yuntao Du VLM 59 75 0 03 Feb 2024
HCVP: Leveraging Hierarchical Contrastive Visual Prompt for Domain Generalization Guanglin Zhou Zhongyi Han Shiming Chen Biwei Huang Liming Zhu Tongliang Liu Lina Yao Kun Zhang 32 3 0 18 Jan 2024
LaViP:Language-Grounded Visual Prompts Nilakshan Kunananthaseelan Jing Zhang Mehrtash Harandi VLM 8 0 0 18 Dec 2023
An unsupervised approach towards promptable defect segmentation in laser-based additive manufacturing by Segment Anything Israt Zarin Era Imtiaz Ahmed Zhichao Liu Srinjoy Das 19 2 0 07 Dec 2023
Visual Prompting Upgrades Neural Network Sparsification: A Data-Model Perspective Can Jin Tianjin Huang Yihua Zhang Mykola Pechenizkiy Sijia Liu Shiwei Liu Tianlong Chen VLM 23 26 0 03 Dec 2023
Few-Shot Classification & Segmentation Using Large Language Models Agent Tian Meng Yang Tao Wuliang Yin VLM 28 1 0 19 Nov 2023
Towards Robust and Accurate Visual Prompting Qi Li Liangzhi Li Zhouqiang Jiang Bowen Wang VPVLM VLM 11 3 0 18 Nov 2023
Instruct Me More! Random Prompting for Visual In-Context Learning Jiahao Zhang Bowen Wang Liangzhi Li Yuta Nakashima Hajime Nagahara VLM 25 15 0 07 Nov 2023
Exploring In-Context Learning of Textless Speech Language Model for Speech Classification Tasks Ming-Hao Hsu Kai-Wei Chang Shang-Wen Li Hung-yi Lee 26 7 0 19 Oct 2023
Quantifying Privacy Risks of Prompts in Visual Prompt Learning Yixin Wu Rui Wen Michael Backes Pascal Berrang Mathias Humbert Yun Shen Yang Zhang AAML VPVLM 27 8 0 18 Oct 2023
Unifying Image Processing as Visual Prompting Question Answering Yihao Liu Xiangyu Chen Xianzheng Ma Xintao Wang Jiantao Zhou Yu Qiao Chao Dong MLLM 22 18 0 16 Oct 2023
Selectivity Drives Productivity: Efficient Dataset Pruning for Enhanced Transfer Learning Yihua Zhang Yimeng Zhang Aochuan Chen Jinghan Jia Jiancheng Liu Gaowen Liu Min-Fong Hong Shiyu Chang Sijia Liu AAML 29 8 0 13 Oct 2023
AutoVP: An Automated Visual Prompting Framework and Benchmark Hsi-Ai Tsao Lei Hsiung Pin-Yu Chen Sijia Liu Tsung-Yi Ho VLM 14 18 0 12 Oct 2023
Prompt Backdoors in Visual Prompt Learning Hai Huang Zhengyu Zhao Michael Backes Yun Shen Yang Zhang VLM VPVLM AAML SILM 35 2 0 11 Oct 2023
Uncovering the Hidden Cost of Model Compression Diganta Misra Muawiz Chaudhary Agam Goyal Bharat Runwal Pin-Yu Chen VLM 28 0 0 29 Aug 2023
An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning Yihua Zhang Prashant Khanduri Ioannis C. Tsaknakis Yuguang Yao Min-Fong Hong Sijia Liu AI4CE 36 25 0 01 Aug 2023
Lost In Translation: Generating Adversarial Examples Robust to Round-Trip Translation Neel Bhandari Pin-Yu Chen AAML SILM 32 3 0 24 Jul 2023
MoP-CLIP: A Mixture of Prompt-Tuned CLIP Models for Domain Incremental Learning Julien Nicolas Florent Chiaroni Imtiaz Masud Ziko Ola Ahmad Christian Desrosiers Jose Dolz VLM CLL 26 5 0 11 Jul 2023