Empirical Analysis of Large Vision-Language Models against Goal
Hijacking via Visual Prompt Injection

Empirical Analysis of Large Vision-Language Models against Goal Hijacking via Visual Prompt Injection

7 August 2024

Shumpei Miyawaki

Jun Suzuki

Keisuke Sakaguchi

ArXiv (abs)PDF HTML

Papers citing "Empirical Analysis of Large Vision-Language Models against Goal Hijacking via Visual Prompt Injection"

6 / 6 papers shown

Title
Comprehensive Vulnerability Analysis is Necessary for Trustworthy LLM-MAS Pengfei He Yue Xing Shen Dong Juanhui Li Zhenwei Dai ... Hui Liu Han Xu Zhen Xiang Charu C. Aggarwal Hui Liu LLMAG 84 0 0 02 Jun 2025
Manipulating Multimodal Agents via Cross-Modal Prompt Injection Le Wang Zonghao Ying Tianyuan Zhang Siyuan Liang Shengshan Hu Mingchuan Zhang A. Liu Xianglong Liu AAML 177 4 0 19 Apr 2025
SCAM: A Real-World Typographic Robustness Evaluation for Multimodal Foundation Models Justus Westerhoff Erblina Purellku Jakob Hackstein Jonas Loos Leo Pinetzki Lorenz Hufe AAML 141 0 0 07 Apr 2025
Exploring Typographic Visual Prompts Injection Threats in Cross-Modality Generation Models Hao-Ran Cheng Erjia Xiao Yichi Wang Kaidi Xu Mengshu Sun Jindong Gu Renjing Xu 91 0 0 14 Mar 2025
Exploring Response Uncertainty in MLLMs: An Empirical Evaluation under Misleading Scenarios Yunkai Dang Mengxi Gao Yibo Yan Xin Zou Yanggan Gu Aiwei Liu Xuming Hu 92 6 0 05 Nov 2024
FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Prompts Yichen Gong Delong Ran Jinyuan Liu Conglei Wang Tianshuo Cong Anyu Wang Sisi Duan Xiaoyun Wang MLLM 233 160 0 09 Nov 2023