v1v2 (latest)

Hidden Ghost Hand: Unveiling Backdoor Vulnerabilities in MLLM-Powered Mobile GUI Agents

20 May 2025

Papers citing "Hidden Ghost Hand: Unveiling Backdoor Vulnerabilities in MLLM-Powered Mobile GUI Agents"

33 / 33 papers shown

Title
The Obvious Invisible Threat: LLM-Powered GUI Agents' Vulnerability to Fine-Print Injections Chong Chen Zhiping Zhang Bingcan Guo Shang Ma Ibrahim Khalilov ... Yanfang Ye Ziang Xiao Yaxing Yao Tianshi Li Tao Li AAML LLMAG SILM 107 9 0 15 Apr 2025
Attacking Multimodal OS Agents with Malicious Image Patches Lukas Aichberger Alasdair Paren Y. Gal Philip Torr Adel Bibi AAML 113 5 0 13 Mar 2025
AppAgentX: Evolving GUI Agents as Proficient Smartphone Users Wenjia Jiang Yangyang Zhuang Chenxi Song Xu Yang Chi Zhang Chi Zhang LLMAG 179 6 0 04 Mar 2025
Smoothing Grounding and Reasoning for MLLM-Powered GUI Agents with Query-Oriented Pivot Tasks Zongru Wu Pengzhou Cheng Zheng Wu Tianjie Ju Zhuosheng Zhang Gongshen Liu LRM 82 4 0 01 Mar 2025
OS-Kairos: Adaptive Interaction for MLLM-Powered GUI Agents Pengzhou Cheng Zheng Wu Zongru Wu Aston Zhang Zhuosheng Zhang Gongshen Liu LLMAG 105 4 0 26 Feb 2025
WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning Zehan Qi Xiao-Chang Liu Iat Long Iong Hanyu Lai Xingwu Sun ... Shuntian Yao Tianjie Zhang Wei Xu J. Tang Yuxiao Dong 184 42 0 28 Jan 2025
BLAST: A Stealthy Backdoor Leverage Attack against Cooperative Multi-Agent Deep Reinforcement Learning based Systems Yinbo Yu Saihao Yan Xueyu Yin Jing Fang Jiajia Liu AAML 50 3 0 03 Jan 2025
GUI Agents with Foundation Models: A Comprehensive Survey Shuai Wang Wen Liu Jingxuan Chen Weinan Gan Xingshan Zeng ... Bin Wang Chuhan Wu Yasheng Wang Ruiming Tang Jianye Hao LLMAG 124 27 0 07 Nov 2024
OS-ATLAS: A Foundation Action Model for Generalist GUI Agents Zhiyong Wu Zhenyu Wu Fangzhi Xu Yian Wang Qiushi Sun ... Kanzhi Cheng Zichen Ding Lixing Chen Paul Pu Liang Yu Qiao 90 73 0 30 Oct 2024
Dynamic Planning for LLM-based Graphical User Interface Automation Shaoqing Zhang Zhuosheng Zhang Kehai Chen Xinbei Ma Muyun Yang Tiejun Zhao Min Zhang LLMAG 73 10 0 01 Oct 2024
Caution for the Environment: Multimodal Agents are Susceptible to Environmental Distractions Xinbei Ma Yiting Wang Yao Yao Tongxin Yuan Aston Zhang Zhuosheng Zhang Hai Zhao AAML LLMAG 94 26 0 05 Aug 2024
DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning Hao Bai Yifei Zhou Mert Cemri Jiayi Pan Alane Suhr Sergey Levine Aviral Kumar OffRL 98 65 0 14 Jun 2024
BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents Yifei Wang Dizhan Xue Shengjie Zhang Shengsheng Qian AAML LLMAG 102 38 0 05 Jun 2024
Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration Junyang Wang Haiyang Xu Haitao Jia Xi Zhang Ming Yan Weizhou Shen Ji Zhang Fei Huang Jitao Sang LM&Ro LLMAG 102 74 0 03 Jun 2024
Cradle: Empowering Foundation Agents Towards General Computer Control Weihao Tan Wentao Zhang Xinrun Xu Haochong Xia Ziluo Ding ... Xinrun Wang Börje F. Karlsson Bo An Shuicheng Yan Zongqing Lu 78 32 0 05 Mar 2024
Android in the Zoo: Chain-of-Action-Thought for GUI Agents Jiwen Zhang Jihao Wu Yihua Teng Minghui Liao Nuo Xu Xiao Xiao Zhongyu Wei Duyu Tang LLMAG LM&Ro 113 75 0 05 Mar 2024
VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models Jiawei Liang Siyuan Liang Man Luo Aishan Liu Dongchen Han Ee-Chien Chang Xiaochun Cao 92 47 0 21 Feb 2024
CoCo-Agent: A Comprehensive Cognitive MLLM Agent for Smartphone GUI Automation Xinbei Ma Zhuosheng Zhang Hai Zhao LLMAG 90 34 0 19 Feb 2024
Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents Wenkai Yang Xiaohan Bi Yankai Lin Sishuo Chen Jie Zhou Xu Sun LLMAG AAML 124 71 0 17 Feb 2024
Instruction Backdoor Attacks Against Customized LLMs Rui Zhang Hongwei Li Rui Wen Wenbo Jiang Yuan Zhang Michael Backes Yun Shen Yang Zhang AAML SILM 104 32 0 14 Feb 2024
UFO: A UI-Focused Agent for Windows OS Interaction Chaoyun Zhang Liqun Li Shilin He Xu Zhang Bo Qiao ... Yu Kang Qingwei Lin Saravan Rajmohan Dongmei Zhang Qi Zhang LLMAG 154 83 0 08 Feb 2024
Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception Junyang Wang Haiyang Xu Jiabo Ye Mingshi Yan Weizhou Shen Ji Zhang Fei Huang Jitao Sang 134 128 0 29 Jan 2024
GPT-4V(ision) is a Generalist Web Agent, if Grounded Boyuan Zheng Boyu Gou Jihyung Kil Huan Sun Yu-Chuan Su MLLM VLM LLMAG 130 264 0 03 Jan 2024
The Philosopher's Stone: Trojaning Plugins of Large Language Models Tian Dong Minhui Xue Guoxing Chen Rayne Holland Shaofeng Li Yan Meng Zhen Liu Haojin Zhu AAML 140 14 0 01 Dec 2023
You Only Look at Screens: Multimodal Chain-of-Action Agents Zhuosheng Zhang Aston Zhang LLMAG LM&Ro 87 119 0 20 Sep 2023
Backdoor Attacks and Countermeasures in Natural Language Processing Models: A Comprehensive Security Review Pengzhou Cheng Zongru Wu Wei Du Haodong Zhao Wei Lu Gongshen Liu SILM AAML 157 21 0 12 Sep 2023
Backdoor Attacks for In-Context Learning with Language Models Nikhil Kandpal Matthew Jagielski Florian Tramèr Nicholas Carlini SILM AAML 107 83 0 27 Jul 2023
DroidBot-GPT: GPT-powered UI Automation for Android Hao Wen Hongmin Wang Jiaxuan Liu Yan Liang LM&Ro LM&MA 77 43 0 14 Apr 2023
RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models Wenkai Yang Yankai Lin Peng Li Jie Zhou Xu Sun SILM AAML 144 112 0 15 Oct 2021
Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger Fanchao Qi Mukai Li Yangyi Chen Zhengyan Zhang Zhiyuan Liu Yasheng Wang Maosong Sun SILM 80 235 0 26 May 2021
ONION: A Simple and Effective Defense Against Textual Backdoor Attacks Fanchao Qi Yangyi Chen Mukai Li Yuan Yao Zhiyuan Liu Maosong Sun AAML 107 283 0 20 Nov 2020
A backdoor attack against LSTM-based text classification systems Jiazhu Dai Chuanshuai Chen SILM 89 330 0 29 May 2019
Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networks Kang Liu Brendan Dolan-Gavitt S. Garg AAML 74 1,047 0 30 May 2018