v1v2v3 (latest)

One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Models

8 June 2024

Hao Fang

Bin Chen

Hao Wu

Papers citing "One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Models"

50 / 107 papers shown

Title
X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIP Hanxun Huang Sarah Monazam Erfani Yige Li Xingjun Ma James Bailey AAML 127 1 0 08 May 2025
Protecting Your Video Content: Disrupting Automated Video-based LLM Annotations Haitong Liu Kuofeng Gao Yang Bai Jinmin Li Jinxiao Shan Tao Dai Shu-Tao Xia AAML 108 1 0 26 Mar 2025
Cross-Model Transferability of Adversarial Patches in Real-time Segmentation for Autonomous Driving Prashant Shekhar Bidur Devkota Dumindu Samaraweera Laxima Niure Kandel Manoj Babu AAML 86 0 0 22 Feb 2025
TAPT: Test-Time Adversarial Prompt Tuning for Robust Inference in Vision-Language Models Xin Wang Kai-xiang Chen Jiaming Zhang Jingjing Chen Xingjun Ma AAML VPVLM VLM 128 3 0 20 Nov 2024
BlueSuffix: Reinforced Blue Teaming for Vision-Language Models Against Jailbreak Attacks Yunhan Zhao Xiang Zheng Lin Luo Yige Li Xingjun Ma Yu-Gang Jiang VLM AAML 97 6 0 28 Oct 2024
Efficient and Effective Universal Adversarial Attack against Vision-Language Pre-training Models Fan Yang Yihao Huang Kaidi Wang Ling Shi G. Pu Yang Liu Haoran Wang AAML VLM 67 2 0 15 Oct 2024
A Closer Look at GAN Priors: Exploiting Intermediate Features for Enhanced Model Inversion Attacks Yixiang Qiu Hao Fang Hongyao Yu Bin Chen Meikang Qiu Shu-Tao Xia AAML 74 15 0 18 Jul 2024
CLIP-Guided Networks for Transferable Targeted Attacks Hao Fang Jiawei Kong Bin Chen Tao Dai Hao Wu Shu-Tao Xia AAML 96 6 0 14 Jul 2024
Video Watermarking: Safeguarding Your Video from (Unauthorized) Annotations by Video-based LLMs Jinmin Li Kuofeng Gao Yang Bai Jingyun Zhang Shu-Tao Xia 74 4 0 02 Jul 2024
LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling Yaohua Zha Naiqi Li Yanzi Wang Tao Dai Hang Guo Bin Chen Zhi Wang Zhihao Ouyang Shu-Tao Xia Mamba 109 10 0 27 May 2024
Universal Adversarial Perturbations for Vision-Language Pre-trained Models Pengfei Zhang Zi Huang Guangdong Bai AAML 78 12 0 09 May 2024
Generating Universal Adversarial Perturbations for Quantum Classifiers Gautham Anil Vishnu Vinod Apurva Narayan AAML 65 5 0 13 Feb 2024
Enhancing Generalization of Universal Adversarial Perturbation through Gradient Aggregation Xuantong Liu Yaoyao Zhong Yuhang Zhang Lixiong Qin Weihong Deng AAML 79 25 0 11 Aug 2023
GIFD: A Generative Gradient Inversion Method with Feature Domain Optimization Hao Fang Bin Chen Xuan Wang Zhi Wang Shutao Xia 76 34 0 09 Aug 2023
Set-level Guidance Attack: Boosting Adversarial Transferability of Vision-Language Pre-training Models Dong Lu Zhiqiang Wang Teng Wang Weili Guan Hongchang Gao Feng Zheng AAML 99 73 0 26 Jul 2023
Downstream-agnostic Adversarial Examples Ziqi Zhou Shengshan Hu Rui-Qing Zhao Qian Wang L. Zhang Junhui Hou Hai Jin SILM AAML 75 24 0 23 Jul 2023
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models Deyao Zhu Jun Chen Xiaoqian Shen Xiang Li Mohamed Elhoseiny VLM MLLM 158 2,060 0 20 Apr 2023
Visual Instruction Tuning Haotian Liu Chunyuan Li Qingyang Wu Yong Jae Lee SyDa VLM MLLM 560 4,861 0 17 Apr 2023
Backdoor Defense via Adaptively Splitting Poisoned Dataset Kuofeng Gao Yang Bai Jindong Gu Yong-Liang Yang Shutao Xia AAML 59 50 0 23 Mar 2023
PointCA: Evaluating the Robustness of 3D Point Cloud Completion Models Against Adversarial Examples Shengshan Hu Junwei Zhang Wen Liu Junhui Hou Minghui Li L. Zhang Hai Jin Lichao Sun AAML 3DPC 66 11 0 22 Nov 2022
Imperceptible and Robust Backdoor Attack in 3D Point Cloud Kuofeng Gao Jiawang Bai Baoyuan Wu Mengxi Ya Shutao Xia AAML 3DPC 83 33 0 17 Aug 2022
Frequency Domain Model Augmentation for Adversarial Attack Yuyang Long Qi-li Zhang Boheng Zeng Lianli Gao Xianglong Liu Jian Zhang Jingkuan Song AAML 80 164 0 12 Jul 2022
Defending Multimodal Fusion Models against Single-Source Adversaries Karren D. Yang Wan-Yi Lin M. Barman Filipe Condessa Zico Kolter AAML 39 32 0 25 Jun 2022
Towards Adversarial Attack on Vision-Language Pre-training Models Jiaming Zhang Qiaomin Yi Jitao Sang VLM AAML 70 106 0 19 Jun 2022
Diffusion Models for Adversarial Purification Weili Nie Brandon Guo Yujia Huang Chaowei Xiao Arash Vahdat Anima Anandkumar WIGM 263 448 0 16 May 2022
Fine-Grained Visual Entailment Christopher Thomas Yipeng Zhang Shih-Fu Chang 125 6 0 29 Mar 2022
CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailment Haoyu Song Li Dong Weinan Zhang Ting Liu Furu Wei VLM CLIP 81 139 0 14 Mar 2022
Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfer Shengshan Hu Xiaogeng Liu Yechao Zhang Minghui Li L. Zhang Hai Jin Libing Wu AAML PICV 83 92 0 07 Mar 2022
Vision-Language Pre-Training with Triple Contrastive Learning Jinyu Yang Jiali Duan Son N. Tran Yi Xu Sampath Chanda Liqun Chen Belinda Zeng Trishul Chilimbi Junzhou Huang VLM 108 297 0 21 Feb 2022
A Survey of Vision-Language Pre-Trained Models Yifan Du Zikang Liu Junyi Li Wayne Xin Zhao VLM 114 185 0 18 Feb 2022
VLP: A Survey on Vision-Language Pre-training Feilong Chen Duzhen Zhang Minglun Han Xiuyi Chen Jing Shi Shuang Xu Bo Xu VLM 148 223 0 18 Feb 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong Guosheng Lin MLLM BDL VLM CLIP 542 4,398 0 28 Jan 2022
Learning to Learn Transferable Attack Shuman Fang Jie Li Xianming Lin Rongrong Ji AAML 85 21 0 10 Dec 2021
Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts Yan Zeng Xinsong Zhang Hang Li VLM CLIP 74 307 0 16 Nov 2021
An Empirical Study of Training End-to-End Vision-and-Language Transformers Zi-Yi Dou Yichong Xu Zhe Gan Jianfeng Wang Shuohang Wang ... Pengchuan Zhang Lu Yuan Nanyun Peng Zicheng Liu Michael Zeng VLM 74 379 0 03 Nov 2021
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision Zirui Wang Jiahui Yu Adams Wei Yu Zihang Dai Yulia Tsvetkov Yuan Cao VLM MLLM 133 800 0 24 Aug 2021
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation Junnan Li Ramprasaath R. Selvaraju Akhilesh Deepak Gotmare Shafiq Joty Caiming Xiong Guosheng Lin FaML 215 1,970 0 16 Jul 2021
Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-training Hongwei Xue Yupan Huang Bei Liu Houwen Peng Jianlong Fu Houqiang Li Jiebo Luo 77 89 0 25 Jun 2021
MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding Aishwarya Kamath Mannat Singh Yann LeCun Gabriel Synnaeve Ishan Misra Nicolas Carion ObjD VLM 179 883 0 26 Apr 2021
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning Zhicheng Huang Zhaoyang Zeng Yupan Huang Bei Liu Dongmei Fu Jianlong Fu VLM ViT 149 273 0 07 Apr 2021
GLM: General Language Model Pretraining with Autoregressive Blank Infilling Zhengxiao Du Yujie Qian Xiao Liu Ming Ding J. Qiu Zhilin Yang Jie Tang BDL AI4CE 137 1,550 0 18 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 967 29,731 0 26 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 445 3,887 0 11 Feb 2021
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision Wonjae Kim Bokyung Son Ildoo Kim VLM CLIP 128 1,749 0 05 Feb 2021
Admix: Enhancing the Transferability of Adversarial Attacks Xiaosen Wang Xu He Jingdong Wang Kun He AAML 123 201 0 31 Jan 2021
UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning Wei Li Can Gao Guocheng Niu Xinyan Xiao Hao Liu Jiachen Liu Hua Wu Haifeng Wang 107 380 0 31 Dec 2020
Transferable Universal Adversarial Perturbations Using Generative Models Atiyeh Hashemi Andreas Bär S. Mozaffari Tim Fingscheidt AAML 62 17 0 28 Oct 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 667 41,369 0 22 Oct 2020
DeVLBert: Learning Deconfounded Visio-Linguistic Representations Shengyu Zhang Tan Jiang Tan Wang Kun Kuang Zhou Zhao Jianke Zhu Jin Yu Hongxia Yang Leilei Gan OOD 59 87 0 16 Aug 2020
Defense against Adversarial Attacks in NLP via Dirichlet Neighborhood Ensemble Yi Zhou Xiaoqing Zheng Cho-Jui Hsieh Kai-Wei Chang Xuanjing Huang SILM 93 48 0 20 Jun 2020