CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIP

5 March 2025

Papers citing "CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIP"

40 / 40 papers shown

Title
Adversarial Robustness for Unified Multi-Modal Encoders via Efficient Calibration Chih-Ting Liao Bin Ren Guofeng Mei Xu Zheng AAML 57 0 0 17 May 2025
Robust CLIP: Unsupervised Adversarial Fine-Tuning of Vision Embeddings for Robust Large Vision-Language Models Christian Schlarmann Naman D. Singh Francesco Croce Matthias Hein VLM AAML 86 50 0 19 Feb 2024
Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Models Erfan Shayegani Yue Dong Nael B. Abu-Ghazaleh 105 152 0 26 Jul 2023
On Evaluating Adversarial Robustness of Large Vision-Language Models Yunqing Zhao Tianyu Pang Chao Du Xiao Yang Chongxuan Li Ngai-Man Cheung Min Lin VLM AAML MLLM 133 180 0 26 May 2023
Visual Instruction Tuning Haotian Liu Chunyuan Li Qingyang Wu Yong Jae Lee SyDa VLM MLLM 571 4,925 0 17 Apr 2023
Diffusion Models for Adversarial Purification Weili Nie Brandon Guo Yujia Huang Chaowei Xiao Arash Vahdat Anima Anandkumar WIGM 269 450 0 16 May 2022
CoCa: Contrastive Captioners are Image-Text Foundation Models Jiahui Yu Zirui Wang Vijay Vasudevan Legg Yeung Mojtaba Seyedhosseini Yonghui Wu VLM CLIP OffRL 179 1,309 0 04 May 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 148 1,359 0 10 Mar 2022
Evaluating the Adversarial Robustness of Adaptive Test-time Defenses Francesco Croce Sven Gowal T. Brunner Evan Shelhamer Matthias Hein A. Cemgil TTA AAML 233 70 0 28 Feb 2022
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 513 2,422 0 02 Sep 2021
AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense Duhun Hwang Eunjung Lee Wonjong Rhee AAML 208 16 0 14 Jul 2021
Adversarial purification with Score-based generative models Jongmin Yoon Sung Ju Hwang Juho Lee DiffM 90 158 0 11 Jun 2021
Attacking Adversarial Attacks as A Defense Boxi Wu Heng Pan Li Shen Jindong Gu Shuai Zhao Zhifeng Li Deng Cai Xiaofei He Wei Liu AAML 82 32 0 09 Jun 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 735 6,139 0 29 Apr 2021
Combating Adversaries with Anti-Adversaries Motasem Alfarra Juan C. Pérez Ali K. Thabet Adel Bibi Philip Torr Guohao Li AAML 83 27 0 26 Mar 2021
Adversarial Attacks are Reversible with Natural Supervision Chengzhi Mao Mia Chiquer Hao Wang Junfeng Yang Carl Vondrick BDL AAML 91 56 0 26 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 1.0K 29,926 0 26 Feb 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 420 5,005 0 24 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 469 3,906 0 11 Feb 2021
Recent Advances in Adversarial Training for Adversarial Robustness Tao Bai Jinqi Luo Jun Zhao Bihan Wen Qian Wang AAML 184 495 0 02 Feb 2021
A Deep Dive into Adversarial Robustness in Zero-Shot Learning M. K. Yucel R. G. Cinbis P. D. Sahin VLM 59 7 0 17 Aug 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 408 6,849 0 13 Jun 2020
Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks Francesco Croce Matthias Hein AAML 241 1,861 0 03 Mar 2020
Overfitting in adversarially robust deep learning Leslie Rice Eric Wong Zico Kolter 124 809 0 26 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 393 18,897 0 13 Feb 2020
Fast is better than free: Revisiting adversarial training Eric Wong Leslie Rice J. Zico Kolter AAML OOD 142 1,181 0 12 Jan 2020
Adversarial Training for Free! Ali Shafahi Mahyar Najibi Amin Ghiasi Zheng Xu John P. Dickerson Christoph Studer L. Davis Gavin Taylor Tom Goldstein AAML 139 1,253 0 29 Apr 2019
Defense-GAN: Protecting Classifiers Against Adversarial Attacks Using Generative Models Pouya Samangouei Maya Kabkab Rama Chellappa AAML GAN 86 1,179 0 17 May 2018
Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples Anish Athalye Nicholas Carlini D. Wagner AAML 249 3,195 0 01 Feb 2018
Mitigating Adversarial Effects Through Randomization Cihang Xie Jianyu Wang Zhishuai Zhang Zhou Ren Alan Yuille AAML 122 1,063 0 06 Nov 2017
Countering Adversarial Images using Input Transformations Chuan Guo Mayank Rana Moustapha Cissé Laurens van der Maaten AAML 135 1,406 0 31 Oct 2017
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification P. Helber B. Bischke Andreas Dengel Damian Borth 158 1,834 0 31 Aug 2017
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 319 12,151 0 19 Jun 2017
Towards Evaluating the Robustness of Neural Networks Nicholas Carlini D. Wagner OOD AAML 282 8,587 0 16 Aug 2016
Adversarial examples in the physical world Alexey Kurakin Ian Goodfellow Samy Bengio SILM AAML 547 5,912 0 08 Jul 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.3K 194,641 0 10 Dec 2015
DeepFool: a simple and accurate method to fool deep neural networks Seyed-Mohsen Moosavi-Dezfooli Alhussein Fawzi P. Frossard AAML 154 4,910 0 14 Nov 2015
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 496 43,717 0 17 Sep 2014
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 291 14,968 1 21 Dec 2013
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 135 2,272 0 21 Jun 2013