Are Vision Transformers Robust to Patch Perturbations?

Are Vision Transformers Robust to Patch Perturbations?

20 November 2021

Jindong Gu

Papers citing "Are Vision Transformers Robust to Patch Perturbations?"

18 / 18 papers shown

Title
Benchmarking the Spatial Robustness of DNNs via Natural and Adversarial Localized Corruptions Giulia Marchiori Pietrosanti Giulio Rossolini Alessandro Biondi Giorgio Buttazzo AAML 80 0 0 02 Apr 2025
Unveiling Typographic Deceptions: Insights of the Typographic Vulnerability in Large Vision-Language Model Hao-Ran Cheng Erjia Xiao Jindong Gu Le Yang Jinhao Duan Jize Zhang Jiahang Cao Kaidi Xu Renjing Xu 37 6 0 29 Feb 2024
MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness Xiaoyun Xu Shujian Yu Jingzheng Wu S. Picek AAML 35 0 0 08 Dec 2023
Random Position Adversarial Patch for Vision Transformers Mingzhen Shao ViT AAML 32 2 0 09 Jul 2023
Benchmarking Robustness of Adaptation Methods on Pre-trained Vision-Language Models Shuo Chen Jindong Gu Zhen Han Yunpu Ma Philip H. S. Torr Volker Tresp VPVLM VLM 32 17 0 03 Jun 2023
How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defenses Joana Cabral Costa Tiago Roxo Hugo Manuel Proença Pedro R. M. Inácio AAML 37 49 0 18 May 2023
Explainability and Robustness of Deep Visual Classification Models Jindong Gu AAML 39 2 0 03 Jan 2023
On the interplay of adversarial robustness and architecture components: patches, convolution and attention Francesco Croce Matthias Hein 41 6 0 14 Sep 2022
Exploring Adversarial Robustness of Vision Transformers in the Spectral Perspective Gihyun Kim Juyeop Kim Jong-Seok Lee AAML ViT 21 4 0 20 Aug 2022
Towards Efficient Adversarial Training on Vision Transformers Boxi Wu Jindong Gu Zhifeng Li Deng Cai Xiaofei He Wei Liu ViT AAML 35 37 0 21 Jul 2022
Decision-based Black-box Attack Against Vision Transformers via Patch-wise Adversarial Removal Yucheng Shi Yahong Han Yu-an Tan Xiaohui Kuang 38 30 0 07 Dec 2021
Are Transformers More Robust Than CNNs? Yutong Bai Jieru Mei Alan Yuille Cihang Xie ViT AAML 192 257 0 10 Nov 2021
Understanding and Improving Robustness of Vision Transformers through Patch-based Negative Augmentation Yao Qin Chiyuan Zhang Ting Chen Balaji Lakshminarayanan Alex Beutel Xuezhi Wang ViT 50 42 0 15 Oct 2021
Certified Patch Robustness via Smoothed Vision Transformers Hadi Salman Saachi Jain Eric Wong Aleksander Mkadry AAML 67 58 0 11 Oct 2021
Intriguing Properties of Vision Transformers Muzammal Naseer Kanchana Ranasinghe Salman Khan Munawar Hayat F. Khan Ming-Hsuan Yang ViT 256 620 0 21 May 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 271 2,603 0 04 May 2021
Visformer: The Vision-friendly Transformer Zhengsu Chen Lingxi Xie Jianwei Niu Xuefeng Liu Longhui Wei Qi Tian ViT 117 209 0 26 Apr 2021
Transformer in Transformer Kai Han An Xiao Enhua Wu Jianyuan Guo Chunjing Xu Yunhe Wang ViT 284 1,524 0 27 Feb 2021