Understanding Robustness of Transformers for Image Classification

26 March 2021

Srinadh Bhojanapalli

Papers citing "Understanding Robustness of Transformers for Image Classification"

50 / 90 papers shown

Title
Benchmarking the Spatial Robustness of DNNs via Natural and Adversarial Localized Corruptions Giulia Marchiori Pietrosanti Giulio Rossolini Alessandro Biondi Giorgio Buttazzo AAML 89 0 0 02 Apr 2025
Reasoning Bias of Next Token Prediction Training Pengxiao Lin Zhongwang Zhang Zhi-Qin John Xu LRM 94 2 0 21 Feb 2025
Exploring the Adversarial Robustness of CLIP for AI-generated Image Detection Vincenzo De Rosa Fabrizio Guillaro Giovanni Poggi D. Cozzolino L. Verdoliva AAML 65 5 0 28 Jul 2024
Transformer Layers as Painters Qi Sun Marc Pickett Aakash Kumar Nain Llion Jones AI4CE 31 13 0 12 Jul 2024
DistilDoc: Knowledge Distillation for Visually-Rich Document Applications Jordy Van Landeghem Subhajit Maity Ayan Banerjee Matthew Blaschko Marie-Francine Moens Josep Lladós Sanket Biswas 50 2 0 12 Jun 2024
Benchmarking the Robustness of Temporal Action Detection Models Against Temporal Corruptions Runhao Zeng Xiaoyong Chen Jiaming Liang Huisi Wu Guangzhong Cao Yong Guo AAML 39 3 0 29 Mar 2024
Adversarial Testing for Visual Grounding via Image-Aware Property Reduction Zhiyuan Chang Mingyang Li Junjie Wang Cheng Li Boyu Wu Fanjiang Xu Qing Wang AAML 36 0 0 02 Mar 2024
MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness Xiaoyun Xu Shujian Yu Jingzheng Wu S. Picek AAML 35 0 0 08 Dec 2023
What Makes Pre-Trained Visual Representations Successful for Robust Manipulation? Kaylee Burns Zach Witzel Jubayer Ibn Hamid Tianhe Yu Chelsea Finn Karol Hausman OOD SSL 32 22 0 03 Nov 2023
Artifact-Robust Graph-Based Learning in Digital Pathology Saba Heidari Gheshlaghi Milan Aryal Nasim Yahyasoltani Masoud Ganji OOD 27 0 0 27 Oct 2023
Investigating the Robustness and Properties of Detection Transformers (DETR) Toward Difficult Images Zhao Ning Zou Yuhang Zhang Robert Wijaya 25 0 0 12 Oct 2023
EViT: An Eagle Vision Transformer with Bi-Fovea Self-Attention Yulong Shi Mingwei Sun Yongshuai Wang Hui Sun Zengqiang Chen 34 4 0 10 Oct 2023
Leveraging the Power of Data Augmentation for Transformer-based Tracking Jie Zhao Johan Edstedt M. Felsberg D. Wang Huchuan Lu ViT 27 4 0 15 Sep 2023
Learning Diverse Features in Vision Transformers for Improved Generalization A. Nicolicioiu Andrei Liviu Nicolicioiu B. Alexe Damien Teney 33 3 0 30 Aug 2023
VisAlign: Dataset for Measuring the Degree of Alignment between AI and Humans in Visual Perception Jiyoung Lee Seung Wook Kim Seunghyun Won Joonseok Lee Marzyeh Ghassemi James Thorne Jaeseok Choi O.-Kil Kwon Edward Choi 30 1 0 03 Aug 2023
On the unreasonable vulnerability of transformers for image restoration -- and an easy fix Shashank Agnihotri Kanchana Vaishnavi Gandikota Julia Grabinski Paramanand Chandramouli M. Keuper 32 9 0 25 Jul 2023
Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radar Runwei Guan Shanliang Yao Xiaohui Zhu Ka Lok Man Eng Gee Lim Jeremy S. Smith Yong 0001Yue Yutao Yue VOS 32 17 0 14 Jul 2023
Random Position Adversarial Patch for Vision Transformers Mingzhen Shao ViT AAML 38 2 0 09 Jul 2023
InvPT++: Inverted Pyramid Multi-Task Transformer for Visual Scene Understanding Hanrong Ye Dan Xu ViT 29 10 0 08 Jun 2023
On enhancing the robustness of Vision Transformers: Defensive Diffusion Raza Imam Muhammad Huzaifa Mohammed El-Amine Azz MedIm DiffM 41 5 0 14 May 2023
High-Resolution Synthetic RGB-D Datasets for Monocular Depth Estimation Aakash Rajpal N. Cheema K. Illgner-Fehns P. Slusallek S. Jaiswal MDE 3DV 40 12 0 02 May 2023
Token Boosting for Robust Self-Supervised Visual Transformer Pre-training Tianjiao Li Lin Geng Foo Ping Hu Xindi Shang Hossein Rahmani Zehuan Yuan Xiaozhong Liu 40 7 0 09 Apr 2023
Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Driving Zijian Zhu Yichi Zhang Hai Chen Yinpeng Dong Shu Zhao Wenbo Ding Jiachen Zhong Shibao Zheng AAML 3DPC 23 38 0 30 Mar 2023
Transferable Adversarial Attacks on Vision Transformers with Token Gradient Regularization Jianping Zhang Yizhan Huang Weibin Wu Michael R. Lyu AAML ViT 18 49 0 28 Mar 2023
Self-attention in Vision Transformers Performs Perceptual Grouping, Not Attention Paria Mehrani John K. Tsotsos 25 24 0 02 Mar 2023
A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinking Chang-Shu Liu Yinpeng Dong Wenzhao Xiang X. Yang Hang Su Junyi Zhu YueFeng Chen Yuan He H. Xue Shibao Zheng OOD VLM AAML 33 72 0 28 Feb 2023
MedViT: A Robust Vision Transformer for Generalized Medical Image Classification Omid Nejati Manzari Hamid Ahmadabadi Hossein Kashiani S. B. Shokouhi Ahmad Ayatollahi ViT MedIm 34 177 0 19 Feb 2023
Efficiency 360: Efficient Vision Transformers Badri N. Patro Vijay Srinivas Agneeswaran 26 6 0 16 Feb 2023
Out of Distribution Performance of State of Art Vision Model Salman Rahman W. Lee 40 2 0 25 Jan 2023
Exploiting Optical Flow Guidance for Transformer-Based Video Inpainting Kaiwen Zhang Jialun Peng Jingjing Fu Dong Liu ViT 27 8 0 24 Jan 2023
A Study on the Generality of Neural Network Structures for Monocular Depth Estimation Ji-Hoon Bae K. Hwang Sunghoon Im MDE 29 7 0 09 Jan 2023
Explainability and Robustness of Deep Visual Classification Models Jindong Gu AAML 41 2 0 03 Jan 2023
Representation Separation for Semantic Segmentation with Vision Transformers Yuanduo Hong Huihui Pan Weichao Sun Xinghu Yu Huijun Gao ViT 28 5 0 28 Dec 2022
Comparing the Decision-Making Mechanisms by Transformers and CNNs via Explanation Methods Ming-Xiu Jiang Saeed Khorram Li Fuxin FAtt 22 9 0 13 Dec 2022
Hierarchical Transformer for Survival Prediction Using Multimodality Whole Slide Images and Genomics Chunyuan Li Xinliang Zhu Jiawen Yao Junzhou Huang MedIm 30 11 0 29 Nov 2022
Vision Transformers in Medical Imaging: A Review Emerald U. Henry Onyeka Emebob C. Omonhinmin ViT MedIm 34 34 0 18 Nov 2022
FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformers Jinyu Chen Wenchao Xu Song Guo Junxiao Wang Jie Zhang Yining Qi FedML 28 32 0 15 Nov 2022
SSDA-YOLO: Semi-supervised Domain Adaptive YOLO for Cross-Domain Object Detection Huayi Zhou Fei Jiang Hongtao Lu ObjD 27 73 0 04 Nov 2022
FedTP: Federated Learning by Transformer Personalization Hongxia Li Zhongyi Cai Jingya Wang Jiangnan Tang Weiping Ding Chin-Teng Lin Ye-ling Shi FedML 38 59 0 03 Nov 2022
Evaluating Out-of-Distribution Performance on Document Image Classifiers Stefan Larson Gordon Lim Yutong Ai David Kuang Kevin Leach OODD OOD 37 18 0 14 Oct 2022
Curved Representation Space of Vision Transformers Juyeop Kim Junha Park Songkuk Kim Jongseok Lee ViT 38 6 0 11 Oct 2022
ViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpoints Yinpeng Dong Shouwei Ruan Hang Su Cai Kang Xingxing Wei Junyi Zhu AAML 30 49 0 08 Oct 2022
A Light Recipe to Train Robust Vision Transformers Edoardo Debenedetti Vikash Sehwag Prateek Mittal ViT 32 68 0 15 Sep 2022
On the interplay of adversarial robustness and architecture components: patches, convolution and attention Francesco Croce Matthias Hein 41 6 0 14 Sep 2022
CLUDA : Contrastive Learning in Unsupervised Domain Adaptation for Semantic Segmentation Midhun Vayyat Jaswin Kasi Anuraag Bhattacharya Shuaib Ahmed Rahul Tallamraju 33 18 0 27 Aug 2022
Exploring Adversarial Robustness of Vision Transformers in the Spectral Perspective Gihyun Kim Juyeop Kim Jong-Seok Lee AAML ViT 24 4 0 20 Aug 2022
Flow-Guided Transformer for Video Inpainting Kaiwen Zhang Jingjing Fu Dong Liu ViT 35 68 0 14 Aug 2022
Self-Ensembling Vision Transformer (SEViT) for Robust Medical Image Classification Faris Almalik Mohammad Yaqub Karthik Nandakumar ViT AAML MedIm 29 33 0 04 Aug 2022
Understanding Adversarial Robustness of Vision Transformers via Cauchy Problem Zheng Wang Wenjie Ruan ViT 42 8 0 01 Aug 2022
Towards Efficient Adversarial Training on Vision Transformers Boxi Wu Jindong Gu Zhifeng Li Deng Cai Xiaofei He Wei Liu ViT AAML 46 38 0 21 Jul 2022