Are Transformers More Robust Than CNNs?

10 November 2021

Jieru Mei

Cihang Xie

Papers citing "Are Transformers More Robust Than CNNs?"

50 / 57 papers shown

Title
Relaxed Equivariance via Multitask Learning Ahmed A. A. Elhag T. Konstantin Rusch Francesco Di Giovanni Michael Bronstein 42 2 0 23 Oct 2024
Equivariant Machine Learning Decoder for 3D Toric Codes Oliver Weissl Evgenii Egorov 22 0 0 06 Sep 2024
Exploring the Adversarial Robustness of CLIP for AI-generated Image Detection Vincenzo De Rosa Fabrizio Guillaro Giovanni Poggi D. Cozzolino L. Verdoliva AAML 59 5 0 28 Jul 2024
PartImageNet++ Dataset: Scaling up Part-based Models for Robust Recognition Xiao-Li Li Yining Liu Na Dong Sitian Qin Xiaolin Hu 36 3 0 15 Jul 2024
Benchmarking the Robustness of Temporal Action Detection Models Against Temporal Corruptions Runhao Zeng Xiaoyong Chen Jiaming Liang Huisi Wu Guangzhong Cao Yong Guo AAML 34 3 0 29 Mar 2024
Approximate Nullspace Augmented Finetuning for Robust Vision Transformers Haoyang Liu Aditya Singh Yijiang Li Haohan Wang AAML ViT 31 1 0 15 Mar 2024
Learning Low-Rank Feature for Thorax Disease Classification Rajeev Goel Utkarsh Nath Yancheng Wang Alvin C. Silva Teresa Wu Yingzhen Yang 20 0 0 14 Feb 2024
Floralens: a Deep Learning Model for the Portuguese Native Flora António Filgueiras Eduardo R. B. Marques Luís M. B. Lopes Miguel Marques Hugo Silva 27 0 0 13 Feb 2024
MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness Xiaoyun Xu Shujian Yu Jingzheng Wu S. Picek AAML 35 0 0 08 Dec 2023
Improving Interpretation Faithfulness for Vision Transformers Lijie Hu Yixin Liu Ninghao Liu Mengdi Huai Lichao Sun Di Wang 21 5 0 29 Nov 2023
On the unreasonable vulnerability of transformers for image restoration -- and an easy fix Shashank Agnihotri Kanchana Vaishnavi Gandikota Julia Grabinski Paramanand Chandramouli M. Keuper 32 9 0 25 Jul 2023
COCO-O: A Benchmark for Object Detectors under Natural Distribution Shifts Xiaofeng Mao YueFeng Chen Yao Zhu Da Chen Hang Su Rong Zhang H. Xue ObjD OOD 33 18 0 24 Jul 2023
Mitigating Adversarial Vulnerability through Causal Parameter Estimation by Adversarial Double Machine Learning Byung-Kwan Lee Junho Kim Yonghyun Ro AAML 10 9 0 14 Jul 2023
Intra- & Extra-Source Exemplar-Based Style Synthesis for Improved Domain Generalization Yumeng Li Dan Zhang M. Keuper Anna Khoreva 46 10 0 02 Jul 2023
InvPT++: Inverted Pyramid Multi-Task Transformer for Visual Scene Understanding Hanrong Ye Dan Xu ViT 25 10 0 08 Jun 2023
How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defenses Joana Cabral Costa Tiago Roxo Hugo Manuel Proença Pedro R. M. Inácio AAML 32 49 0 18 May 2023
Token Boosting for Robust Self-Supervised Visual Transformer Pre-training Tianjiao Li Lin Geng Foo Ping Hu Xindi Shang Hossein Rahmani Zehuan Yuan J. Liu 32 7 0 09 Apr 2023
Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Driving Zijian Zhu Yichi Zhang Hai Chen Yinpeng Dong Shu Zhao Wenbo Ding Jiachen Zhong Shibao Zheng AAML 3DPC 15 38 0 30 Mar 2023
SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspective Xiwei Xuan Ziquan Deng Hsuan-Tien Lin Z. Kong Kwan-Liu Ma AAML FAtt 24 2 0 01 Mar 2023
A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinking Chang-Shu Liu Yinpeng Dong Wenzhao Xiang X. Yang Hang Su Junyi Zhu YueFeng Chen Yuan He H. Xue Shibao Zheng OOD VLM AAML 17 72 0 28 Feb 2023
Making Substitute Models More Bayesian Can Enhance Transferability of Adversarial Examples Qizhang Li Yiwen Guo W. Zuo Hao Chen AAML 27 35 0 10 Feb 2023
Beyond Pretrained Features: Noisy Image Modeling Provides Adversarial Defense Zunzhi You Daochang Liu Bohyung Han Chang Xu AAML VLM 41 4 0 02 Feb 2023
Weight Prediction Boosts the Convergence of AdamW Lei Guan 18 15 0 01 Feb 2023
Inference Time Evidences of Adversarial Attacks for Forensic on Transformers Hugo Lemarchant Liang Li Yiming Qian Yuta Nakashima Hajime Nagahara ViT AAML 38 0 0 31 Jan 2023
Out of Distribution Performance of State of Art Vision Model Salman Rahman W. Lee 24 2 0 25 Jan 2023
Finding Differences Between Transformers and ConvNets Using Counterfactual Simulation Testing Nataniel Ruiz Sarah Adel Bargal Cihang Xie Kate Saenko Stan Sclaroff ViT 30 5 0 29 Nov 2022
Are Deep Sequence Classifiers Good at Non-Trivial Generalization? Francesco Cazzaro A. Quattoni X. Carreras MQ 15 0 0 24 Oct 2022
1st Place Solution of The Robust Vision Challenge 2022 Semantic Segmentation Track Junfei Xiao Zhichao Xu Shiyi Lan Zhiding Yu Alan Yuille Anima Anandkumar 11 5 0 23 Oct 2022
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification Junfei Xiao Yutong Bai Alan Yuille Zongwei Zhou MedIm ViT 30 58 0 23 Oct 2022
Diffusion Visual Counterfactual Explanations Maximilian Augustin Valentyn Boreiko Francesco Croce Matthias Hein DiffM BDL 25 68 0 21 Oct 2022
When Adversarial Training Meets Vision Transformers: Recipes from Training to Architecture Yi Mo Dongxian Wu Yifei Wang Yiwen Guo Yisen Wang ViT 32 52 0 14 Oct 2022
Evaluating Out-of-Distribution Performance on Document Image Classifiers Stefan Larson Gordon Lim Yutong Ai David Kuang Kevin Leach OODD OOD 29 18 0 14 Oct 2022
Curved Representation Space of Vision Transformers Juyeop Kim Junha Park Songkuk Kim Jongseok Lee ViT 28 6 0 11 Oct 2022
ViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpoints Yinpeng Dong Shouwei Ruan Hang Su Cai Kang Xingxing Wei Junyi Zhu AAML 28 50 0 08 Oct 2022
The Geometry of Self-supervised Learning Models and its Impact on Transfer Learning Romain Cosentino Sarath Shekkizhar Mahdi Soltanolkotabi A. Avestimehr Antonio Ortega SSL 46 7 0 18 Sep 2022
A Light Recipe to Train Robust Vision Transformers Edoardo Debenedetti Vikash Sehwag Prateek Mittal ViT 19 68 0 15 Sep 2022
On the interplay of adversarial robustness and architecture components: patches, convolution and attention Francesco Croce Matthias Hein 37 6 0 14 Sep 2022
Bag of Tricks for FGSM Adversarial Training Zichao Li Li Liu Zeyu Wang Yuyin Zhou Cihang Xie AAML 23 6 0 06 Sep 2022
Exploring Adversarial Robustness of Vision Transformers in the Spectral Perspective Gihyun Kim Juyeop Kim Jong-Seok Lee AAML ViT 11 4 0 20 Aug 2022
An Impartial Take to the CNN vs Transformer Robustness Contest Francesco Pinto Philip H. S. Torr P. Dokania UQCV AAML 22 48 0 22 Jul 2022
Contrastive Self-Supervised Learning Leads to Higher Adversarial Susceptibility Rohit Gupta Naveed Akhtar Ajmal Saeed Mian M. Shah AAML SSL 21 5 0 22 Jul 2022
Towards Efficient Adversarial Training on Vision Transformers Boxi Wu Jindong Gu Zhifeng Li Deng Cai Xiaofei He Wei Liu ViT AAML 30 37 0 21 Jul 2022
Assaying Out-Of-Distribution Generalization in Transfer Learning F. Wenzel Andrea Dittadi Peter V. Gehler Carl-Johann Simon-Gabriel Max Horn ... Chris Russell Thomas Brox Bernt Schiele Bernhard Schölkopf Francesco Locatello OOD OODD AAML 49 71 0 19 Jul 2022
Benchmarking the Robustness of Deep Neural Networks to Common Corruptions in Digital Pathology Yunlong Zhang Yuxuan Sun Honglin Li S. Zheng Chenglu Zhu L. Yang OOD 56 27 0 30 Jun 2022
EVAC+: Multi-scale V-net with Deep Feature CRF Layers for Brain Extraction Jong Sung Park S. Fadnavis Eleftherios Garyfallidis 34 0 0 06 Jun 2022
Guided Diffusion Model for Adversarial Purification Jinyi Wang Zhaoyang Lyu Dahua Lin Bo Dai Hongfei Fu DiffM 193 82 0 30 May 2022
MulT: An End-to-End Multitask Learning Transformer Deblina Bhattacharjee Tong Zhang Sabine Süsstrunk Mathieu Salzmann ViT 34 62 0 17 May 2022
Diffusion Models for Adversarial Purification Weili Nie Brandon Guo Yujia Huang Chaowei Xiao Arash Vahdat Anima Anandkumar WIGM 195 417 0 16 May 2022
Deeper Insights into the Robustness of ViTs towards Common Corruptions Rui Tian Zuxuan Wu Qi Dai Han Hu Yu-Gang Jiang ViT AAML 18 4 0 26 Apr 2022
Revisiting the Adversarial Robustness-Accuracy Tradeoff in Robot Learning Mathias Lechner Alexander Amini Daniela Rus T. Henzinger AAML 21 9 0 15 Apr 2022