On the unreasonable vulnerability of transformers for image restoration -- and an easy fix

25 July 2023

Shashank Agnihotri

Kanchana Vaishnavi Gandikota

Julia Grabinski

Paramanand Chandramouli

Margret Keuper

ArXiv PDF HTML

Papers citing "On the unreasonable vulnerability of transformers for image restoration -- and an easy fix"

48 / 48 papers shown

Title
FAIR-TAT: Improving Model Fairness Using Targeted Adversarial Training Tejaswini Medi Steffen Jung Margret Keuper AAML 77 3 0 30 Oct 2024
CosPGD: an efficient white-box adversarial attack for pixel-wise prediction tasks Shashank Agnihotri Steffen Jung Margret Keuper AAML 52 21 0 04 Feb 2023
On Adversarial Robustness of Deep Image Deblurring Kanchana Vaishnavi Gandikota Paramanand Chandramouli Michael Moeller 61 11 0 05 Oct 2022
Swin2SR: SwinV2 Transformer for Compressed Image Super-Resolution and Restoration Marcos V. Conde Ui-Jin Choi Maxime Burchi Radu Timofte ViT 80 139 0 22 Sep 2022
On the interplay of adversarial robustness and architecture components: patches, convolution and attention Francesco Croce Matthias Hein 66 6 0 14 Sep 2022
Robust Real-World Image Super-Resolution against Adversarial Attacks N. Babaguchi John R. Smith Pengxu Wei T. Plagemann Rong Yan AAML 70 26 0 31 Jul 2022
SegPGD: An Effective and Efficient Adversarial Attack for Evaluating and Boosting Segmentation Robustness Jindong Gu Hengshuang Zhao Volker Tresp Philip Torr AAML 40 74 0 25 Jul 2022
An Impartial Take to the CNN vs Transformer Robustness Contest Francesco Pinto Philip Torr P. Dokania UQCV AAML 47 49 0 22 Jul 2022
Can CNNs Be More Robust Than Transformers? Zeyu Wang Yutong Bai Yuyin Zhou Cihang Xie UQCV OOD 35 46 0 07 Jun 2022
DRT: A Lightweight Single Image Deraining Recursive Transformer Yuan Liang Saeed Anwar Yang Liu ViT 34 48 0 25 Apr 2022
Simple Baselines for Image Restoration Liangyu Chen Xiaojie Chu Xinming Zhang Jian Sun 79 862 0 10 Apr 2022
Stripformer: Strip Transformer for Fast Image Deblurring Fu-Jen Tsai Yan-Tsung Peng Yen-Yu Lin Chung-Chi Tsai Chia-Wen Lin ViT 42 174 0 10 Apr 2022
Towards Robust Rain Removal Against Adversarial Attacks: A Comprehensive Benchmark Analysis and Beyond Yi Yu Wenhan Yang Yap-Peng Tan Alex C. Kot AAML 54 62 0 31 Mar 2022
Towards Adversarially Robust Deep Image Denoising Hanshu Yan Jingfeng Zhang Jiashi Feng Masashi Sugiyama Vincent Y. F. Tan DiffM 27 16 0 12 Jan 2022
A ConvNet for the 2020s Zhuang Liu Hanzi Mao Chaozheng Wu Christoph Feichtenhofer Trevor Darrell Saining Xie ViT 65 5,102 0 10 Jan 2022
MAXIM: Multi-Axis MLP for Image Processing Zhengzhong Tu Hossein Talebi Han Zhang Feng Yang P. Milanfar A. Bovik Yinxiao Li 78 469 0 09 Jan 2022
TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions Jeya Maria Jose Valanarasu R. Yasarla Vishal M. Patel ViT 82 282 0 29 Nov 2021
Restormer: Efficient Transformer for High-Resolution Image Restoration Syed Waqas Zamir Aditya Arora Salman Khan Munawar Hayat Fahad Shahbaz Khan Ming-Hsuan Yang ViT 123 2,188 0 18 Nov 2021
Are Transformers More Robust Than CNNs? Yutong Bai Jieru Mei Alan Yuille Cihang Xie ViT AAML 218 262 0 10 Nov 2021
RobustART: Benchmarking Robustness on Architecture Design and Training Techniques Shiyu Tang Ruihao Gong Yan Wang Aishan Liu Jiakai Wang ... Xianglong Liu D. Song Alan Yuille Philip Torr Dacheng Tao VLM AAML 31 107 0 11 Sep 2021
SwinIR: Image Restoration Using Swin Transformer Christos Sakaridis Jie Cao Guolei Sun Peng Sun Luc Van Gool Radu Timofte ViT 165 2,862 0 23 Aug 2021
XCiT: Cross-Covariance Image Transformers Alaaeldin El-Nouby Hugo Touvron Mathilde Caron Piotr Bojanowski Matthijs Douze ... Ivan Laptev Natalia Neverova Gabriel Synnaeve Jakob Verbeek Hervé Jégou ViT 112 508 0 17 Jun 2021
Uformer: A General U-Shaped Transformer for Image Restoration Zhendong Wang Xiaodong Cun Jianmin Bao Wengang Zhou Jianzhuang Liu Houqiang Li ViT 76 1,385 0 06 Jun 2021
Vision Transformers are Robust Learners Sayak Paul Pin-Yu Chen ViT 50 310 0 17 May 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 381 2,638 0 04 May 2021
Deep Image Destruction: Vulnerability of Deep Image-to-Image Models against Adversarial Attacks Jun-Ho Choi Huan Zhang Jun-Hyuk Kim Cho-Jui Hsieh Jong-Seok Lee VLM 39 7 0 30 Apr 2021
On the Robustness of Vision Transformers to Adversarial Examples Kaleel Mahmood Rigel Mahmood Marten van Dijk ViT 83 221 0 31 Mar 2021
On the Adversarial Robustness of Vision Transformers Rulin Shao Zhouxing Shi Jinfeng Yi Pin-Yu Chen Cho-Jui Hsieh ViT 58 138 0 29 Mar 2021
Understanding Robustness of Transformers for Image Classification Srinadh Bhojanapalli Ayan Chakrabarti Daniel Glasner Daliang Li Thomas Unterthiner Andreas Veit ViT 47 382 0 26 Mar 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 319 21,175 0 25 Mar 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 371 40,217 0 22 Oct 2020
Single Image Super-Resolution via a Holistic Attention Network Ben Niu Weilei Wen Wenqi Ren Xiangde Zhang Lianping Yang Shuzhen Wang Kaihao Zhang Xiaochun Cao Haifeng Shen SupR 49 621 0 20 Aug 2020
Cross-Scale Internal Graph Neural Network for Image Super-Resolution Shangchen Zhou Jiawei Zhang W. Zuo Chen Change Loy SupR 42 212 0 30 Jun 2020
Smooth Adversarial Training Cihang Xie Mingxing Tan Boqing Gong Alan Yuille Quoc V. Le OOD 54 152 0 25 Jun 2020
Spatially-Attentive Patch-Hierarchical Network for Adaptive Motion Deblurring Maitreya Suin Kuldeep Purohit A. N. Rajagopalan 3DV 49 281 0 11 Apr 2020
Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov Lucas Beyer Xiaohua Zhai J. Puigcerver Jessica Yung Sylvain Gelly N. Houlsby MQ 217 1,196 0 24 Dec 2019
Evaluating Robustness of Deep Image Super-Resolution against Adversarial Attacks Jun-Ho Choi Huan Zhang Jun-Hyuk Kim Cho-Jui Hsieh Jong-Seok Lee AAML SupR 46 70 0 12 Apr 2019
Adversarial Robustness vs Model Compression, or Both? Shaokai Ye Kaidi Xu Sijia Liu Jan-Henrik Lambrechts Huan Zhang Aojun Zhou Kaisheng Ma Yanzhi Wang Xue Lin AAML 44 164 0 29 Mar 2019
Benchmarking Neural Network Robustness to Common Corruptions and Perturbations Dan Hendrycks Thomas G. Dietterich OOD VLM 105 3,399 0 28 Mar 2019
Squeeze-and-Excitation Networks Jie Hu Li Shen Samuel Albanie Gang Sun Enhua Wu 336 26,241 0 05 Sep 2017
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 227 11,962 0 19 Jun 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 443 129,831 0 12 Jun 2017
Language Modeling with Gated Convolutional Networks Yann N. Dauphin Angela Fan Michael Auli David Grangier 195 2,377 0 23 Dec 2016
Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring Seungjun Nah Tae Hyun Kim Kyoung Mu Lee 127 1,959 0 07 Dec 2016
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 159 4,958 0 27 Jun 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.4K 192,638 0 10 Dec 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.2K 76,547 0 18 May 2015
Explaining and Harnessing Adversarial Examples Ian Goodfellow Jonathon Shlens Christian Szegedy AAML GAN 163 18,922 0 20 Dec 2014