v1v2v3 (latest)

Shift Invariance Can Reduce Adversarial Robustness

3 March 2021

Papers citing "Shift Invariance Can Reduce Adversarial Robustness"

50 / 50 papers shown

Title
On the Adversarial Robustness of Vision Transformers Rulin Shao Zhouxing Shi Jinfeng Yi Pin-Yu Chen Cho-Jui Hsieh ViT 74 145 0 29 Mar 2021
Truly shift-invariant convolutional neural networks Anadi Chaman Ivan Dokmanić 63 71 0 28 Nov 2020
$Most ReLU Networks Suffer from $\ell^2$ Adversarial Perturbations$ Most ReLU Networks Suffer from $\ell^2$ Adversarial Perturbations Amit Daniely Hadas Shacham MLT 29 16 0 28 Oct 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 667 41,369 0 22 Oct 2020
Mind the Pad -- CNNs can Develop Blind Spots B. Alsallakh Narine Kokhlikyan Vivek Miglani Jun Yuan Orion Reblitz-Richardson 56 75 0 05 Oct 2020
Deep Neural Tangent Kernel and Laplace Kernel Have the Same RKHS Lin Chen Sheng Xu 137 94 0 22 Sep 2020
Towards Learning Convolutions from Scratch Behnam Neyshabur SSL 286 71 0 27 Jul 2020
On the Similarity between the Laplace and Neural Tangent Kernels Amnon Geifman A. Yadav Yoni Kasten Meirav Galun David Jacobs Ronen Basri 120 94 0 03 Jul 2020
Tensor Programs II: Neural Tangent Kernel for Any Architecture Greg Yang 114 136 0 25 Jun 2020
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains Matthew Tancik Pratul P. Srinivasan B. Mildenhall Sara Fridovich-Keil N. Raghavan Utkarsh Singhal R. Ramamoorthi Jonathan T. Barron Ren Ng 124 2,421 0 18 Jun 2020
The Recurrent Neural Tangent Kernel Sina Alemohammad Zichao Wang Randall Balestriero Richard Baraniuk AAML 54 78 0 18 Jun 2020
The Pitfalls of Simplicity Bias in Neural Networks Harshay Shah Kaustav Tamuly Aditi Raghunathan Prateek Jain Praneeth Netrapalli AAML 69 361 0 13 Jun 2020
On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Location O. Kayhan Jan van Gemert 307 236 0 16 Mar 2020
Frequency Bias in Neural Networks for Input of Non-Uniform Density Ronen Basri Meirav Galun Amnon Geifman David Jacobs Yoni Kasten S. Kritchman 84 185 0 10 Mar 2020
Why Do Deep Residual Networks Generalize Better than Deep Feedforward Networks? -- A Neural Tangent Kernel Perspective Kaixuan Huang Yuqing Wang Molei Tao T. Zhao MLT 51 98 0 14 Feb 2020
More Data Can Expand the Generalization Gap Between Adversarially Robust and Standard Models Lin Chen Yifei Min Mingrui Zhang Amin Karbasi OOD 68 64 0 11 Feb 2020
Enhanced Convolutional Neural Tangent Kernels Zhiyuan Li Ruosong Wang Dingli Yu S. Du Wei Hu Ruslan Salakhutdinov Sanjeev Arora 68 133 0 03 Nov 2019
Making an Invisibility Cloak: Real World Adversarial Attacks on Object Detectors Zuxuan Wu Ser-Nam Lim L. Davis Tom Goldstein AAML 123 265 0 31 Oct 2019
Harnessing the Power of Infinitely Wide Deep Nets on Small-data Tasks Sanjeev Arora S. Du Zhiyuan Li Ruslan Salakhutdinov Ruosong Wang Dingli Yu AAML 66 162 0 03 Oct 2019
The Convergence Rate of Neural Networks for Learned Functions of Different Frequencies Ronen Basri David Jacobs Yoni Kasten S. Kritchman 75 218 0 02 Jun 2019
Graph Neural Tangent Kernel: Fusing Graph Neural Networks with Graph Kernels S. Du Kangcheng Hou Barnabás Póczós Ruslan Salakhutdinov Ruosong Wang Keyulu Xu 135 276 0 30 May 2019
On the Inductive Bias of Neural Tangent Kernels A. Bietti Julien Mairal 88 259 0 29 May 2019
High Frequency Component Helps Explain the Generalization of Convolutional Neural Networks Haohan Wang Xindi Wu Pengcheng Yin Eric Xing 61 524 0 28 May 2019
Batch Normalization is a Cause of Adversarial Vulnerability A. Galloway A. Golubeva T. Tanay M. Moussa Graham W. Taylor ODL AAML 66 80 0 06 May 2019
On Exact Computation with an Infinitely Wide Neural Net Sanjeev Arora S. Du Wei Hu Zhiyuan Li Ruslan Salakhutdinov Ruosong Wang 226 926 0 26 Apr 2019
Making Convolutional Networks Shift-Invariant Again Richard Y. Zhang OOD 93 798 0 25 Apr 2019
A Simple Explanation for the Existence of Adversarial Examples with Small Hamming Distance A. Shamir Itay Safran Eyal Ronen O. Dunkelman GAN AAML 37 95 0 30 Jan 2019
Adversarial Robustness May Be at Odds With Simplicity Preetum Nakkiran AAML 85 108 0 02 Jan 2019
Decoupling Direction and Norm for Efficient Gradient-Based L2 Adversarial Attacks and Defenses Jérôme Rony L. G. Hafemann Luiz Eduardo Soares de Oliveira Ismail Ben Ayed R. Sabourin Eric Granger AAML 57 298 0 23 Nov 2018
Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers Zeyuan Allen-Zhu Yuanzhi Li Yingyu Liang MLT 201 773 0 12 Nov 2018
A Convergence Theory for Deep Learning via Over-Parameterization Zeyuan Allen-Zhu Yuanzhi Li Zhao Song AI4CE ODL 264 1,466 0 09 Nov 2018
Gradient Descent Finds Global Minima of Deep Neural Networks S. Du Jason D. Lee Haochuan Li Liwei Wang Masayoshi Tomizuka ODL 209 1,135 0 09 Nov 2018
On the Geometry of Adversarial Examples Marc Khoury Dylan Hadfield-Menell AAML 59 79 0 01 Nov 2018
Excessive Invariance Causes Adversarial Vulnerability J. Jacobsen Jens Behrmann R. Zemel Matthias Bethge AAML 68 166 0 01 Nov 2018
Gradient Descent Provably Optimizes Over-parameterized Neural Networks S. Du Xiyu Zhai Barnabás Póczós Aarti Singh MLT ODL 224 1,275 0 04 Oct 2018
Are adversarial examples inevitable? Ali Shafahi Wenjie Huang Christoph Studer Soheil Feizi Tom Goldstein SILM 72 283 0 06 Sep 2018
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min Lin Fred Hamprecht Yoshua Bengio Aaron Courville 154 1,451 0 22 Jun 2018
Neural Tangent Kernel: Convergence and Generalization in Neural Networks Arthur Jacot Franck Gabriel Clément Hongler 269 3,213 0 20 Jun 2018
Why do deep convolutional networks generalize so poorly to small image transformations? Aharon Azulay Yair Weiss 77 561 0 30 May 2018
Robustness May Be at Odds with Accuracy Dimitris Tsipras Shibani Santurkar Logan Engstrom Alexander Turner Aleksander Madry AAML 106 1,783 0 30 May 2018
Adversarially Robust Generalization Requires More Data Ludwig Schmidt Shibani Santurkar Dimitris Tsipras Kunal Talwar Aleksander Madry OOD AAML 149 794 0 30 Apr 2018
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 283 8,904 0 25 Aug 2017
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 310 12,117 0 19 Jun 2017
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 775 36,861 0 25 Aug 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 335 8,169 0 13 Aug 2016
Group Equivariant Convolutional Networks Taco S. Cohen Max Welling BDL 171 1,941 0 24 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,322 0 10 Dec 2015
Explaining and Harnessing Adversarial Examples Ian Goodfellow Jonathon Shlens Christian Szegedy AAML GAN 280 19,107 0 20 Dec 2014
One weird trick for parallelizing convolutional neural networks A. Krizhevsky GNN 90 1,303 0 23 Apr 2014
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 277 14,961 1 21 Dec 2013