The Robustness Limits of SoTA Vision Models to Natural Variation

24 October 2022

Papers citing "The Robustness Limits of SoTA Vision Models to Natural Variation"

35 / 35 papers shown

Title
MoENAS: Mixture-of-Expert based Neural Architecture Search for jointly Accurate, Fair, and Robust Edge Deep Neural Networks Lotfi Abdelkrim Mecharbat Alberto Marchisio Mohamed Bennai M. Ghassemi Tuka Alhanai 169 0 0 11 Feb 2025
Progress and limitations of deep networks to recognize objects in unusual poses Amro Abbas Stéphane Deny OOD AAML 41 17 0 16 Jul 2022
Training Compute-Optimal Large Language Models Jordan Hoffmann Sebastian Borgeaud A. Mensch Elena Buchatskaya Trevor Cai ... Karen Simonyan Erich Elsen Jack W. Rae Oriol Vinyals Laurent Sifre AI4TS 208 1,976 0 29 Mar 2022
High Fidelity Visualization of What Your Self-Supervised Representation Knows About Florian Bordes Randall Balestriero Pascal Vincent DiffM 65 65 0 16 Dec 2021
iBOT: Image BERT Pre-Training with Online Tokenizer Jinghao Zhou Chen Wei Huiyu Wang Wei Shen Cihang Xie Alan Yuille Tao Kong 83 740 0 15 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 467 7,814 0 11 Nov 2021
When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning? Lijie Fan Sijia Liu Pin-Yu Chen Gaoyuan Zhang Chuang Gan AAML VLM 78 124 0 01 Nov 2021
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 260 497 0 01 Oct 2021
Grounding inductive biases in natural images:invariance stems from variations in data Diane Bouchacourt Mark Ibrahim Ari S. Morcos OOD 68 26 0 09 Jun 2021
Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style Julius von Kügelgen Yash Sharma Luigi Gresele Wieland Brendel Bernhard Schölkopf M. Besserve Francesco Locatello 99 317 0 08 Jun 2021
Scaling Vision Transformers Xiaohua Zhai Alexander Kolesnikov N. Houlsby Lucas Beyer ViT 138 1,092 0 08 Jun 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 317 711 0 22 Apr 2021
Self-supervised Pretraining of Visual Features in the Wild Priya Goyal Mathilde Caron Benjamin Lefaudeux Min Xu Pengchao Wang ... Mannat Singh Vitaliy Liptchinsky Ishan Misra Armand Joulin Piotr Bojanowski VLM SSL 76 274 0 02 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 967 29,731 0 26 Feb 2021
Bridging Composite and Real: Towards End-to-end Deep Image Matting Jizhizi Li Jing Zhang Stephen J. Maybank Dacheng Tao 75 117 0 30 Oct 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 667 41,369 0 22 Oct 2020
On the surprising similarities between supervised and self-supervised models Robert Geirhos Kantharaju Narayanappa Benjamin Mitzkus Matthias Bethge Felix Wichmann Wieland Brendel OOD SSL DRL 112 48 0 16 Oct 2020
A Framework For Contrastive Self-Supervised Learning And Designing A New Approach William Falcon Kyunghyun Cho SSL 67 104 0 31 Aug 2020
When and how CNNs generalize to out-of-distribution category-viewpoint combinations Spandan Madan Timothy M. Henry Jamell Dozier Helen Ho Nishchal Bhandari Tomotake Sasaki F. Durand Hanspeter Pfister Xavier Boix OOD 93 25 0 15 Jul 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 246 4,097 0 17 Jun 2020
Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning Tianlong Chen Sijia Liu Shiyu Chang Yu Cheng Lisa Amini Zhangyang Wang AAML 61 250 0 28 Mar 2020
On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Location O. Kayhan Jan van Gemert 307 236 0 16 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 375 18,859 0 13 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 608 4,893 0 23 Jan 2020
Natural Adversarial Examples Dan Hendrycks Kevin Zhao Steven Basart Jacob Steinhardt Basel Alomair OODD 212 1,482 0 16 Jul 2019
Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty Dan Hendrycks Mantas Mazeika Saurav Kadavath Basel Alomair OOD SSL 56 948 0 28 Jun 2019
On the Transfer of Inductive Bias from Simulation to the Real World: a New Disentanglement Dataset Muhammad Waleed Gondal Manuel Wüthrich Ðorðe Miladinovic Francesco Locatello M. Breidt V. Volchkov J. Akpo Olivier Bachem Bernhard Schölkopf Stefan Bauer OOD DRL 99 138 0 07 Jun 2019
Making Convolutional Networks Shift-Invariant Again Richard Y. Zhang OOD 93 798 0 25 Apr 2019
Strike (with) a Pose: Neural Networks Are Easily Fooled by Strange Poses of Familiar Objects Michael A. Alcorn Melvin Johnson Zhitao Gong Chengfei Wang Long Mai Naveen Ari Stella Laurenzo 89 298 0 28 Nov 2018
An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution Rosanne Liu Joel Lehman Piero Molino F. Such Eric Frank Alexander Sergeev J. Yosinski 78 893 0 09 Jul 2018
Why do deep convolutional networks generalize so poorly to small image transformations? Aharon Azulay Yair Weiss 77 561 0 30 May 2018
Pooling is neither necessary nor sufficient for appropriate deformation stability in CNNs Avraham Ruderman Neil C. Rabinowitz Ari S. Morcos Daniel Zoran 85 41 0 12 Apr 2018
Disentangling by Factorising Hyunjik Kim A. Mnih CoGe OOD 62 1,356 0 16 Feb 2018
Understanding image representations by measuring their equivariance and equivalence Karel Lenc Andrea Vedaldi SSL FAtt 112 537 0 21 Nov 2014
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 269 12,456 0 24 Jun 2012