Measuring Robustness to Natural Distribution Shifts in Image Classification

1 July 2020

Benjamin Recht

Papers citing "Measuring Robustness to Natural Distribution Shifts in Image Classification"

50 / 352 papers shown

Title
Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalization John Miller Rohan Taori Aditi Raghunathan Shiori Sagawa Pang Wei Koh Vaishaal Shankar Percy Liang Y. Carmon Ludwig Schmidt OODD OOD 25 267 0 09 Jul 2021
Predicting with Confidence on Unseen Distributions Devin Guillory Vaishaal Shankar Sayna Ebrahimi Trevor Darrell Ludwig Schmidt UQCV OOD 25 116 0 07 Jul 2021
Poisoning and Backdooring Contrastive Learning Nicholas Carlini Andreas Terzis 46 157 0 17 Jun 2021
On Deep Neural Network Calibration by Regularization and its Impact on Refinement Aditya Singh Alessandro Bay B. Sengupta Andrea Mirabile AAML 27 2 0 17 Jun 2021
Revisiting the Calibration of Modern Neural Networks Matthias Minderer Josip Djolonga Rob Romijnders F. Hubis Xiaohua Zhai N. Houlsby Dustin Tran Mario Lucic UQCV 51 358 0 15 Jun 2021
Partial success in closing the gap between human and machine vision Robert Geirhos Kantharaju Narayanappa Benjamin Mitzkus Tizian Thieringer Matthias Bethge Felix Wichmann Wieland Brendel VLM AAML 48 221 0 14 Jun 2021
Gradual Domain Adaptation in the Wild:When Intermediate Distributions are Absent Samira Abnar Rianne van den Berg Golnaz Ghiasi Mostafa Dehghani Nal Kalchbrenner Hanie Sedghi OOD CLL TTA 36 21 0 10 Jun 2021
What Does Rotation Prediction Tell Us about Classifier Accuracy under Varying Testing Environments? Weijian Deng Stephen Gould Liang Zheng 39 63 0 10 Jun 2021
RobustNav: Towards Benchmarking Robustness in Embodied Navigation Prithvijit Chattopadhyay Judy Hoffman Roozbeh Mottaghi Aniruddha Kembhavi 25 55 0 08 Jun 2021
Towards a Theoretical Framework of Out-of-Distribution Generalization Haotian Ye Chuanlong Xie Tianle Cai Ruichen Li Zhenguo Li Liwei Wang OODD OOD 61 105 0 08 Jun 2021
3DB: A Framework for Debugging Computer Vision Models Guillaume Leclerc Hadi Salman Andrew Ilyas Sai H. Vemprala Logan Engstrom ... Pengchuan Zhang Shibani Santurkar Greg Yang Ashish Kapoor A. Madry 40 40 0 07 Jun 2021
Finding and Fixing Spurious Patterns with Explanations Gregory Plumb Marco Tulio Ribeiro Ameet Talwalkar 32 40 0 03 Jun 2021
Using the Overlapping Score to Improve Corruption Benchmarks Alfred Laugros A. Caplier Matthieu Ospici 30 2 0 26 May 2021
Causally motivated Shortcut Removal Using Auxiliary Labels Maggie Makar Ben Packer D. Moldovan Davis W. Blalock Yoni Halpern Alexander DÁmour OOD CML 35 71 0 13 May 2021
Poisoning the Unlabeled Dataset of Semi-Supervised Learning Nicholas Carlini AAML 164 68 0 04 May 2021
A neural anisotropic view of underspecification in deep learning Guillermo Ortiz-Jiménez I. Salazar-Reque Apostolos Modas Seyed-Mohsen Moosavi-Dezfooli P. Frossard 34 6 0 29 Apr 2021
If your data distribution shifts, use self-learning E. Rusak Steffen Schneider George Pachitariu L. Eck Peter V. Gehler Oliver Bringmann Wieland Brendel Matthias Bethge VLM OOD TTA 81 30 0 27 Apr 2021
On Aliased Resizing and Surprising Subtleties in GAN Evaluation Gaurav Parmar Richard Y. Zhang Jun-Yan Zhu EGVM 25 74 0 22 Apr 2021
Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness? Vikash Sehwag Saeed Mahloujifar Tinashe Handina Sihui Dai Chong Xiang M. Chiang Prateek Mittal OOD 47 127 0 19 Apr 2021
SI-Score: An image dataset for fine-grained analysis of robustness to object location, rotation and size Jessica Yung Rob Romijnders Alexander Kolesnikov Lucas Beyer Josip Djolonga N. Houlsby Sylvain Gelly Mario Lucic Xiaohua Zhai 32 8 0 09 Apr 2021
Defending Against Image Corruptions Through Adversarial Augmentations D. A. Calian Florian Stimberg Olivia Wiles Sylvestre-Alvise Rebuffi András Gyorgy Timothy A. Mann Sven Gowal AAML 17 41 0 02 Apr 2021
Improving robustness against common corruptions with frequency biased models Tonmoy Saikia Cordelia Schmid Thomas Brox OOD 26 40 0 30 Mar 2021
Learning Under Adversarial and Interventional Shifts Harvineet Singh Shalmali Joshi Finale Doshi-Velez Himabindu Lakkaraju OOD 17 3 0 29 Mar 2021
Lagrangian Objective Function Leads to Improved Unforeseen Attack Generalization in Adversarial Training Mohammad Azizmalayeri M. Rohban OOD 37 4 0 29 Mar 2021
Contrasting Contrastive Self-Supervised Representation Learning Pipelines Klemen Kotar Gabriel Ilharco Ludwig Schmidt Kiana Ehsani Roozbeh Mottaghi SSL 43 46 0 25 Mar 2021
Contemplating real-world object classification Ali Borji OOD 24 9 0 08 Mar 2021
Domain Generalization: A Survey Kaiyang Zhou Ziwei Liu Yu Qiao Tao Xiang Chen Change Loy OOD AI4CE 75 982 0 03 Mar 2021
On the effectiveness of adversarial training against common corruptions Klim Kireev Maksym Andriushchenko Nicolas Flammarion AAML 19 101 0 03 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 183 27,846 0 26 Feb 2021
Model-Based Domain Generalization Alexander Robey George J. Pappas Hamed Hassani OOD 45 129 0 23 Feb 2021
On Interaction Between Augmentations and Corruptions in Natural Corruption Robustness Eric Mintun A. Kirillov Saining Xie 20 90 0 22 Feb 2021
Learning Neural Network Subspaces Mitchell Wortsman Maxwell Horton Carlos Guestrin Ali Farhadi Mohammad Rastegari UQCV 27 85 0 20 Feb 2021
CrossNorm and SelfNorm for Generalization under Distribution Shifts Zhiqiang Tang Yunhe Gao Yi Zhu Zhi-Li Zhang Mu Li Dimitris N. Metaxas OOD 30 51 0 04 Feb 2021
Do Question Answering Modeling Improvements Hold Across Benchmarks? Nelson F. Liu Tony Lee Robin Jia Percy Liang 28 13 0 01 Feb 2021
Robustness Gym: Unifying the NLP Evaluation Landscape Karan Goel Nazneen Rajani Jesse Vig Samson Tan Jason M. Wu Stephan Zheng Caiming Xiong Joey Tianyi Zhou Christopher Ré AAML OffRL OOD 154 137 0 13 Jan 2021
Why do classifier accuracies show linear trends under distribution shift? Horia Mania S. Sra OOD 37 19 0 31 Dec 2020
Unadversarial Examples: Designing Objects for Robust Vision Hadi Salman Andrew Ilyas Logan Engstrom Sai H. Vemprala A. Madry Ashish Kapoor WIGM 73 59 0 22 Dec 2020
Toward Transformer-Based Object Detection Josh Beal Eric Kim Eric Tzeng Dong Huk Park Andrew Zhai Dmitry Kislyuk ViT 30 209 0 17 Dec 2020
WILDS: A Benchmark of in-the-Wild Distribution Shifts Pang Wei Koh Shiori Sagawa Henrik Marklund Sang Michael Xie Marvin Zhang ... A. Kundaje Emma Pierson Sergey Levine Chelsea Finn Percy Liang OOD 106 1,383 0 14 Dec 2020
An Analysis of Deep Object Detectors For Diver Detection Karin de Langis Michael Fulton Junaed Sattar ObjD 25 10 0 25 Nov 2020
Underspecification Presents Challenges for Credibility in Modern Machine Learning Alexander DÁmour Katherine A. Heller D. Moldovan Ben Adlam B. Alipanahi ... Kellie Webster Steve Yadlowsky T. Yun Xiaohua Zhai D. Sculley OffRL 77 671 0 06 Nov 2020
Why Do Better Loss Functions Lead to Less Transferable Features? Simon Kornblith Ting-Li Chen Honglak Lee Mohammad Norouzi FaML 45 90 0 30 Oct 2020
RobustBench: a standardized adversarial robustness benchmark Francesco Croce Maksym Andriushchenko Vikash Sehwag Edoardo Debenedetti Nicolas Flammarion M. Chiang Prateek Mittal Matthias Hein VLM 234 680 0 19 Oct 2020
Optimism in the Face of Adversity: Understanding and Improving Deep Learning through Adversarial Robustness Guillermo Ortiz-Jiménez Apostolos Modas Seyed-Mohsen Moosavi-Dezfooli P. Frossard AAML 31 48 0 19 Oct 2020
BREEDS: Benchmarks for Subpopulation Shift Shibani Santurkar Dimitris Tsipras A. Madry OOD 21 168 0 11 Aug 2020
On Robustness and Transferability of Convolutional Neural Networks Josip Djolonga Jessica Yung Michael Tschannen Rob Romijnders Lucas Beyer ... D. Moldovan Sylvain Gelly N. Houlsby Xiaohua Zhai Mario Lucic OOD 13 154 0 16 Jul 2020
Understanding and Improving Fast Adversarial Training Maksym Andriushchenko Nicolas Flammarion AAML 26 285 0 06 Jul 2020
Model-Based Robust Deep Learning: Generalizing to Natural, Out-of-Distribution Data Alexander Robey Hamed Hassani George J. Pappas OOD 43 42 0 20 May 2020
Can we have it all? On the Trade-off between Spatial and Adversarial Robustness of Neural Networks Sandesh Kamath Amit Deshpande Subrahmanyam Kambhampati Venkata V. Balasubramanian 33 12 0 26 Feb 2020
Do Image Classifiers Generalize Across Time? Vaishaal Shankar Achal Dave Rebecca Roelofs Deva Ramanan Benjamin Recht Ludwig Schmidt 20 82 0 05 Jun 2019