Measuring Robustness to Natural Distribution Shifts in Image Classification

1 July 2020

Benjamin Recht

Papers citing "Measuring Robustness to Natural Distribution Shifts in Image Classification"

50 / 352 papers shown

Title
3D Common Corruptions and Data Augmentation Oğuzhan Fatih Kar Teresa Yeo Andrei Atanov Amir Zamir 3DPC 53 107 0 02 Mar 2022
Improving generalization with synthetic training data for deep learning based quality inspection Antoine Cordier Pierre Gutierrez Victoire Plessis 24 2 0 25 Feb 2022
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution Ananya Kumar Aditi Raghunathan Robbie Jones Tengyu Ma Percy Liang OODD 50 645 0 21 Feb 2022
Deep Ensembles Work, But Are They Necessary? Taiga Abe E. Kelly Buchanan Geoff Pleiss R. Zemel John P. Cunningham OOD UQCV 44 60 0 14 Feb 2022
Predicting Out-of-Distribution Error with the Projection Norm Yaodong Yu Zitong Yang Alexander Wei Yi Ma Jacob Steinhardt OODD 20 43 0 11 Feb 2022
NoisyMix: Boosting Model Robustness to Common Corruptions N. Benjamin Erichson S. H. Lim Winnie Xu Francisco Utrera Ziang Cao Michael W. Mahoney 19 17 0 02 Feb 2022
Certifying Model Accuracy under Distribution Shifts Aounon Kumar Alexander Levine Tom Goldstein S. Feizi OOD 27 7 0 28 Jan 2022
An Empirical Investigation of Model-to-Model Distribution Shifts in Trained Convolutional Filters Paul Gavrikov J. Keuper 24 1 0 20 Jan 2022
Parameter-free Online Test-time Adaptation Malik Boudiaf Romain Mueller Ismail Ben Ayed Luca Bertinetto TTA 33 139 0 15 Jan 2022
Towards Transferable Unrestricted Adversarial Examples with Minimum Changes Fangcheng Liu Chaoning Zhang Hongyang R. Zhang AAML 31 20 0 04 Jan 2022
Optimal Representations for Covariate Shift Yangjun Ruan Yann Dubois Chris J. Maddison OOD 28 68 0 31 Dec 2021
PRIME: A few primitives can boost robustness to common corruptions Apostolos Modas Rahul Rade Guillermo Ortiz-Jiménez Seyed-Mohsen Moosavi-Dezfooli P. Frossard AAML 25 42 0 27 Dec 2021
Provable Adversarial Robustness in the Quantum Model Khashayar Barooti Grzegorz Gluch R. Urbanke AAML OOD 11 1 0 17 Dec 2021
Do You See What I See? Capabilities and Limits of Automated Multimedia Content Analysis Carey Shenkman Dhanaraj Thakur Emma Llansó 27 8 0 15 Dec 2021
Measure and Improve Robustness in NLP Models: A Survey Xuezhi Wang Haohan Wang Diyi Yang 139 130 0 15 Dec 2021
Extending the WILDS Benchmark for Unsupervised Adaptation Shiori Sagawa Pang Wei Koh Tony Lee Irena Gao Sang Michael Xie ... Kate Saenko Tatsunori Hashimoto Sergey Levine Chelsea Finn Percy Liang OOD 18 98 0 09 Dec 2021
A Systematic Review of Robustness in Deep Learning for Computer Vision: Mind the gap? Nathan G. Drenkow Numair Sani I. Shpitser Mathias Unberath 19 75 0 01 Dec 2021
Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models Guilherme Pombo Robert J. Gray M. Jorge Cardoso Sebastien Ourselin G. Rees John Ashburner P. Nachev 36 16 0 29 Nov 2021
Do Invariances in Deep Neural Networks Align with Human Perception? Vedant Nanda Ayan Majumdar Camila Kolling John P. Dickerson Krishna P. Gummadi Bradley C. Love Adrian Weller AAML 16 4 0 29 Nov 2021
Confounder Identification-free Causal Visual Feature Learning Xin Li Zhizheng Zhang Guoqiang Wei Cuiling Lan Wenjun Zeng Xin Jin Zhibo Chen CML OOD 32 14 0 26 Nov 2021
Combined Scaling for Zero-shot Transfer Learning Hieu H. Pham Zihang Dai Golnaz Ghiasi Kenji Kawaguchi Hanxiao Liu ... Yi-Ting Chen Minh-Thang Luong Yonghui Wu Mingxing Tan Quoc V. Le VLM 17 194 0 19 Nov 2021
Understanding and Testing Generalization of Deep Networks on Out-of-Distribution Data Rui Hu Jitao Sang Jinqiang Wang Rui Hu Chaoquan Jiang CML OOD 27 7 0 17 Nov 2021
Benchmarks for Corruption Invariant Person Re-identification Minghui Chen Zhiqiang Wang Feng Zheng 36 25 0 01 Nov 2021
Adversarial Robustness with Semi-Infinite Constrained Learning Alexander Robey Luiz F. O. Chamon George J. Pappas Hamed Hassani Alejandro Ribeiro AAML OOD 118 43 0 29 Oct 2021
Robust Contrastive Learning Using Negative Samples with Diminished Semantics Songwei Ge Shlok Kumar Mishra Haohan Wang Chun-Liang Li David Jacobs SSL 24 71 0 27 Oct 2021
AugMax: Adversarial Composition of Random Augmentations for Robust Training Haotao Wang Chaowei Xiao Jean Kossaifi Zhiding Yu Anima Anandkumar Zhangyang Wang 27 107 0 26 Oct 2021
A Fine-Grained Analysis on Distribution Shift Olivia Wiles Sven Gowal Florian Stimberg Sylvestre-Alvise Rebuffi Ira Ktena Krishnamurthy Dvijotham A. Cemgil OOD 236 208 0 21 Oct 2021
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp Günter Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 207 102 0 21 Oct 2021
Exploring Novel Pooling Strategies for Edge Preserved Feature Maps in Convolutional Neural Networks Adithya Sineesh Mahesh Raveendranatha Panicker 22 2 0 17 Oct 2021
Reappraising Domain Generalization in Neural Networks S. Sivaprasad Akshay Goindani Vaibhav Garg Ritam Basu Saiteja Kosgi Vineet Gandhi OOD AI4CE 23 6 0 15 Oct 2021
Out-of-Distribution Robustness in Deep Learning Compression Eric Lei Hamed Hassani Shirin Saeedi Bidokhti OOD OODD 11 5 0 13 Oct 2021
Benchmarking the Robustness of Spatial-Temporal Models Against Corruptions Chenyu Yi Siyuan Yang Haoliang Li Yap-Peng Tan Alex C. Kot 26 32 0 13 Oct 2021
Robustness Evaluation of Transformer-based Form Field Extractors via Form Attacks Le Xue M. Gao Zeyuan Chen Caiming Xiong Ran Xu 11 3 0 08 Oct 2021
Exploring the Limits of Large Scale Pre-training Samira Abnar Mostafa Dehghani Behnam Neyshabur Hanie Sedghi AI4CE 60 114 0 05 Oct 2021
Anti-aliasing Deep Image Classifiers using Novel Depth Adaptive Blurring and Activation Function Md Tahmid Hossain S. Teng Ferdous Sohel Guojun Lu 49 13 0 03 Oct 2021
FathomNet: A global image database for enabling artificial intelligence in the ocean K. Katija E. Orenstein B. Schlining L. Lundsten K. Barnard ... O. Boulais M. Cromwell Erin R Butler Benjamin Woodward K. L. Bell 12 69 0 29 Sep 2021
Training on Test Data with Bayesian Adaptation for Covariate Shift Aurick Zhou Sergey Levine OOD TTA 50 13 0 27 Sep 2021
Robust Generalization of Quadratic Neural Networks via Function Identification Kan Xu Hamsa Bastani Osbert Bastani OOD 36 8 0 22 Sep 2021
RobustART: Benchmarking Robustness on Architecture Design and Training Techniques Shiyu Tang Ruihao Gong Yan Wang Aishan Liu Jiakai Wang ... Xianglong Liu D. Song Alan Yuille Philip Torr Dacheng Tao VLM AAML 26 107 0 11 Sep 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 64 695 0 04 Sep 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 350 2,279 0 02 Sep 2021
SHIFT15M: Fashion-specific dataset for set-to-set matching with several distribution shifts Masanari Kimura Takuma Nakamura Yuki Saito OOD 39 3 0 30 Aug 2021
A comparison of approaches to improve worst-case predictive model performance over patient subpopulations Stephen R. Pfohl Haoran Zhang Yizhe Xu Agata Foryciarz Marzyeh Ghassemi N. Shah OOD 29 22 0 27 Aug 2021
StyleAugment: Learning Texture De-biased Representations by Style Augmentation without Pre-defined Textures Sanghyuk Chun Song Park 19 6 0 24 Aug 2021
Sequential Multivariate Change Detection with Calibrated and Memoryless False Detection Rates Oliver Cobb A. V. Looveren Janis Klaise 34 6 0 02 Aug 2021
SimROD: A Simple Adaptation Method for Robust Object Detection Rindranirina Ramamonjison Amin Banitalebi-Dehkordi Xinyu Kang Xiaolong Bai Yong Zhang ObjD TTA 26 53 0 28 Jul 2021
Using Synthetic Corruptions to Measure Robustness to Natural Distribution Shifts Alfred Laugros A. Caplier Matthieu Ospici 25 5 0 26 Jul 2021
Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions Eike Petersen Yannik Potdevin Esfandiar Mohammadi Stephan Zidowitz Sabrina Breyer ... Sandra Henn Ludwig Pechmann M. Leucker P. Rostalski Christian Herzog FaML AILaw OOD 41 21 0 20 Jul 2021
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning Paul Pu Liang Yiwei Lyu Xiang Fan Zetian Wu Yun Cheng ... Peter Wu Michelle A. Lee Yuke Zhu Ruslan Salakhutdinov Louis-Philippe Morency VLM 32 159 0 15 Jul 2021
Adversarial for Good? How the Adversarial ML Community's Values Impede Socially Beneficial Uses of Attacks Kendra Albert Maggie K. Delano B. Kulynych Ramnath Kumar AAML 22 4 0 11 Jul 2021