Measuring Robustness to Natural Distribution Shifts in Image Classification

1 July 2020

Benjamin Recht

Papers citing "Measuring Robustness to Natural Distribution Shifts in Image Classification"

50 / 351 papers shown

Title
Are Sample-Efficient NLP Models More Robust? Nelson F. Liu Ananya Kumar Percy Liang Robin Jia VLM OOD 30 6 0 12 Oct 2022
Probabilistic Inverse Modeling: An Application in Hydrology Somya Sharma Rahul Ghosh Arvind Renganathan Xiang Li Snigdhansu Chatterjee John L. Nieber C. Duffy Vipin Kumar AI4CE 30 1 0 12 Oct 2022
Transfer Learning with Pretrained Remote Sensing Transformers A. Fuller K. Millard J.R. Green 35 11 0 28 Sep 2022
Frequency Dropout: Feature-Level Regularization via Randomized Filtering Mobarakol Islam Ben Glocker OOD 35 6 0 20 Sep 2022
Estimating and Explaining Model Performance When Both Covariates and Labels Shift Lingjiao Chen Matei A. Zaharia James Zou 30 15 0 18 Sep 2022
Confidence-Guided Data Augmentation for Improved Semi-Supervised Training Fadoua Khmaissia H. Frigui 11 0 0 16 Sep 2022
Part-Based Models Improve Adversarial Robustness Chawin Sitawarin Kornrapat Pongmala Yizheng Chen Nicholas Carlini David Wagner 44 11 0 15 Sep 2022
ID and OOD Performance Are Sometimes Inversely Correlated on Real-world Datasets Damien Teney Yong Lin Seong Joon Oh Ehsan Abbasnejad OOD 391 47 0 01 Sep 2022
Progressive Fusion for Multimodal Integration Shiv Shankar Laure Thompson M. Fiterau 36 3 0 01 Sep 2022
Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP Thao Nguyen Gabriel Ilharco Mitchell Wortsman Sewoong Oh Ludwig Schmidt CLIP VLM 53 99 0 10 Aug 2022
Joint covariate-alignment and concept-alignment: a framework for domain generalization Thuan Q. Nguyen Boyang Lyu Prakash Ishwar matthias. scheutz Shuchin Aeron OOD 24 4 0 01 Aug 2022
Assaying Out-Of-Distribution Generalization in Transfer Learning F. Wenzel Andrea Dittadi Peter V. Gehler Carl-Johann Simon-Gabriel Max Horn ... Chris Russell Thomas Brox Bernt Schiele Bernhard Schölkopf Francesco Locatello OOD OODD AAML 62 71 0 19 Jul 2022
Decorrelative Network Architecture for Robust Electrocardiogram Classification Christopher Wiedeman Ge Wang OOD 13 2 0 19 Jul 2022
Progress and limitations of deep networks to recognize objects in unusual poses Amro Abbas Stéphane Deny OOD AAML 15 18 0 16 Jul 2022
Is a Caption Worth a Thousand Images? A Controlled Study for Representation Learning Shibani Santurkar Yann Dubois Rohan Taori Percy Liang Tatsunori Hashimoto CLIP VLM 19 41 0 15 Jul 2022
Plex: Towards Reliability using Pretrained Large Model Extensions Dustin Tran J. Liu Michael W. Dusenberry Du Phan Mark Collier ... D. Sculley Y. Gal Zoubin Ghahramani Jasper Snoek Balaji Lakshminarayanan VLM 39 124 0 15 Jul 2022
On the Strong Correlation Between Model Invariance and Generalization Weijian Deng Stephen Gould Liang Zheng OOD 32 16 0 14 Jul 2022
Test-Time Adaptation via Self-Training with Nearest Neighbor Information M-U Jang Sae-Young Chung Hye Won Chung OOD TTA 41 59 0 08 Jul 2022
A simple normalization technique using window statistics to improve the out-of-distribution generalization on medical images Chengfeng Zhou Songchang Chen Chenming Xu Jun Wang Feng Liu Chun Zhang Juan Ye Hefeng Huang Xiaobo Li OOD 13 0 0 07 Jul 2022
Robustness Analysis of Video-Language Models Against Visual and Language Perturbations Madeline Chantry Schiappa Shruti Vyas Hamid Palangi Yogesh S Rawat Vibhav Vineet VLM 123 18 0 05 Jul 2022
Predicting Out-of-Domain Generalization with Neighborhood Invariance Nathan Ng Neha Hulkund Kyunghyun Cho Marzyeh Ghassemi OOD 27 4 0 05 Jul 2022
How Robust is Your Fairness? Evaluating and Sustaining Fairness under Unseen Distribution Shifts Haotao Wang Junyuan Hong Jiayu Zhou Zhangyang Wang OOD 60 11 0 04 Jul 2022
RegMixup: Mixup as a Regularizer Can Surprisingly Improve Accuracy and Out Distribution Robustness Francesco Pinto Harry Yang Ser-Nam Lim Philip Torr P. Dokania UQCV 33 34 0 29 Jun 2022
Auditing Visualizations: Transparency Methods Struggle to Detect Anomalous Behavior Jean-Stanislas Denain Jacob Steinhardt AAML 44 7 0 27 Jun 2022
Gated Domain Units for Multi-source Domain Generalization Simon Foll Alina Dubatovka Eugen Ernst Siu Lun Chau Martin Maritsch Patrik Okanovic Gudrun Thater J. M. Buhmann Felix Wortmann Krikamol Muandet OOD 43 3 0 24 Jun 2022
Measuring Representational Robustness of Neural Networks Through Shared Invariances Vedant Nanda Till Speicher Camila Kolling John P. Dickerson Krishna P. Gummadi Adrian Weller 19 12 0 23 Jun 2022
VisFIS: Visual Feature Importance Supervision with Right-for-the-Right-Reason Objectives Zhuofan Ying Peter Hase Joey Tianyi Zhou LRM 33 13 0 22 Jun 2022
Performance Prediction Under Dataset Shift Simona Maggio Victor Bouvier L. Dreyfus-Schmidt OOD AI4TS 21 2 0 21 Jun 2022
The Fallacy of AI Functionality Inioluwa Deborah Raji Indra Elizabeth Kumar Aaron Horowitz Andrew D. Selbst 34 180 0 20 Jun 2022
StaDRe and StaDRo: Reliability and Robustness Estimation of ML-based Forecasting using Statistical Distance Measures Mohammed Naveed Akram Akshatha Ambekar Ioannis Sorokos Koorosh Aslansefat Daniel Schneider OOD 27 3 0 17 Jun 2022
How Robust is Unsupervised Representation Learning to Distribution Shift? Yuge Shi Imant Daunhawer Julia E. Vogt Philip Torr Amartya Sanyal OOD 35 25 0 17 Jun 2022
Noisy Learning for Neural ODEs Acts as a Robustness Locus Widening Martin Gonzalez H. Hajri Loic Cantat Mihaly Petreczky 37 1 0 16 Jun 2022
Learn to Adapt: Robust Drift Detection in Security Domain Aditya Kuppa Nhien-An Le-Khac OOD 33 15 0 15 Jun 2022
A Meta-Analysis of Distributionally-Robust Models Ben Feuer Ameya Joshi C. Hegde OOD VLM 43 3 0 15 Jun 2022
Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview Florian Karl Tobias Pielok Julia Moosbauer Florian Pfisterer Stefan Coors ... Jakob Richter Michel Lang Eduardo C. Garrido-Merchán Juergen Branke B. Bischl AI4CE 26 57 0 15 Jun 2022
SyntheX: Scaling Up Learning-based X-ray Image Analysis Through In Silico Experiments Cong Gao Benjamin Killeen Yicheng Hu Robert Grupp Russell H. Taylor Mehran Armand Mathias Unberath MedIm 35 9 0 13 Jun 2022
On the Generalization and Adaption Performance of Causal Models Nino Scherrer Anirudh Goyal Stefan Bauer Yoshua Bengio Nan Rosemary Ke CML OOD BDL TTA 31 8 0 09 Jun 2022
Test-Time Robust Personalization for Federated Learning Liang Jiang Tao R. Lin FedML OOD TTA 85 43 0 22 May 2022
Localized Adversarial Domain Generalization Wei-wei Zhu Le Lu Jing Xiao Mei Han Jiebo Luo Adam P. Harrison OOD 32 22 0 09 May 2022
Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP) Alex Fang Gabriel Ilharco Mitchell Wortsman Yu Wan Vaishaal Shankar Achal Dave Ludwig Schmidt VLM OOD 33 139 0 03 May 2022
Testing robustness of predictions of trained classifiers against naturally occurring perturbations S. Scher A. Trugler OOD AAML 25 1 0 21 Apr 2022
Robust Cross-Modal Representation Learning with Progressive Self-Distillation A. Andonian Shixing Chen Raffay Hamid VLM 29 54 0 10 Apr 2022
CNN Filter DB: An Empirical Investigation of Trained Convolutional Filters Paul Gavrikov J. Keuper AAML 24 31 0 29 Mar 2022
Causality Inspired Representation Learning for Domain Generalization Fangrui Lv Jian Liang Shuang Li Bin Zang Chi Harold Liu Ziteng Wang Di Liu CML OOD 38 162 0 27 Mar 2022
Do Deep Networks Transfer Invariances Across Classes? Allan Zhou Fahim Tajwar Alexander Robey Tom Knowles George J. Pappas Hamed Hassani Chelsea Finn OOD 37 18 0 18 Mar 2022
Generalized but not Robust? Comparing the Effects of Data Modification Methods on Out-of-Domain Generalization and Adversarial Robustness Tejas Gokhale Swaroop Mishra Man Luo Bhavdeep Singh Sachdeva Chitta Baral 52 29 0 15 Mar 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 47 1,294 0 10 Mar 2022
Do better ImageNet classifiers assess perceptual similarity better? Manoj Kumar N. Houlsby Nal Kalchbrenner E. D. Cubuk 31 31 0 09 Mar 2022
ImageNet-Patch: A Dataset for Benchmarking Machine Learning Robustness against Adversarial Patches Maura Pintor Daniele Angioni Angelo Sotgiu Christian Scano Ambra Demontis Battista Biggio Fabio Roli AAML 33 49 0 07 Mar 2022
3D Common Corruptions and Data Augmentation Oğuzhan Fatih Kar Teresa Yeo Andrei Atanov Amir Zamir 3DPC 53 107 0 02 Mar 2022