Measuring Robustness to Natural Distribution Shifts in Image Classification

1 July 2020

Benjamin Recht

Papers citing "Measuring Robustness to Natural Distribution Shifts in Image Classification"

50 / 351 papers shown

Title
WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation Jongheon Jeong Yang Zou Taewan Kim Dongqing Zhang Avinash Ravichandran Onkar Dabeer VLM 75 187 0 26 Mar 2023
Enhancing Multiple Reliability Measures via Nuisance-extended Information Bottleneck Jongheon Jeong Sihyun Yu Hankook Lee Jinwoo Shin AAML 44 0 0 24 Mar 2023
The effectiveness of MAE pre-pretraining for billion-scale pretraining Mannat Singh Quentin Duval Kalyan Vasudev Alwala Haoqi Fan Vaibhav Aggarwal ... Piotr Dollár Christoph Feichtenhofer Ross B. Girshick Rohit Girdhar Ishan Misra LRM 126 63 0 23 Mar 2023
Improving Generalization with Domain Convex Game Fangrui Lv Jian Liang Shuang Li Jinming Zhang Di Liu 21 6 0 23 Mar 2023
Reliability in Semantic Segmentation: Are We on the Right Track? Pau de Jorge Riccardo Volpi Philip Torr Grégory Rogez UQCV 26 19 0 20 Mar 2023
SeiT: Storage-Efficient Vision Training with Tokens Using 1% of Pixel Storage Song Park Sanghyuk Chun Byeongho Heo Wonjae Kim Sangdoo Yun VLM ViT 14 8 0 20 Mar 2023
Model-tuning Via Prompts Makes NLP Models Adversarially Robust Mrigank Raman Pratyush Maini J. Zico Kolter Zachary Chase Lipton Danish Pruthi AAML 38 17 0 13 Mar 2023
Adaptive Calibrator Ensemble for Model Calibration under Distribution Shift Yu-Hui Zou Weijian Deng Liang Zheng OODD 25 2 0 09 Mar 2023
Chasing Fairness Under Distribution Shift: A Model Weight Perturbation Approach Zhimeng Jiang Xiaotian Han Hongye Jin Guanchu Wang Rui Chen Na Zou Xia Hu 12 13 0 06 Mar 2023
Masked Images Are Counterfactual Samples for Robust Fine-tuning Yao Xiao Ziyi Tang Pengxu Wei Cong Liu Liang Lin 49 16 0 06 Mar 2023
Fine-Grained ImageNet Classification in the Wild Maria Lymperaiou Konstantinos Thomas Giorgos Stamou VLM 36 1 0 04 Mar 2023
Diagnosing Model Performance Under Distribution Shift Tiffany Cai Hongseok Namkoong Steve Yadlowsky 37 27 0 03 Mar 2023
Edit at your own risk: evaluating the robustness of edited models to distribution shifts Davis Brown Charles Godfrey Cody Nizinski Jonathan Tu Henry Kvinge KELM 29 8 0 28 Feb 2023
The Role of Pre-training Data in Transfer Learning R. Entezari Mitchell Wortsman O. Saukh M. Shariatnia Hanie Sedghi Ludwig Schmidt 46 21 0 27 Feb 2023
Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights? Ruisi Cai Zhenyu Zhang Zhangyang Wang AAML OOD 46 12 0 24 Feb 2023
Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation Joshua Vendrow Saachi Jain Logan Engstrom A. Madry OOD 32 34 0 15 Feb 2023
Scaling Vision Transformers to 22 Billion Parameters Mostafa Dehghani Josip Djolonga Basil Mustafa Piotr Padlewski Jonathan Heek ... Mario Luvcić Xiaohua Zhai Daniel Keysers Jeremiah Harmsen N. Houlsby MLLM 90 572 0 10 Feb 2023
Linear-scaling kernels for protein sequences and small molecules outperform deep learning while providing uncertainty quantitation and improved interpretability J. Parkinson Wen Wang BDL 24 8 0 07 Feb 2023
RLSbench: Domain Adaptation Under Relaxed Label Shift Saurabh Garg Nick Erickson James Sharpnack Alexander J. Smola Sivaraman Balakrishnan Zachary Chase Lipton VLM 33 31 0 06 Feb 2023
Leaving Reality to Imagination: Robust Classification via Generated Datasets Hritik Bansal Aditya Grover OOD 44 87 0 05 Feb 2023
Effective Robustness against Natural Distribution Shifts for Models with Different Training Data Zhouxing Shi Nicholas Carlini Ananth Balashankar Ludwig Schmidt Cho-Jui Hsieh Alex Beutel Yao Qin OOD 26 9 0 02 Feb 2023
Confidence and Dispersity Speak: Characterising Prediction Matrix for Unsupervised Accuracy Estimation Weijian Deng Yumin Suh Stephen Gould Liang Zheng UQCV 29 12 0 02 Feb 2023
CLIPood: Generalizing CLIP to Out-of-Distributions Yang Shu Xingzhuo Guo Jialong Wu Ximei Wang Jianmin Wang Mingsheng Long OODD VLM 52 73 0 02 Feb 2023
Model Monitoring and Robustness of In-Use Machine Learning Models: Quantifying Data Distribution Shifts Using Population Stability Index A. Khademi M. Hopka Devesh Upadhyay OOD 33 3 0 01 Feb 2023
Pathologies of Predictive Diversity in Deep Ensembles Taiga Abe E. Kelly Buchanan Geoff Pleiss John P. Cunningham UQCV 43 13 0 01 Feb 2023
Demystifying Disagreement-on-the-Line in High Dimensions Dong-Hwan Lee Behrad Moniri Xinmeng Huang Yan Sun Hamed Hassani 23 8 0 31 Jan 2023
Diverse, Difficult, and Odd Instances (D2O): A New Test Set for Object Classification Ali Borji VLM 37 0 0 29 Jan 2023
A Closer Look at Few-shot Classification Again Xu Luo Hao Wu Ji Zhang Lianli Gao Jing Xu Jingkuan Song 24 48 0 28 Jan 2023
BinaryVQA: A Versatile Test Set to Evaluate the Out-of-Distribution Generalization of VQA Models Ali Borji CoGe 15 1 0 28 Jan 2023
ClimaX: A foundation model for weather and climate Tung Nguyen Johannes Brandstetter Ashish Kapoor Jayesh K. Gupta Aditya Grover AI4Cl AI4CE 11 246 0 24 Jan 2023
Does progress on ImageNet transfer to real-world datasets? Alex Fang Simon Kornblith Ludwig Schmidt VLM 34 34 0 11 Jan 2023
Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization Alexandre Ramé Kartik Ahuja Jianyu Zhang Matthieu Cord Léon Bottou David Lopez-Paz MoMe OODD 42 81 0 20 Dec 2022
A Probabilistic Framework for Lifelong Test-Time Adaptation Dhanajit Brahma Piyush Rai TTA 24 35 0 19 Dec 2022
Reproducible scaling laws for contrastive language-image learning Mehdi Cherti Romain Beaumont Ross Wightman Mitchell Wortsman Gabriel Ilharco Cade Gordon Christoph Schuhmann Ludwig Schmidt J. Jitsev VLM CLIP 59 747 0 14 Dec 2022
Robust Speech Recognition via Large-Scale Weak Supervision Alec Radford Jong Wook Kim Tao Xu Greg Brockman C. McLeavey Ilya Sutskever OffRL 79 3,315 0 06 Dec 2022
Context-Aware Robust Fine-Tuning Xiaofeng Mao YueFeng Chen Xiaojun Jia Rong Zhang Hui Xue Zhao Li VLM CLIP 35 25 0 29 Nov 2022
Context-Adaptive Deep Neural Networks via Bridge-Mode Connectivity Nathan G. Drenkow Alvin Tan C. Ashcraft Kiran Karra 18 0 0 28 Nov 2022
Subgroup Robustness Grows On Trees: An Empirical Baseline Investigation Josh Gardner Zoran Popovic Ludwig Schmidt OOD 34 22 0 23 Nov 2022
Mechanistic Mode Connectivity Ekdeep Singh Lubana Eric J. Bigelow Robert P. Dick David M. Krueger Hidenori Tanaka 34 45 0 15 Nov 2022
Okapi: Generalising Better by Making Statistical Matches Match Myles Bartlett Sara Romiti V. Sharmanska Novi Quadrianto 45 3 0 07 Nov 2022
Local Manifold Augmentation for Multiview Semantic Consistency Yu Yang Wing Yin Cheung Chang-rui Liu Xiang Ji 39 1 0 05 Nov 2022
Data Models for Dataset Drift Controls in Machine Learning With Optical Images Luis Oala Marco Aversa Gabriel Nobis Kurt Willis Yoan Neuenschwander ... E. Pomarico Wojciech Samek Roderick Murray-Smith Christoph Clausen B. Sanguinetti 31 5 0 04 Nov 2022
ImageNet-X: Understanding Model Mistakes with Factor of Variation Annotations Badr Youbi Idrissi Diane Bouchacourt Randall Balestriero Ivan Evtimov C. Hazirbas Nicolas Ballas Pascal Vincent M. Drozdzal David Lopez-Paz Mark Ibrahim VLM ViT 56 45 0 03 Nov 2022
Private and Reliable Neural Network Inference Nikola Jovanović Marc Fischer Samuel Steffen Martin Vechev 22 14 0 27 Oct 2022
Learning to Augment via Implicit Differentiation for Domain Generalization Ting-Hsiang Wang Da Li Kaiyang Zhou Tao Xiang Yi-Zhe Song 19 0 0 25 Oct 2022
Exploring The Landscape of Distributional Robustness for Question Answering Models Anas Awadalla Mitchell Wortsman Gabriel Ilharco Sewon Min Ian H. Magnusson Hannaneh Hajishirzi Ludwig Schmidt ELM OOD KELM 72 19 0 22 Oct 2022
Intra-Source Style Augmentation for Improved Domain Generalization Yumeng Li Dan Zhang M. Keuper Anna Khoreva 29 32 0 18 Oct 2022
A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities Andrea Tocchetti Lorenzo Corti Agathe Balayn Mireia Yurrita Philip Lippmann Marco Brambilla Jie-jin Yang 32 10 0 17 Oct 2022
LAION-5B: An open large-scale dataset for training next generation image-text models Christoph Schuhmann Romain Beaumont Richard Vencu Cade Gordon Ross Wightman ... Srivatsa Kundurthy Katherine Crowson Ludwig Schmidt R. Kaczmarczyk J. Jitsev VLM MLLM CLIP 90 3,276 0 16 Oct 2022
Caption supervision enables robust learners Ben Feuer Ameya Joshi C. Hegde SSL CLIP VLM 39 2 0 13 Oct 2022