v1v2 (latest)

Measuring Robustness to Natural Distribution Shifts in Image Classification

1 July 2020

Benjamin Recht

Papers citing "Measuring Robustness to Natural Distribution Shifts in Image Classification"

50 / 355 papers shown

Title
DetCLIPv2: Scalable Open-Vocabulary Object Detection Pre-training via Word-Region Alignment Lewei Yao Jianhua Han Xiaodan Liang Danqian Xu Wei Zhang Zhenguo Li Hang Xu VLM ObjD CLIP 128 79 0 10 Apr 2023
On Robustness in Multimodal Learning Brandon McKinzie Joseph Cheng Vaishaal Shankar Yinfei Yang Jonathon Shlens Alexander Toshev 70 2 0 10 Apr 2023
Progressive Random Convolutions for Single Domain Generalization Seokeon Choi Debasmit Das Sungha Choi Seunghan Yang Hyunsin Park Sungrack Yun 110 40 0 02 Apr 2023
Your Diffusion Model is Secretly a Zero-Shot Classifier Alexander C. Li Mihir Prabhudesai Shivam Duggal Ellis L Brown Deepak Pathak DiffM VLM 193 240 0 28 Mar 2023
GeoNet: Benchmarking Unsupervised Adaptation across Geographies Tarun Kalluri Wangdong Xu Manmohan Chandraker OOD 63 15 0 27 Mar 2023
WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation Jongheon Jeong Yang Zou Taewan Kim Dongqing Zhang Avinash Ravichandran Onkar Dabeer VLM 138 211 0 26 Mar 2023
Enhancing Multiple Reliability Measures via Nuisance-extended Information Bottleneck Jongheon Jeong Sihyun Yu Hankook Lee Jinwoo Shin AAML 80 0 0 24 Mar 2023
The effectiveness of MAE pre-pretraining for billion-scale pretraining Mannat Singh Quentin Duval Kalyan Vasudev Alwala Haoqi Fan Vaibhav Aggarwal ... Piotr Dollár Christoph Feichtenhofer Ross B. Girshick Rohit Girdhar Ishan Misra LRM 182 71 0 23 Mar 2023
Improving Generalization with Domain Convex Game Fangrui Lv Jian Liang Shuang Li Jinming Zhang Di Liu 88 7 0 23 Mar 2023
Reliability in Semantic Segmentation: Are We on the Right Track? Pau de Jorge Riccardo Volpi Philip Torr Grégory Rogez UQCV 70 21 0 20 Mar 2023
SeiT: Storage-Efficient Vision Training with Tokens Using 1% of Pixel Storage Song Park Sanghyuk Chun Byeongho Heo Wonjae Kim Sangdoo Yun VLM ViT 97 8 0 20 Mar 2023
Model-tuning Via Prompts Makes NLP Models Adversarially Robust Mrigank Raman Pratyush Maini J. Zico Kolter Zachary Chase Lipton Danish Pruthi AAML 71 17 0 13 Mar 2023
Adaptive Calibrator Ensemble for Model Calibration under Distribution Shift Yu-Hui Zou Weijian Deng Liang Zheng OODD 34 2 0 09 Mar 2023
Chasing Fairness Under Distribution Shift: A Model Weight Perturbation Approach Zhimeng Jiang Xiaotian Han Hongye Jin Guanchu Wang Rui Chen Na Zou Helen Zhou 95 14 0 06 Mar 2023
Masked Images Are Counterfactual Samples for Robust Fine-tuning Yao Xiao Ziyi Tang Pengxu Wei Cong Liu Liang Lin 141 19 0 06 Mar 2023
Fine-Grained ImageNet Classification in the Wild Maria Lymperaiou Konstantinos Thomas Giorgos Stamou VLM 67 1 0 04 Mar 2023
Diagnosing Model Performance Under Distribution Shift Tiffany Cai Hongseok Namkoong Steve Yadlowsky 134 36 0 03 Mar 2023
Edit at your own risk: evaluating the robustness of edited models to distribution shifts Davis Brown Charles Godfrey Cody Nizinski Jonathan Tu Henry Kvinge KELM 85 8 0 28 Feb 2023
The Role of Pre-training Data in Transfer Learning R. Entezari Mitchell Wortsman O. Saukh M. Shariatnia Hanie Sedghi Ludwig Schmidt 107 23 0 27 Feb 2023
Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights? Ruisi Cai Zhenyu Zhang Zhangyang Wang AAML OOD 99 12 0 24 Feb 2023
Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation Joshua Vendrow Saachi Jain Logan Engstrom Aleksander Madry OOD 85 35 0 15 Feb 2023
Scaling Vision Transformers to 22 Billion Parameters Mostafa Dehghani Josip Djolonga Basil Mustafa Piotr Padlewski Jonathan Heek ... Mario Luvcić Xiaohua Zhai Daniel Keysers Jeremiah Harmsen N. Houlsby MLLM 203 615 0 10 Feb 2023
Linear-scaling kernels for protein sequences and small molecules outperform deep learning while providing uncertainty quantitation and improved interpretability J. Parkinson Wen Wang BDL 70 9 0 07 Feb 2023
RLSbench: Domain Adaptation Under Relaxed Label Shift Saurabh Garg Nick Erickson James Sharpnack Alexander J. Smola Sivaraman Balakrishnan Zachary Chase Lipton VLM 111 33 0 06 Feb 2023
Leaving Reality to Imagination: Robust Classification via Generated Datasets Hritik Bansal Aditya Grover OOD 117 94 0 05 Feb 2023
Effective Robustness against Natural Distribution Shifts for Models with Different Training Data Zhouxing Shi Nicholas Carlini Ananth Balashankar Ludwig Schmidt Cho-Jui Hsieh Alex Beutel Yao Qin OOD 68 10 0 02 Feb 2023
Confidence and Dispersity Speak: Characterising Prediction Matrix for Unsupervised Accuracy Estimation Weijian Deng Yumin Suh Stephen Gould Liang Zheng UQCV 86 13 0 02 Feb 2023
CLIPood: Generalizing CLIP to Out-of-Distributions Yang Shu Xingzhuo Guo Jialong Wu Ximei Wang Jianmin Wang Mingsheng Long OODD VLM 164 80 0 02 Feb 2023
Model Monitoring and Robustness of In-Use Machine Learning Models: Quantifying Data Distribution Shifts Using Population Stability Index A. Khademi M. Hopka Devesh Upadhyay OOD 82 3 0 01 Feb 2023
Pathologies of Predictive Diversity in Deep Ensembles Taiga Abe E. Kelly Buchanan Geoff Pleiss John P. Cunningham UQCV 152 14 0 01 Feb 2023
Demystifying Disagreement-on-the-Line in High Dimensions Dong-Hwan Lee Behrad Moniri Xinmeng Huang Yan Sun Hamed Hassani 77 9 0 31 Jan 2023
Diverse, Difficult, and Odd Instances (D2O): A New Test Set for Object Classification Ali Borji VLM 105 0 0 29 Jan 2023
A Closer Look at Few-shot Classification Again Xu Luo Hao Wu Ji Zhang Lianli Gao Jing Xu Jingkuan Song 101 53 0 28 Jan 2023
BinaryVQA: A Versatile Test Set to Evaluate the Out-of-Distribution Generalization of VQA Models Ali Borji CoGe 57 1 0 28 Jan 2023
ClimaX: A foundation model for weather and climate Tung Nguyen Johannes Brandstetter Ashish Kapoor Jayesh K. Gupta Aditya Grover AI4Cl AI4CE 125 271 0 24 Jan 2023
Does progress on ImageNet transfer to real-world datasets? Alex Fang Simon Kornblith Ludwig Schmidt VLM 89 38 0 11 Jan 2023
Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization Alexandre Ramé Kartik Ahuja Jianyu Zhang Matthieu Cord Léon Bottou David Lopez-Paz MoMe OODD 130 86 0 20 Dec 2022
A Probabilistic Framework for Lifelong Test-Time Adaptation Dhanajit Brahma Piyush Rai TTA 68 36 0 19 Dec 2022
Reproducible scaling laws for contrastive language-image learning Mehdi Cherti Romain Beaumont Ross Wightman Mitchell Wortsman Gabriel Ilharco Cade Gordon Christoph Schuhmann Ludwig Schmidt J. Jitsev VLM CLIP 147 825 0 14 Dec 2022
Robust Speech Recognition via Large-Scale Weak Supervision Alec Radford Jong Wook Kim Tao Xu Greg Brockman C. McLeavey Ilya Sutskever OffRL 236 3,780 0 06 Dec 2022
Context-Aware Robust Fine-Tuning Xiaofeng Mao YueFeng Chen Xiaojun Jia Rong Zhang Hui Xue Zhao Li VLM CLIP 85 28 0 29 Nov 2022
Context-Adaptive Deep Neural Networks via Bridge-Mode Connectivity Nathan G. Drenkow Alvin Tan C. Ashcraft Kiran Karra 55 0 0 28 Nov 2022
Subgroup Robustness Grows On Trees: An Empirical Baseline Investigation Josh Gardner Zoran Popovic Ludwig Schmidt OOD 107 23 0 23 Nov 2022
Mechanistic Mode Connectivity Ekdeep Singh Lubana Eric J. Bigelow Robert P. Dick David M. Krueger Hidenori Tanaka 122 49 0 15 Nov 2022
Okapi: Generalising Better by Making Statistical Matches Match Myles Bartlett Sara Romiti V. Sharmanska Novi Quadrianto 88 3 0 07 Nov 2022
Local Manifold Augmentation for Multiview Semantic Consistency Yu Yang Wing Yin Cheung Chang-rui Liu Xiang Ji 85 1 0 05 Nov 2022
Data Models for Dataset Drift Controls in Machine Learning With Optical Images Luis Oala Marco Aversa Gabriel Nobis Kurt Willis Yoan Neuenschwander ... E. Pomarico Wojciech Samek Roderick Murray-Smith Christoph Clausen B. Sanguinetti 95 6 0 04 Nov 2022
ImageNet-X: Understanding Model Mistakes with Factor of Variation Annotations Badr Youbi Idrissi Diane Bouchacourt Randall Balestriero Ivan Evtimov C. Hazirbas Nicolas Ballas Pascal Vincent M. Drozdzal David Lopez-Paz Mark Ibrahim VLM ViT 101 46 0 03 Nov 2022
Private and Reliable Neural Network Inference Nikola Jovanović Marc Fischer Samuel Steffen Martin Vechev 75 15 0 27 Oct 2022
Learning to Augment via Implicit Differentiation for Domain Generalization Ting-Hsiang Wang Da Li Kaiyang Zhou Tao Xiang Yi-Zhe Song 50 0 0 25 Oct 2022