Understanding the Failure Modes of Out-of-Distribution Generalization

29 October 2020

Papers citing "Understanding the Failure Modes of Out-of-Distribution Generalization"

41 / 41 papers shown

Title
Severing Spurious Correlations with Data Pruning Varun Mulchandani Jung-Eun Kim 195 0 0 24 Mar 2025
Beyond Reward Hacking: Causal Rewards for Large Language Model Alignment Chaoqi Wang Zhuokai Zhao Yibo Jiang Zhaorun Chen Chen Zhu ... Jiayi Liu Lizhu Zhang Xiangjun Fan Hao Ma Sinong Wang 80 3 0 17 Jan 2025
In-context Learning in Presence of Spurious Correlations Hrayr Harutyunyan R. Darbinyan Samvel Karapetyan Hrant Khachatrian LRM 54 1 0 04 Oct 2024
Feature contamination: Neural networks learn uncorrelated features and fail to generalize Tianren Zhang Chujie Zhao Guanyu Chen Yizhou Jiang Feng Chen OOD MLT OODD 77 3 0 05 Jun 2024
Towards a Better Evaluation of Out-of-Domain Generalization Duhun Hwang Suhyun Kang Moonjung Eo Jimyeong Kim Wonjong Rhee 59 0 0 30 May 2024
When does compositional structure yield compositional generalization? A kernel theory Samuel Lippl Kim Stachenfeld NAI CoGe 73 5 0 26 May 2024
Complexity Matters: Dynamics of Feature Learning in the Presence of Spurious Correlations GuanWen Qiu Da Kuang Surbhi Goel 27 8 0 05 Mar 2024
LEVI: Generalizable Fine-tuning via Layer-wise Ensemble of Different Views Yuji Roh Qingyun Liu Huan Gui Zhe Yuan Yujin Tang ... Liang Liu Shuchao Bi Lichan Hong Ed H. Chi Zhe Zhao 46 1 0 07 Feb 2024
Out-of-distribution detection using normalizing flows on the data manifold S. Razavi M. Mehmanchi Reshad Hosseini Mostafa Tavassolipour OODD 48 0 0 26 Aug 2023
Spurious Correlations and Where to Find Them Gautam Sreekumar Vishnu Boddeti CML 22 3 0 21 Aug 2023
An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration Hiroki Naganuma Ryuichiro Hataya Kotaro Yoshida Ioannis Mitliagkas OODD 95 1 0 17 Jul 2023
Fantastic DNN Classifiers and How to Identify them without Data Nathaniel R. Dean D. Sarkar 23 1 0 24 May 2023
Modeling the Q-Diversity in a Min-max Play Game for Robust Optimization Ting Wu Rui Zheng Tao Gui Qi Zhang Xuanjing Huang 51 2 0 20 May 2023
SFP: Spurious Feature-targeted Pruning for Out-of-Distribution Generalization Yingchun Wang Jingcai Guo Yi Liu Song Guo Weizhan Zhang Xiangyong Cao Qinghua Zheng AAML OODD 33 11 0 19 May 2023
Spawrious: A Benchmark for Fine Control of Spurious Correlation Biases Aengus Lynch G. Dovonon Jean Kaddour Ricardo M. A. Silva 202 30 0 09 Mar 2023
Improving group robustness under noisy labels using predictive uncertainty Dongpin Oh Dae Lee Jeunghyun Byun Bonggun Shin UQCV 23 3 0 14 Dec 2022
Avoiding spurious correlations via logit correction Sheng Liu Xu Zhang Nitesh Sekhar Yue Wu Prateek Singhal C. Fernandez‐Granda 25 29 0 02 Dec 2022
Malign Overfitting: Interpolation Can Provably Preclude Invariance Yoav Wald G. Yona Uri Shalit Y. Carmon 17 6 0 28 Nov 2022
FL Games: A Federated Learning Framework for Distribution Shifts Sharut Gupta Kartik Ahuja Mohammad Havaei N. Chatterjee Yoshua Bengio OOD FedML 29 18 0 31 Oct 2022
Evaluation of Categorical Generative Models -- Bridging the Gap Between Real and Synthetic Data Florence Regol Anja Kroon Mark J. Coates ELM EGVM 36 1 0 28 Oct 2022
Test-Time Training for Graph Neural Networks Yiqi Wang Chaozhuo Li Wei Jin Rui Li Jianan Zhao Jiliang Tang Xing Xie OOD 30 14 0 17 Oct 2022
Improving Out-of-Distribution Generalization by Adversarial Training with Structured Priors Qixun Wang Yifei Wang Hong Zhu Yisen Wang OOD 22 19 0 13 Oct 2022
Training Debiased Subnetworks with Contrastive Weight Pruning Geon Yeong Park Sangmin Lee Sang Wan Lee Jong Chul Ye CML 35 13 0 11 Oct 2022
Towards Understanding and Boosting Adversarial Transferability from a Distribution Perspective Yao Zhu YueFeng Chen Xiaodan Li Kejiang Chen Yuan He Xiang Tian Bo Zheng Yao-wu Chen Qingming Huang AAML 33 58 0 09 Oct 2022
Out-of-Distribution Detection and Selective Generation for Conditional Language Models Jie Jessie Ren Jiaming Luo Yao-Min Zhao Kundan Krishna Mohammad Saleh Balaji Lakshminarayanan Peter J. Liu OODD 75 96 0 30 Sep 2022
Optimal Transport-based Identity Matching for Identity-invariant Facial Expression Recognition D. Kim B. Song OT 40 10 0 25 Sep 2022
Importance Tempering: Group Robustness for Overparameterized Models Yiping Lu Wenlong Ji Zachary Izzo Lexing Ying 45 7 0 19 Sep 2022
Calibrated ensembles can mitigate accuracy tradeoffs under distribution shift Ananya Kumar Tengyu Ma Percy Liang Aditi Raghunathan UQCV OODD OOD 45 38 0 18 Jul 2022
Exploring Length Generalization in Large Language Models Cem Anil Yuhuai Wu Anders Andreassen Aitor Lewkowycz Vedant Misra V. Ramasesh Ambrose Slone Guy Gur-Ari Ethan Dyer Behnam Neyshabur ReLM LRM 33 158 0 11 Jul 2022
Towards out of distribution generalization for problems in mechanics Lingxiao Yuan Harold S. Park Emma Lejeune OOD AI4CE 36 17 0 29 Jun 2022
Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow Adam Subel Yifei Guan Ashesh Chattopadhyay Pedram Hassanzadeh AI4CE 35 41 0 07 Jun 2022
Bayesian Active Learning for Scanning Probe Microscopy: from Gaussian Processes to Hypothesis Learning M. Ziatdinov Yongtao Liu K. Kelley Rama K Vasudevan Sergei V. Kalinin AI4CE 47 49 0 30 May 2022
Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations Polina Kirichenko Pavel Izmailov A. Wilson OOD 49 318 0 06 Apr 2022
Understanding Rare Spurious Correlations in Neural Networks Yao-Yuan Yang Chi-Ning Chou Kamalika Chaudhuri AAML 18 25 0 10 Feb 2022
Conditional entropy minimization principle for learning domain invariant representation features Thuan Q. Nguyen Boyang Lyu Prakash Ishwar matthias. scheutz Shuchin Aeron OOD 32 7 0 25 Jan 2022
Deep Learning Through the Lens of Example Difficulty R. Baldock Hartmut Maennel Behnam Neyshabur 47 156 0 17 Jun 2021
Invariant Information Bottleneck for Domain Generalization Bo-wen Li Yifei Shen Yezhen Wang Wenzhen Zhu Colorado Reed Jun Zhang Dongsheng Li Kurt Keutzer Han Zhao OOD 32 105 0 11 Jun 2021
Can Subnetwork Structure be the Key to Out-of-Distribution Generalization? Dinghuai Zhang Kartik Ahuja Yilun Xu Yisen Wang Aaron Courville OOD 20 95 0 05 Jun 2021
Does Invariant Risk Minimization Capture Invariance? Pritish Kamath Akilesh Tangella Danica J. Sutherland Nathan Srebro OOD 206 125 0 04 Jan 2021
An Investigation of Why Overparameterization Exacerbates Spurious Correlations Shiori Sagawa Aditi Raghunathan Pang Wei Koh Percy Liang 152 371 0 09 May 2020
Out-of-Distribution Generalization via Risk Extrapolation (REx) David M. Krueger Ethan Caballero J. Jacobsen Amy Zhang Jonathan Binas Dinghuai Zhang Rémi Le Priol Aaron Courville OOD 215 901 0 02 Mar 2020