Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization

20 November 2019

Shiori Sagawa

Pang Wei Koh

Tatsunori B. Hashimoto

Percy Liang

OOD

ArXiv PDF HTML

Papers citing "Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization"

50 / 70 papers shown

Title
Robust Invariant Representation Learning by Distribution Extrapolation Kotaro Yoshida Konstantinos Slavakis OOD 73 0 0 22 May 2025
Fine-Grained Bias Exploration and Mitigation for Group-Robust Classification Miaoyun Zhao Qiang Zhang C. Li 80 0 0 11 May 2025
Learning Fine-grained Domain Generalization via Hyperbolic State Space Hallucination Qi Bi Jingjun Yi Haolan Zhan Wei Ji Gui-Song Xia 114 2 0 10 Apr 2025
Partial Transportability for Domain Generalization Kasra Jalaldoust Alexis Bellot Elias Bareinboim OOD 124 5 0 30 Mar 2025
BackMix: Regularizing Open Set Recognition by Removing Underlying Fore-Background Priors Yu Wang Junxian Mu Hongzhi Huang Qilong Wang Pengfei Zhu Q. Hu 207 1 0 22 Mar 2025
A Language Anchor-Guided Method for Robust Noisy Domain Generalization Zilin Dai Lehong Wang Fangzhou Lin Yidong Wang Zhigang Li Kazunori D Yamada Ziming Zhang Wang Lu 375 0 0 21 Mar 2025
Predicting Practically? Domain Generalization for Predictive Analytics in Real-world Environments Hanyu Duan Yi Yang Ahmed Abbasi Kar Yan Tam OOD 156 0 0 05 Mar 2025
Interpretable Failure Detection with Human-Level Concepts Kien X. Nguyen Tang Li Xi Peng 104 1 0 07 Feb 2025
Spurious Correlations in High Dimensional Regression: The Roles of Regularization, Simplicity Bias and Over-Parameterization Simone Bombari Marco Mondelli 201 0 0 03 Feb 2025
NExtLong: Toward Effective Long-Context Training without Long Documents Chaochen Gao Xing Wu Zijia Lin Debing Zhang Songlin Hu SyDa 130 2 0 22 Jan 2025
VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidance Divyansh Srivastava Beatriz Cabrero-Daniel Christian Berger VLM 127 13 0 17 Jan 2025
Refining Skewed Perceptions in Vision-Language Models through Visual Representations Haocheng Dai Sarang Joshi VLM 114 0 0 03 Jan 2025
Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes Aodi Li Liansheng Zhuang Xiao Long Minghong Yao Shafei Wang 459 0 0 18 Dec 2024
DRPruning: Efficient Large Language Model Pruning through Distributionally Robust Optimization Hexuan Deng Wenxiang Jiao Xuebo Liu Min Zhang Zhaopeng Tu Zhaopeng Tu VLM 231 0 0 21 Nov 2024
Dist Loss: Enhancing Regression in Few-Shot Region through Distribution Distance Constraint Guangkun Nie Gongzheng Tang Shenda Hong 119 0 0 20 Nov 2024
Compositional Risk Minimization Divyat Mahajan Mohammad Pezeshki Ioannis Mitliagkas Kartik Ahuja Pascal Vincent Pascal Vincent 81 5 0 08 Oct 2024
Organizing Unstructured Image Collections using Natural Language Mingxuan Liu Zhun Zhong Jun Li Gianni Franchi Subhankar Roy Elisa Ricci VLM 121 4 0 07 Oct 2024
Quantifying Context Bias in Domain Adaptation for Object Detection Hojun Son Asma Almutairi Arpan Kusari AI4CE 91 1 0 23 Sep 2024
Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval Guangyuan Ma Yongliang Ma Xing Wu Zhenpeng Su Ming Zhou Songlin Hu OOD 151 3 0 20 Aug 2024
Leveraging Invariant Principle for Heterophilic Graph Structure Distribution Shifts Jinluan Yang Zhengyu Chen Teng Xiao Wenqiao Zhang Yong Lin Kun Kuang 92 2 0 18 Aug 2024
Invariant Graph Learning Meets Information Bottleneck for Out-of-Distribution Generalization Wenyu Mao Jiancan Wu Haoyang Liu Yongduo Sui Xiang Wang OOD 98 2 0 03 Aug 2024
Invariant Correlation of Representation with Label: Enhancing Domain Generalization in Noisy Environments Gaojie Jin Ronghui Mu Xinping Yi Xiaowei Huang Lijun Zhang 124 0 0 01 Jul 2024
Fine-Grained Domain Generalization with Feature Structuralization Wenlong Yu Dongyue Chen Qilong Wang Qinghua Hu 81 0 0 13 Jun 2024
Feature contamination: Neural networks learn uncorrelated features and fail to generalize Tianren Zhang Chujie Zhao Guanyu Chen Yizhou Jiang Feng Chen OOD MLT OODD 152 5 0 05 Jun 2024
Causality Pursuit from Heterogeneous Environments via Neural Adversarial Invariance Learning Yihong Gu Cong Fang Peter Bühlmann Jianqing Fan OOD CML 269 2 0 07 May 2024
A Multimodal Automated Interpretability Agent Tamar Rott Shaham Sarah Schwettmann Franklin Wang Achyuta Rajaram Evan Hernandez Jacob Andreas Antonio Torralba 193 26 0 22 Apr 2024
Controlled Training Data Generation with Diffusion Models Teresa Yeo Andrei Atanov Harold Benoit Aleksandr Alekseev Ruchira Ray Pooya Esmaeil Akhoondi Amir Zamir 81 6 0 22 Mar 2024
Fine-tuning with Very Large Dropout Jianyu Zhang Léon Bottou 89 2 0 01 Mar 2024
Balancing Act: Distribution-Guided Debiasing in Diffusion Models Rishubh Parihar Abhijnya Bhat Abhipsa Basu Saswat Mallick Jogendra Nath Kundu R. V. Babu 99 19 0 28 Feb 2024
Identifying Spurious Correlations using Counterfactual Alignment Joseph Paul Cohen Louis Blankemeier Akshay S. Chaudhari CML 96 1 0 01 Dec 2023
Causality-oriented robustness: exploiting general noise interventions Xinwei Shen Peter Buhlmann Armeen Taeb OOD 102 9 0 18 Jul 2023
An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration Hiroki Naganuma Ryuichiro Hataya Kotaro Yoshida Ioannis Mitliagkas OODD 161 3 0 17 Jul 2023
Model Patching: Closing the Subgroup Performance Gap with Data Augmentation Karan Goel Albert Gu Yixuan Li Christopher Ré 79 121 0 15 Aug 2020
Noise or Signal: The Role of Image Backgrounds in Object Recognition Kai Y. Xiao Logan Engstrom Andrew Ilyas Aleksander Madry 135 387 0 17 Jun 2020
Hidden Stratification Causes Clinically Meaningful Failures in Machine Learning for Medical Imaging Luke Oakden-Rayner Jared A. Dunnmon G. Carneiro Christopher Ré OOD 73 383 0 27 Sep 2019
Distributionally Robust Language Modeling Yonatan Oren Shiori Sagawa Tatsunori B. Hashimoto Percy Liang OOD 70 172 0 04 Sep 2019
Invariant Risk Minimization Martín Arjovsky Léon Bottou Ishaan Gulrajani David Lopez-Paz OOD 186 2,229 0 05 Jul 2019
Invariance-inducing regularization using worst-case transformations suffices to boost accuracy and spatial robustness Fanny Yang Zuowen Wang C. Heinze-Deml 103 42 0 26 Jun 2019
Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss Kaidi Cao Colin Wei Adrien Gaidon Nikos Arechiga Tengyu Ma 127 1,602 0 18 Jun 2019
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference R. Thomas McCoy Ellie Pavlick Tal Linzen 131 1,239 0 04 Feb 2019
Class-Balanced Loss Based on Effective Number of Samples Huayu Chen Menglin Jia Nayeon Lee Yang Song Serge J. Belongie 200 2,281 0 16 Jan 2019
What is the Effect of Importance Weighting in Deep Learning? Jonathon Byrd Zachary Chase Lipton 89 464 0 08 Dec 2018
Deep Learning Predicts Hip Fracture using Confounding Patient and Healthcare Variables Giovanni Sutanto J. Zech Luke Oakden-Rayner Yevgen Chebotar Manway Liu William Gale M. McConnell Ankur Handa Thomas M. Snyder Dieter Fox AI4CE OOD 84 245 0 08 Nov 2018
Learning Models with Uniform Performance via Distributionally Robust Optimization John C. Duchi Hongseok Namkoong OOD 58 419 0 20 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 94,891 0 11 Oct 2018
Fairness Without Demographics in Repeated Loss Minimization Tatsunori B. Hashimoto Megha Srivastava Hongseok Namkoong Percy Liang FaML 108 584 0 20 Jun 2018
Annotation Artifacts in Natural Language Inference Data Suchin Gururangan Swabha Swayamdipta Omer Levy Roy Schwartz Samuel R. Bowman Noah A. Smith 150 1,176 0 06 Mar 2018
Certifying Some Distributional Robustness with Principled Adversarial Training Aman Sinha Hongseok Namkoong Riccardo Volpi John C. Duchi OOD 125 863 0 29 Oct 2017
A systematic study of the class imbalance problem in convolutional neural networks Mateusz Buda A. Maki Maciej A. Mazurowski 213 2,366 0 15 Oct 2017
Train longer, generalize better: closing the generalization gap in large batch training of neural networks Elad Hoffer Itay Hubara Daniel Soudry ODL 176 799 0 24 May 2017