ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2012.07421
  4. Cited By
WILDS: A Benchmark of in-the-Wild Distribution Shifts

WILDS: A Benchmark of in-the-Wild Distribution Shifts

14 December 2020
Pang Wei Koh
Shiori Sagawa
Henrik Marklund
Sang Michael Xie
Marvin Zhang
Akshay Balsubramani
Weihua Hu
Michihiro Yasunaga
Richard Lanas Phillips
Irena Gao
Tony Lee
Etiene David
Ian Stavness
Wei Guo
Berton A. Earnshaw
I. Haque
Sara Beery
J. Leskovec
A. Kundaje
Emma Pierson
Sergey Levine
Chelsea Finn
Percy Liang
    OOD
ArXivPDFHTML

Papers citing "WILDS: A Benchmark of in-the-Wild Distribution Shifts"

50 / 942 papers shown
Title
Robust fine-tuning of zero-shot models
Robust fine-tuning of zero-shot models
Mitchell Wortsman
Gabriel Ilharco
Jong Wook Kim
Mike Li
Simon Kornblith
...
Raphael Gontijo-Lopes
Hannaneh Hajishirzi
Ali Farhadi
Hongseok Namkoong
Ludwig Schmidt
VLM
64
691
0
04 Sep 2021
MultiEURLEX -- A multi-lingual and multi-label legal document
  classification dataset for zero-shot cross-lingual transfer
MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfer
Ilias Chalkidis
Manos Fergadiotis
Ion Androutsopoulos
AILaw
27
107
0
02 Sep 2021
Towards Out-Of-Distribution Generalization: A Survey
Towards Out-Of-Distribution Generalization: A Survey
Jiashuo Liu
Zheyan Shen
Yue He
Xingxuan Zhang
Renzhe Xu
Han Yu
Peng Cui
CML
OOD
55
517
0
31 Aug 2021
SHIFT15M: Fashion-specific dataset for set-to-set matching with several
  distribution shifts
SHIFT15M: Fashion-specific dataset for set-to-set matching with several distribution shifts
Masanari Kimura
Takuma Nakamura
Yuki Saito
OOD
39
3
0
30 Aug 2021
Pulling Up by the Causal Bootstraps: Causal Data Augmentation for
  Pre-training Debiasing
Pulling Up by the Causal Bootstraps: Causal Data Augmentation for Pre-training Debiasing
Sindhu C. M. Gowda
Shalmali Joshi
Haoran Zhang
Marzyeh Ghassemi
CML
32
8
0
27 Aug 2021
A comparison of approaches to improve worst-case predictive model
  performance over patient subpopulations
A comparison of approaches to improve worst-case predictive model performance over patient subpopulations
Stephen R. Pfohl
Haoran Zhang
Yizhe Xu
Agata Foryciarz
Marzyeh Ghassemi
N. Shah
OOD
29
22
0
27 Aug 2021
Network Generalization Prediction for Safety Critical Tasks in Novel
  Operating Domains
Network Generalization Prediction for Safety Critical Tasks in Novel Operating Domains
Molly O'Brien
Michael Medoff
Julia V. Bukowski
Gregory Hager
OOD
21
3
0
17 Aug 2021
Challenges for cognitive decoding using deep learning methods
Challenges for cognitive decoding using deep learning methods
A. Thomas
Christopher Ré
R. Poldrack
AI4CE
24
6
0
16 Aug 2021
Active Assessment of Prediction Services as Accuracy Surface Over
  Attribute Combinations
Active Assessment of Prediction Services as Accuracy Surface Over Attribute Combinations
Vihari Piratla
Soumen Chakrabarty
Sunita Sarawagi
11
3
0
14 Aug 2021
Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding
  Ecosystems
Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems
Laurel J. Orr
Atindriyo Sanyal
Xiao Ling
Karan Goel
Megan Leszczynski
25
18
0
11 Aug 2021
DEMix Layers: Disentangling Domains for Modular Language Modeling
DEMix Layers: Disentangling Domains for Modular Language Modeling
Suchin Gururangan
Michael Lewis
Ari Holtzman
Noah A. Smith
Luke Zettlemoyer
KELM
MoE
21
127
0
11 Aug 2021
Exploring Out-of-Distribution Generalization in Text Classifiers Trained
  on Tobacco-3482 and RVL-CDIP
Exploring Out-of-Distribution Generalization in Text Classifiers Trained on Tobacco-3482 and RVL-CDIP
Stefan Larson
Navtej Singh
Saarthak Maheshwari
Shanti Stewart
U. Krishnaswamy
OODD
OOD
17
3
0
05 Aug 2021
Sequential Multivariate Change Detection with Calibrated and Memoryless
  False Detection Rates
Sequential Multivariate Change Detection with Calibrated and Memoryless False Detection Rates
Oliver Cobb
A. V. Looveren
Janis Klaise
34
6
0
02 Aug 2021
Did the Model Change? Efficiently Assessing Machine Learning API Shifts
Did the Model Change? Efficiently Assessing Machine Learning API Shifts
Lingjiao Chen
Tracy Cai
Matei A. Zaharia
James Zou
20
17
0
29 Jul 2021
Characterizing Generalization under Out-Of-Distribution Shifts in Deep
  Metric Learning
Characterizing Generalization under Out-Of-Distribution Shifts in Deep Metric Learning
Timo Milbich
Karsten Roth
Samarth Sinha
Ludwig Schmidt
Marzyeh Ghassemi
Bjorn Ommer
OOD
OODD
28
22
0
20 Jul 2021
Just Train Twice: Improving Group Robustness without Training Group
  Information
Just Train Twice: Improving Group Robustness without Training Group Information
E. Liu
Behzad Haghgoo
Annie S. Chen
Aditi Raghunathan
Pang Wei Koh
Shiori Sagawa
Percy Liang
Chelsea Finn
OOD
37
538
0
19 Jul 2021
A Gentle Introduction to Conformal Prediction and Distribution-Free
  Uncertainty Quantification
A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification
Anastasios Nikolas Angelopoulos
Stephen Bates
OOD
44
581
0
15 Jul 2021
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
Paul Pu Liang
Yiwei Lyu
Xiang Fan
Zetian Wu
Yun Cheng
...
Peter Wu
Michelle A. Lee
Yuke Zhu
Ruslan Salakhutdinov
Louis-Philippe Morency
VLM
32
159
0
15 Jul 2021
Shifts: A Dataset of Real Distributional Shift Across Multiple
  Large-Scale Tasks
Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Tasks
A. Malinin
Neil Band
Ganshin
Alexander
German Chesnokov
...
Roginskiy
Denis
Mariya Shmatova
Panos Tigas
Boris Yangel
UQCV
OOD
29
126
0
15 Jul 2021
FLEX: Unifying Evaluation for Few-Shot NLP
FLEX: Unifying Evaluation for Few-Shot NLP
Jonathan Bragg
Arman Cohan
Kyle Lo
Iz Beltagy
205
104
0
15 Jul 2021
The Role of Pretrained Representations for the OOD Generalization of
  Reinforcement Learning Agents
The Role of Pretrained Representations for the OOD Generalization of Reinforcement Learning Agents
Andrea Dittadi
Frederik Trauble
M. Wuthrich
Felix Widmaier
Peter V. Gehler
Ole Winther
Francesco Locatello
Olivier Bachem
Bernhard Schölkopf
Stefan Bauer
OOD
41
16
0
12 Jul 2021
Source-Free Adaptation to Measurement Shift via Bottom-Up Feature
  Restoration
Source-Free Adaptation to Measurement Shift via Bottom-Up Feature Restoration
Cian Eastwood
I. Mason
Christopher K. I. Williams
Bernhard Schölkopf
TTA
27
51
0
12 Jul 2021
Accuracy on the Line: On the Strong Correlation Between
  Out-of-Distribution and In-Distribution Generalization
Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalization
John Miller
Rohan Taori
Aditi Raghunathan
Shiori Sagawa
Pang Wei Koh
Vaishaal Shankar
Percy Liang
Y. Carmon
Ludwig Schmidt
OODD
OOD
25
267
0
09 Jul 2021
Measuring and Improving Model-Moderator Collaboration using Uncertainty
  Estimation
Measuring and Improving Model-Moderator Collaboration using Uncertainty Estimation
Ian D Kivlichan
Zi Lin
J. Liu
Lucy Vasserman
14
19
0
09 Jul 2021
Predicting with Confidence on Unseen Distributions
Predicting with Confidence on Unseen Distributions
Devin Guillory
Vaishaal Shankar
Sayna Ebrahimi
Trevor Darrell
Ludwig Schmidt
UQCV
OOD
20
116
0
07 Jul 2021
DebiasedDTA: A Framework for Improving the Generalizability of
  Drug-Target Affinity Prediction Models
DebiasedDTA: A Framework for Improving the Generalizability of Drug-Target Affinity Prediction Models
Riza Ozccelik
Alperen Baug
Berk Atil
Melih Barsbey
Arzucan Özgür
Elif Özkirimli
AI4CE
11
0
0
04 Jul 2021
Species Distribution Modeling for Machine Learning Practitioners: A
  Review
Species Distribution Modeling for Machine Learning Practitioners: A Review
Sara Beery
Elijah Cole
Joseph Parker
Pietro Perona
Kevin Winner
21
69
0
03 Jul 2021
Mandoline: Model Evaluation under Distribution Shift
Mandoline: Model Evaluation under Distribution Shift
Mayee F. Chen
Karan Goel
N. Sohoni
Fait Poms
Kayvon Fatahalian
Christopher Ré
28
69
0
01 Jul 2021
The Evolution of Out-of-Distribution Robustness Throughout Fine-Tuning
The Evolution of Out-of-Distribution Robustness Throughout Fine-Tuning
Anders Andreassen
Yasaman Bahri
Behnam Neyshabur
Rebecca Roelofs
OOD
OODD
30
78
0
30 Jun 2021
Detecting Errors and Estimating Accuracy on Unlabeled Data with
  Self-training Ensembles
Detecting Errors and Estimating Accuracy on Unlabeled Data with Self-training Ensembles
Jiefeng Chen
Frederick Liu
Besim Avci
Xi Wu
Yingyu Liang
S. Jha
32
61
0
29 Jun 2021
Critically examining the Domain Generalizability of Facial Expression
  Recognition models
Critically examining the Domain Generalizability of Facial Expression Recognition models
Varsha Suresh
G. Yeo
Desmond C. Ong
29
6
0
29 Jun 2021
Laplace Redux -- Effortless Bayesian Deep Learning
Laplace Redux -- Effortless Bayesian Deep Learning
Erik A. Daxberger
Agustinus Kristiadi
Alexander Immer
Runa Eschenhagen
Matthias Bauer
Philipp Hennig
BDL
UQCV
58
289
0
28 Jun 2021
Meaningfully Debugging Model Mistakes using Conceptual Counterfactual
  Explanations
Meaningfully Debugging Model Mistakes using Conceptual Counterfactual Explanations
Abubakar Abid
Mert Yuksekgonul
James Zou
CML
34
64
0
24 Jun 2021
Image-to-Image Translation of Synthetic Samples for Rare Classes
Image-to-Image Translation of Synthetic Samples for Rare Classes
Edoardo Lanzini
Sara Beery
19
2
0
23 Jun 2021
Examining and Combating Spurious Features under Distribution Shift
Examining and Combating Spurious Features under Distribution Shift
Chunting Zhou
Xuezhe Ma
Paul Michel
Graham Neubig
OOD
32
66
0
14 Jun 2021
Break-It-Fix-It: Unsupervised Learning for Program Repair
Break-It-Fix-It: Unsupervised Learning for Program Repair
Michihiro Yasunaga
Percy Liang
26
106
0
11 Jun 2021
A Discussion on Building Practical NLP Leaderboards: The Case of Machine
  Translation
A Discussion on Building Practical NLP Leaderboards: The Case of Machine Translation
Sebastin Santy
Prasanta Bhattacharya
LLMAG
33
2
0
11 Jun 2021
DORO: Distributional and Outlier Robust Optimization
DORO: Distributional and Outlier Robust Optimization
Runtian Zhai
Chen Dan
J. Zico Kolter
Pradeep Ravikumar
33
60
0
11 Jun 2021
Gradual Domain Adaptation in the Wild:When Intermediate Distributions
  are Absent
Gradual Domain Adaptation in the Wild:When Intermediate Distributions are Absent
Samira Abnar
Rianne van den Berg
Golnaz Ghiasi
Mostafa Dehghani
Nal Kalchbrenner
Hanie Sedghi
OOD
CLL
TTA
28
21
0
10 Jun 2021
Learning Domain Invariant Representations by Joint Wasserstein Distance
  Minimization
Learning Domain Invariant Representations by Joint Wasserstein Distance Minimization
Léo Andéol
Yusei Kawakami
Yuichiro Wada
Takafumi Kanamori
K. Müller
G. Montavon
OOD
37
7
0
09 Jun 2021
Towards a Theoretical Framework of Out-of-Distribution Generalization
Towards a Theoretical Framework of Out-of-Distribution Generalization
Haotian Ye
Chuanlong Xie
Tianle Cai
Ruichen Li
Zhenguo Li
Liwei Wang
OODD
OOD
61
105
0
08 Jun 2021
An Information-theoretic Approach to Distribution Shifts
An Information-theoretic Approach to Distribution Shifts
Marco Federici
Ryota Tomioka
Patrick Forré
OOD
44
17
0
07 Jun 2021
OoD-Bench: Quantifying and Understanding Two Dimensions of
  Out-of-Distribution Generalization
OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalization
Nanyang Ye
Kaican Li
Haoyue Bai
Runpeng Yu
Lanqing Hong
Fengwei Zhou
Zhenguo Li
Jun Zhu
CML
OOD
40
106
0
07 Jun 2021
Quantifying and Improving Transferability in Domain Generalization
Quantifying and Improving Transferability in Domain Generalization
Guojun Zhang
Han Zhao
Yaoliang Yu
Pascal Poupart
40
37
0
07 Jun 2021
A call for better unit testing for invariant risk minimisation
A call for better unit testing for invariant risk minimisation
Chunyang Xiao
Pranava Madhyastha
16
1
0
06 Jun 2021
Can Subnetwork Structure be the Key to Out-of-Distribution
  Generalization?
Can Subnetwork Structure be the Key to Out-of-Distribution Generalization?
Dinghuai Zhang
Kartik Ahuja
Yilun Xu
Yisen Wang
Aaron Courville
OOD
20
95
0
05 Jun 2021
SAND-mask: An Enhanced Gradient Masking Strategy for the Discovery of
  Invariances in Domain Generalization
SAND-mask: An Enhanced Gradient Masking Strategy for the Discovery of Invariances in Domain Generalization
Soroosh Shahtalebi
Jean-Christophe Gagnon-Audet
Touraj Laleh
Mojtaba Faramarzi
Kartik Ahuja
Irina Rish
33
59
0
04 Jun 2021
Learning to Extend Program Graphs to Work-in-Progress Code
Learning to Extend Program Graphs to Work-in-Progress Code
Xuechen Li
Chris J. Maddison
Daniel Tarlow
18
2
0
28 May 2021
Privacy-Preserving Constrained Domain Generalization via Gradient
  Alignment
Privacy-Preserving Constrained Domain Generalization via Gradient Alignment
Chris Xing Tian
Haoliang Li
Yufei Wang
Shiqi Wang
13
4
0
14 May 2021
Global Wheat Challenge 2020: Analysis of the competition design and
  winning models
Global Wheat Challenge 2020: Analysis of the competition design and winning models
Etienne David
F. Ogidi
Wei Guo
F. Baret
Ian Stavness
21
8
0
13 May 2021
Previous
123...171819
Next