An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models

14 July 2020

Papers citing "An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models"

50 / 121 papers shown

Title
Think Twice: Measuring the Efficiency of Eliminating Prediction Shortcuts of Question Answering Models Lukávs Mikula Michal vStefánik Marek Petrovivc Petr Sojka 41 3 0 11 May 2023
Even Small Correlation and Diversity Shifts Pose Dataset-Bias Issues Alceu Bissoto Catarina Barata Eduardo Valle Sandra Avila OOD 27 4 0 09 May 2023
CausalAPM: Generalizable Literal Disentanglement for NLU Debiasing Songyang Gao Shihan Dou Junjie Shan Qi Zhang Xuanjing Huang CML 32 0 0 04 May 2023
Distributionally Robust Optimization with Probabilistic Group Soumya Suvra Ghosal Yixuan Li OOD 16 7 0 10 Mar 2023
Robust Question Answering against Distribution Shifts with Test-Time Adaptation: An Empirical Study Hai Ye Yuyang Ding Juntao Li Hwee Tou Ng OOD TTA 29 9 0 09 Feb 2023
Measure More, Question More: Experimental Studies on Transformer-based Language Models and Complement Coercion Yuling Gu 22 1 0 20 Dec 2022
Debiasing Stance Detection Models with Counterfactual Reasoning and Adversarial Bias Learning Jianhua Yuan Yanyan Zhao Bing Qin 52 4 0 20 Dec 2022
Feature Dropout: Revisiting the Role of Augmentations in Contrastive Learning Alex Tamkin Margalit Glasgow Xiluo He Noah D. Goodman SSL 27 7 0 16 Dec 2022
AGRO: Adversarial Discovery of Error-prone groups for Robust Optimization Bhargavi Paranjape Pradeep Dasigi Vivek Srikumar Luke Zettlemoyer Hannaneh Hajishirzi 36 7 0 02 Dec 2022
ModelDiff: A Framework for Comparing Learning Algorithms Harshay Shah Sung Min Park Andrew Ilyas A. Madry SyDa 54 26 0 22 Nov 2022
GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization Perspective Linyi Yang Shuibai Zhang Libo Qin Yafu Li Yidong Wang Hanmeng Liu Jindong Wang Xingxu Xie Yue Zhang ELM 52 79 0 15 Nov 2022
Looking at the Overlooked: An Analysis on the Word-Overlap Bias in Natural Language Inference S. Rajaee Yadollah Yaghoobzadeh Mohammad Taher Pilehvar 36 5 0 07 Nov 2022
Are All Spurious Features in Natural Language Alike? An Analysis through a Causal Lens Nitish Joshi X. Pan Hengxing He CML 61 30 0 25 Oct 2022
Lexical Generalization Improves with Larger Models and Longer Training Elron Bandel Yoav Goldberg Yanai Elazar 64 6 0 23 Oct 2022
Exploring The Landscape of Distributional Robustness for Question Answering Models Anas Awadalla Mitchell Wortsman Gabriel Ilharco Sewon Min Ian H. Magnusson Hannaneh Hajishirzi Ludwig Schmidt ELM OOD KELM 72 19 0 22 Oct 2022
Measures of Information Reflect Memorization Patterns Rachit Bansal Danish Pruthi Yonatan Belinkov 33 8 0 17 Oct 2022
Kernel-Whitening: Overcome Dataset Bias with Isotropic Sentence Embedding Songyang Gao Shihan Dou Qi Zhang Xuanjing Huang 25 8 0 14 Oct 2022
A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models Yuanxin Liu Fandong Meng Zheng Lin JiangNan Li Peng Fu Yanan Cao Weiping Wang Jie Zhou 39 5 0 11 Oct 2022
Learning Robust Representations for Continual Relation Extraction via Adversarial Class Augmentation Peiyi Wang Yifan Song Tianyu Liu Binghuai Lin Yunbo Cao Sujian Li Zhifang Sui CLL SLR 37 22 0 10 Oct 2022
UU-Tax at SemEval-2022 Task 3: Improving the generalizability of language models for taxonomy classification through data augmentation I. Sarhan P. Mosteiro Marco Spruit 31 2 0 07 Oct 2022
FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training Junyi Chai Reid Pryzant Victor Ye Dong Konstantin Golobokov Chenguang Zhu Yi Liu 37 5 0 06 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 129 95 0 06 Oct 2022
Less is Better: Recovering Intended-Feature Subspace to Robustify NLU Models Ting Wu Tao Gui 45 5 0 16 Sep 2022
Shortcut Learning of Large Language Models in Natural Language Understanding Mengnan Du Fengxiang He Na Zou Dacheng Tao Xia Hu KELM OffRL 42 84 0 25 Aug 2022
Plex: Towards Reliability using Pretrained Large Model Extensions Dustin Tran J. Liu Michael W. Dusenberry Du Phan Mark Collier ... D. Sculley Y. Gal Zoubin Ghahramani Jasper Snoek Balaji Lakshminarayanan VLM 39 124 0 15 Jul 2022
Breaking Correlation Shift via Conditional Invariant Regularizer Mingyang Yi Ruoyu Wang Jiacheng Sun Zhenguo Li Zhi-Ming Ma OODD 20 5 0 14 Jul 2022
Methods for Estimating and Improving Robustness of Language Models Michal Stefánik 13 1 0 16 Jun 2022
A Meta-Analysis of Distributionally-Robust Models Ben Feuer Ameya Joshi C. Hegde OOD VLM 43 3 0 15 Jun 2022
Do we need Label Regularization to Fine-tune Pre-trained Language Models? I. Kobyzev A. Jafari Mehdi Rezagholizadeh Tianda Li Alan Do-Omri Peng Lu Pascal Poupart A. Ghodsi 30 2 0 25 May 2022
A Rationale-Centric Framework for Human-in-the-loop Machine Learning Jinghui Lu Linyi Yang Brian Mac Namee Yue Zhang 27 39 0 24 Mar 2022
Leveraging Expert Guided Adversarial Augmentation For Improving Generalization in Named Entity Recognition Aaron Reich Jiaao Chen Aastha Agrawal Yanzhe Zhang Diyi Yang AAML 16 5 0 21 Mar 2022
Are Vision Transformers Robust to Spurious Correlations? Soumya Suvra Ghosal Yifei Ming Yixuan Li ViT 33 29 0 17 Mar 2022
Adaptor: Objective-Centric Adaptation Framework for Language Models Michal vStefánik Vít Novotný Nikola Groverová Petr Sojka 35 10 0 08 Mar 2022
WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation Alisa Liu Swabha Swayamdipta Noah A. Smith Yejin Choi 82 213 0 16 Jan 2022
CommonsenseQA 2.0: Exposing the Limits of AI through Gamification Alon Talmor Ori Yoran Ronan Le Bras Chandrasekhar Bhagavatula Yoav Goldberg Yejin Choi Jonathan Berant ELM 33 141 0 14 Jan 2022
Polish Natural Language Inference and Factivity -- an Expert-based Dataset and Benchmarks Daniel Ziembicki Anna Wróblewska Karolina Seweryn 24 1 0 10 Jan 2022
Robust Natural Language Processing: Recent Advances, Challenges, and Future Directions Marwan Omar Soohyeon Choi Daehun Nyang David A. Mohaisen 32 57 0 03 Jan 2022
PECO: Examining Single Sentence Label Leakage in Natural Language Inference Datasets through Progressive Evaluation of Cluster Outliers Michael Stephen Saxon Xinyi Wang Wenda Xu William Yang Wang 26 8 0 16 Dec 2021
An Empirical Investigation of the Role of Pre-training in Lifelong Learning Sanket Vaibhav Mehta Darshan Patil Sarath Chandar Emma Strubell CLL 45 137 0 16 Dec 2021
Measure and Improve Robustness in NLP Models: A Survey Xuezhi Wang Haohan Wang Diyi Yang 139 130 0 15 Dec 2021
Extending the WILDS Benchmark for Unsupervised Adaptation Shiori Sagawa Pang Wei Koh Tony Lee Irena Gao Sang Michael Xie ... Kate Saenko Tatsunori Hashimoto Sergey Levine Chelsea Finn Percy Liang OOD 18 98 0 09 Dec 2021
The Effect of Model Size on Worst-Group Generalization Alan Pham Eunice Chan V. Srivatsa Dhruba Ghosh Yaoqing Yang Yaodong Yu Ruiqi Zhong Joseph E. Gonzalez Jacob Steinhardt 23 5 0 08 Dec 2021
OOD-GNN: Out-of-Distribution Generalized Graph Neural Network Haoyang Li Xin Wang Ziwei Zhang Wenwu Zhu OODD OOD 31 97 0 07 Dec 2021
Towards Principled Disentanglement for Domain Generalization Hanlin Zhang Yi-Fan Zhang Weiyang Liu Adrian Weller Bernhard Schölkopf Eric Xing OOD 39 112 0 27 Nov 2021
Benchmarking Multimodal AutoML for Tabular Data with Text Fields Xingjian Shi Jonas W. Mueller Nick Erickson Mu Li Alexander J. Smola LMTD 42 29 0 04 Nov 2021
Quantifying the Task-Specific Information in Text-Based Classifications Zining Zhu Aparna Balagopalan Marzyeh Ghassemi Frank Rudzicz 42 4 0 17 Oct 2021
Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding Mengnan Du Subhabrata Mukherjee Yu Cheng Milad Shokouhi Xia Hu Ahmed Hassan Awadallah 52 13 0 16 Oct 2021
Invariant Language Modeling Maxime Peyrard Sarvjeet Ghotra Martin Josifoski Vidhan Agarwal Barun Patra Dean Carignan Emre Kıcıman Robert West 29 13 0 16 Oct 2021
Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Models Tianlu Wang Rohit Sridhar Diyi Yang Xuezhi Wang AAML 120 72 0 14 Oct 2021
Interpreting the Robustness of Neural NLP Models to Textual Perturbations Yunxiang Zhang Liangming Pan Samson Tan Min-Yen Kan 33 21 0 14 Oct 2021