An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models

14 July 2020

Papers citing "An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models"

50 / 121 papers shown

Title
Why and How LLMs Hallucinate: Connecting the Dots with Subsequence Associations Yiyou Sun Y. Gai Lijie Chen Abhilasha Ravichander Yejin Choi D. Song HILM 57 0 0 17 Apr 2025
MiMu: Mitigating Multiple Shortcut Learning Behavior of Transformers Lili Zhao Qi Liu Wei-neng Chen Lu Chen R.-H. Sun Min Hou Yang Wang Shijin Wang 31 0 0 14 Apr 2025
Language Models, Graph Searching, and Supervision Adulteration: When More Supervision is Less and How to Make More More Arvid Frydenlund LRM 52 0 0 13 Mar 2025
Reasoning Bias of Next Token Prediction Training Pengxiao Lin Zhongwang Zhang Zhi-Qin John Xu LRM 94 2 0 21 Feb 2025
What makes a good metric? Evaluating automatic metrics for text-to-image consistency Candace Ross Melissa Hall Adriana Romero Soriano Adina Williams 95 3 0 18 Dec 2024
Gumbel Counterfactual Generation From Language Models Shauli Ravfogel Anej Svete Vésteinn Snæbjarnarson Ryan Cotterell LRM CML 33 0 0 11 Nov 2024
Fine-Tuning Pre-trained Language Models for Robust Causal Representation Learning Jialin Yu Yuxiang Zhou Yulan He Nevin L. Zhang Ricardo Silva 33 0 0 18 Oct 2024
Leaving the barn door open for Clever Hans: Simple features predict LLM benchmark answers Lorenzo Pacchiardi Marko Tesic Lucy G. Cheke José Hernández-Orallo 36 3 0 15 Oct 2024
ALVIN: Active Learning Via INterpolation Michalis Korakakis Andreas Vlachos Adrian Weller 33 0 0 11 Oct 2024
Tri-Level Navigator: LLM-Empowered Tri-Level Learning for Time Series OOD Generalization Chengtao Jian Kai Yang Yang Jiao AI4TS 37 3 0 09 Oct 2024
Towards Robust Extractive Question Answering Models: Rethinking the Training Methodology Son Quoc Tran Matt Kretchmar OOD 19 0 0 29 Sep 2024
Views Can Be Deceiving: Improved SSL Through Feature Space Augmentation Kimia Hamidieh Haoran Zhang Swami Sankaranarayanan Marzyeh Ghassemi 49 0 0 28 May 2024
Explanation based Bias Decoupling Regularization for Natural Language Inference Jianxiang Zang Hui Liu 16 0 0 20 Apr 2024
The Promises and Pitfalls of Using Language Models to Measure Instruction Quality in Education Paiheng Xu Jing Liu Nathan Jones Julie Cohen Wei Ai AI4Ed 43 5 0 03 Apr 2024
Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition Yash Jain David M. Chan Pranav Dheram Aparna Khare Olabanji Shonibare Venkatesh Ravichandran Shalini Ghosh 40 2 0 28 Mar 2024
Specification Overfitting in Artificial Intelligence Benjamin Roth Pedro Henrique Luz de Araujo Yuxi Xia Saskia Kaltenbrunner Christoph Korab 58 0 0 13 Mar 2024
The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models Adithya Bhaskar Dan Friedman Danqi Chen 35 5 0 06 Mar 2024
Ask Your Distribution Shift if Pre-Training is Right for You Benjamin Cohen-Wang Joshua Vendrow Aleksander Madry OOD 29 3 0 29 Feb 2024
Generalization in Healthcare AI: Evaluation of a Clinical Large Language Model Salman Rahman L. Jiang Saadia Gabriel Yindalon Aphinyanagphongs E. Oermann R. Chunara AI4MH LM&MA 18 3 0 14 Feb 2024
Improving Black-box Robustness with In-Context Rewriting Kyle O'Brien Nathan Ng Isha Puri Jorge Mendez Hamid Palangi Yoon Kim Marzyeh Ghassemi Tom Hartvigsen 52 6 0 13 Feb 2024
Double-Dip: Thwarting Label-Only Membership Inference Attacks with Transfer Learning and Randomization Arezoo Rajabi Reeya Pimple Aiswarya Janardhanan Surudhi Asokraj Bhaskar Ramasubramanian Radha Poovendran 20 0 0 02 Feb 2024
Multitask Learning Can Improve Worst-Group Outcomes Atharva Kulkarni Lucio Dery Amrith Rajagopal Setlur Aditi Raghunathan Ameet Talwalkar Graham Neubig 37 1 0 05 Dec 2023
Explore Spurious Correlations at the Concept Level in Language Models for Text Classification Yuhang Zhou Paiheng Xu Xiaoyu Liu Bang An Wei Ai Furong Huang LRM 71 20 0 15 Nov 2023
Concept-wise Fine-tuning Matters in Preventing Negative Transfer Yunqiao Yang Long-Kai Huang Ying Wei 38 2 0 12 Nov 2023
Principles from Clinical Research for NLP Model Generalization Aparna Elangovan Jiayuan He Yuan Li Karin Verspoor CML 32 3 0 07 Nov 2023
The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining Ting-Rui Chiang Dani Yogatama 25 1 0 25 Oct 2023
MixEdit: Revisiting Data Augmentation and Beyond for Grammatical Error Correction Jingheng Ye Hai-Tao Zheng Yangning Li Hai-Tao Zheng 13 1 0 18 Oct 2023
RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbation Yue Zhang Leyang Cui Enbo Zhao Wei Bi Shuming Shi 38 6 0 11 Oct 2023
An Investigation of LLMs' Inefficacy in Understanding Converse Relations Chengwen Qi Bowen Li Binyuan Hui Bailin Wang Jinyang Li Jinwang Wu Yuanjun Laili 29 10 0 08 Oct 2023
Mitigating Shortcuts in Language Models with Soft Label Encoding Zirui He Huiqi Deng Haiyan Zhao Ninghao Liu Jundong Li 28 2 0 17 Sep 2023
Benchmarks for Detecting Measurement Tampering Fabien Roger Ryan Greenblatt Max Nadeau Buck Shlegeris Nate Thomas 28 2 0 29 Aug 2023
Improving the Reusability of Pre-trained Language Models in Real-world Applications Somayeh Ghanbarzadeh Hamid Palangi Yan-ping Huang R. C. Moreno Hamed Khanpour 12 0 0 19 Jul 2023
Evaluating Shutdown Avoidance of Language Models in Textual Scenarios Teun van der Weij Simon Lermen Leon Lang LLMAG 19 4 0 03 Jul 2023
ZeroGen: Zero-shot Multimodal Controllable Text Generation with Multiple Oracles Haoqin Tu Bowen Yang Xianfeng Zhao 19 6 0 29 Jun 2023
SituatedGen: Incorporating Geographical and Temporal Contexts into Generative Commonsense Reasoning Yunxiang Zhang Xiaojun Wan AILaw LRM 25 6 0 21 Jun 2023
Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluations Lifan Yuan Yangyi Chen Ganqu Cui Hongcheng Gao Fangyuan Zou Xingyi Cheng Heng Ji Zhiyuan Liu Maosong Sun 39 73 0 07 Jun 2023
Commonsense Knowledge Transfer for Pre-trained Language Models Wangchunshu Zhou Ronan Le Bras Yejin Choi KELM LRM 13 4 0 04 Jun 2023
Stubborn Lexical Bias in Data and Models Sofia Serrano Jesse Dodge Noah A. Smith 37 2 0 03 Jun 2023
A Simple yet Effective Self-Debiasing Framework for Transformer Models Xiaoyue Wang Lijie Wang Xin Liu Suhang Wu Jinsong Su Huasen Wu 36 3 0 02 Jun 2023
Measuring the Robustness of NLP Models to Domain Shifts Nitay Calderon Naveh Porat Eyal Ben-David Alexander Chapanin Zorik Gekhman Nadav Oved Vitaly Shalumov Roi Reichart 21 7 0 31 May 2023
Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models Guande He Jianfei Chen Jun Zhu 42 20 0 30 May 2023
Fighting Bias with Bias: Promoting Model Robustness by Amplifying Dataset Biases Yuval Reif Roy Schwartz 28 7 0 30 May 2023
From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework Yangyi Chen Hongcheng Gao Ganqu Cui Lifan Yuan Dehan Kong ... Longtao Huang H. Xue Zhiyuan Liu Maosong Sun Heng Ji AAML ELM 27 6 0 29 May 2023
Large Language Models Can be Lazy Learners: Analyze Shortcuts in In-Context Learning Ruixiang Tang Dehan Kong Lo-li Huang Hui Xue 34 50 0 26 May 2023
On Degrees of Freedom in Defining and Testing Natural Language Understanding Saku Sugawara S. Tsugita ELM 34 1 0 24 May 2023
Out-of-Distribution Generalization in Text Classification: Past, Present, and Future Linyi Yang Yangqiu Song Xuan Ren Chenyang Lyu Yidong Wang Lingqiao Liu Jindong Wang Jennifer Foster Yue Zhang OOD 37 2 0 23 May 2023
Understanding and Mitigating Spurious Correlations in Text Classification with Neighborhood Analysis Oscar Chew Hsuan-Tien Lin Kai-Wei Chang Kuan-Hao Huang 34 5 0 23 May 2023
Physics of Language Models: Part 1, Learning Hierarchical Language Structures Zeyuan Allen-Zhu Yuanzhi Li 35 16 0 23 May 2023
Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations Chenglei Si Dan Friedman Nitish Joshi Shi Feng Danqi Chen He He 13 42 0 22 May 2023
Distilling Robustness into Natural Language Inference Models with Domain-Targeted Augmentation Joe Stacey Marek Rei 29 2 0 22 May 2023