Annotation Artifacts in Natural Language Inference Data

6 March 2018

Papers citing "Annotation Artifacts in Natural Language Inference Data"

50 / 783 papers shown

Title
Self-Supervised Position Debiasing for Large Language Models Zhongkun Liu Zheng Chen Mengqi Zhang Zhaochun Ren Pengjie Ren Zhumin Chen 36 1 0 02 Jan 2024
Zero-Shot Fact-Checking with Semantic Triples and Knowledge Graphs Moy Yuan Andreas Vlachos 29 6 0 19 Dec 2023
Discovering Highly Influential Shortcut Reasoning: An Automated Template-Free Approach Daichi Haraguchi Kiyoaki Shirai Naoya Inoue Natthawut Kertkeidkachorn LRM 16 0 0 15 Dec 2023
PROPRES: Investigating the Projectivity of Presupposition with Various Triggers and Environments Daiki Asami Saku Sugawara 26 1 0 14 Dec 2023
Dissecting vocabulary biases datasets through statistical testing and automated data augmentation for artifact mitigation in Natural Language Inference Dat Thanh Nguyen 22 0 0 14 Dec 2023
RoAST: Robustifying Language Models via Adversarial Perturbation with Selective Training Jaehyung Kim Yuning Mao Rui Hou Hanchao Yu Davis Liang Pascale Fung Qifan Wang Fuli Feng Lifu Huang Madian Khabsa AAML 31 2 0 07 Dec 2023
Improving Bias Mitigation through Bias Experts in Natural Language Understanding Eojin Jeon Mingyu Lee Juhyeong Park Yeachan Kim Wing-Lam Mok SangKeun Lee 19 2 0 06 Dec 2023
Eliciting Latent Knowledge from Quirky Language Models Alex Troy Mallen Madeline Brumley Julia Kharchenko Nora Belrose HILM RALM KELM 21 25 0 02 Dec 2023
The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP Julian Michael 19 1 0 01 Dec 2023
WorldSense: A Synthetic Benchmark for Grounded Reasoning in Large Language Models Youssef Benchekroun Megi Dervishi Mark Ibrahim Jean-Baptiste Gaya Xavier Martinet Grégoire Mialon Thomas Scialom Emmanuel Dupoux Dieuwke Hupkes Pascal Vincent LRM 29 6 0 27 Nov 2023
Human Learning by Model Feedback: The Dynamics of Iterative Prompting with Midjourney Shachar Don-Yehiya Leshem Choshen Omri Abend 21 5 0 20 Nov 2023
Latent Feature-based Data Splits to Improve Generalisation Evaluation: A Hate Speech Detection Case Study Maike Zufle Verna Dankers Ivan Titov 45 0 0 16 Nov 2023
Measuring and Improving Attentiveness to Partial Inputs with Counterfactuals Yanai Elazar Bhargavi Paranjape Hao Peng Sarah Wiegreffe Khyathi Raghavi Vivek Srikumar Sameer Singh Noah A. Smith AAML OOD 34 0 0 16 Nov 2023
Rescue: Ranking LLM Responses with Partial Ordering to Improve Response Generation Yikun Wang Rui Zheng Haoming Li Qi Zhang Tao Gui Fei Liu OffRL 25 3 0 15 Nov 2023
Formal Proofs as Structured Explanations: Proposing Several Tasks on Explainable Natural Language Inference Lasha Abzianidze LRM XAI 21 0 0 15 Nov 2023
Using Natural Language Explanations to Improve Robustness of In-context Learning Xuanli He Yuxiang Wu Oana-Maria Camburu Pasquale Minervini Pontus Stenetorp AAML 36 1 0 13 Nov 2023
Zero-Shot Cross-Lingual Sentiment Classification under Distribution Shift: an Exploratory Study Maarten De Raedt Semere Kiros Bitew Fréderic Godin Thomas Demeester Chris Develder 50 4 0 11 Nov 2023
Recursion in Recursion: Two-Level Nested Recursion for Length Generalization with Scalability Jishnu Ray Chowdhury Cornelia Caragea 37 5 0 08 Nov 2023
Data Factors for Better Compositional Generalization Xiang Zhou Yichen Jiang Mohit Bansal CoGe OOD 32 5 0 08 Nov 2023
Principles from Clinical Research for NLP Model Generalization Aparna Elangovan Jiayuan He Yuan Li Karin Verspoor CML 35 3 0 07 Nov 2023
Measuring Adversarial Datasets Yuanchen Bai Raoyi Huang Vijay Viswanathan Tzu-Sheng Kuo Tongshuang Wu 47 1 0 06 Nov 2023
Invariant-Feature Subspace Recovery: A New Class of Provable Domain Generalization Algorithms Haoxiang Wang Gargi Balasubramaniam Haozhe Si Bo Li Han Zhao OOD 35 1 0 02 Nov 2023
Construction Artifacts in Metaphor Identification Datasets Joanne Boisson Luis Espinosa-Anke Jose Camacho-Collados 11 3 0 01 Nov 2023
IBADR: an Iterative Bias-Aware Dataset Refinement Framework for Debiasing NLU models Xiaoyue Wang Xin Liu Lijie Wang Yaoxiang Wang Jinsong Su Hua Wu 25 1 0 01 Nov 2023
Interpretable-by-Design Text Understanding with Iteratively Generated Concept Bottleneck Josh Magnus Ludan Qing Lyu Yue Yang Liam Dugan Mark Yatskar Chris Callison-Burch 35 4 0 30 Oct 2023
Group Robust Classification Without Any Group Information Christos Tsirigotis João Monteiro Pau Rodríguez David Vazquez Aaron Courville OOD 27 22 0 28 Oct 2023
SDOH-NLI: a Dataset for Inferring Social Determinants of Health from Clinical Notes Á. Lelkes Eric Loreaux Tal Schuster Ming-Jun Chen Alvin Rajkomar 40 2 0 27 Oct 2023
The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI Shayne Longpre Robert Mahari Anthony Chen Naana Obeng-Marnu Damien Sileo ... K. Bollacker Tongshuang Wu Luis Villa Sandy Pentland Sara Hooker 32 56 0 25 Oct 2023
The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining Ting-Rui Chiang Dani Yogatama 25 1 0 25 Oct 2023
On the Foundations of Shortcut Learning Katherine Hermann Hossein Mobahi Thomas Fel M. C. Mozer VLM 38 28 0 24 Oct 2023
From Heuristic to Analytic: Cognitively Motivated Strategies for Coherent Physical Commonsense Reasoning Zheyuan Zhang Shane Storks Fengyuan Hu Sungryull Sohn Moontae Lee Honglak Lee Joyce Chai LRM 39 3 0 24 Oct 2023
EXPLAIN, EDIT, GENERATE: Rationale-Sensitive Counterfactual Data Augmentation for Multi-hop Fact Verification Yingjie Zhu Jiasheng Si Yibo Zhao Haiyang Zhu Deyu Zhou Yulan He 41 6 0 23 Oct 2023
REFER: An End-to-end Rationale Extraction Framework for Explanation Regularization Mohammad Reza Ghasemi Madani Pasquale Minervini 37 4 0 22 Oct 2023
Implications of Annotation Artifacts in Edge Probing Test Datasets Sagnik Ray Choudhury Jushaan Kalra 16 0 0 20 Oct 2023
Ecologically Valid Explanations for Label Variation in NLI Nan-Jiang Jiang Chenhao Tan M. Marneffe FAtt 37 4 0 20 Oct 2023
How Much Consistency Is Your Accuracy Worth? Jacob K. Johnson Ana Marasović 16 0 0 20 Oct 2023
Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learning Lucas Weber Elia Bruni Dieuwke Hupkes 37 25 0 20 Oct 2023
Removing Spurious Concepts from Neural Network Representations via Joint Subspace Estimation Floris Holstege Bram Wouters Noud van Giersbergen C. Diks 34 1 0 18 Oct 2023
Data Contamination Through the Lens of Time Manley Roberts Himanshu Thakur Christine Herlihy Colin White Samuel Dooley 84 31 0 16 Oct 2023
Impact of Co-occurrence on Factual Knowledge of Large Language Models Cheongwoong Kang Jaesik Choi KELM 38 17 0 12 Oct 2023
FTFT: Efficient and Robust Fine-Tuning by Transferring Training Dynamics Yupei Du Albert Gatt Dong Nguyen 31 1 0 10 Oct 2023
Mitigating Simplicity Bias in Deep Learning for Improved OOD Generalization and Robustness Bhavya Vasudeva Kameron Shahabi Vatsal Sharan 35 3 0 09 Oct 2023
A Long Way to Go: Investigating Length Correlations in RLHF Prasann Singhal Tanya Goyal Jiacheng Xu Greg Durrett 44 143 0 05 Oct 2023
The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising "Alignment" in Large Language Models Hannah Rose Kirk Bertie Vidgen Paul Röttger Scott A. Hale 50 2 0 03 Oct 2023
Evaluating Gender Bias of Pre-trained Language Models in Natural Language Inference by Considering All Labels Panatchakorn Anantaprayoon Masahiro Kaneko Naoaki Okazaki 64 16 0 18 Sep 2023
Towards Last-layer Retraining for Group Robustness with Fewer Annotations Tyler LaBonte Vidya Muthukumar Abhishek Kumar 38 36 0 15 Sep 2023
Bias Amplification Enhances Minority Group Performance Gaotang Li Jiarui Liu Wei Hu 30 5 0 13 Sep 2023
Evaluating the Deductive Competence of Large Language Models S. M. Seals V. Shalin ELM ReLM LRM 21 8 0 11 Sep 2023
Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models Yangyi Chen Karan Sikka Michael Cogswell Heng Ji Ajay Divakaran LRM 36 25 0 08 Sep 2023
GLS-CSC: A Simple but Effective Strategy to Mitigate Chinese STM Models' Over-Reliance on Superficial Clue Yanrui Du Sendong Zhao Yuhan Chen Rai Bai Jing Liu Huaqin Wu Haifeng Wang Bing Qin 48 2 0 08 Sep 2023