Agreeing to Disagree: Annotating Offensive Language Datasets with
Annotators' Disagreement

Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreement

28 September 2021

Elisa Leonardelli

Alessio Palmero Aprosio

Papers citing "Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreement"

14 / 14 papers shown

Title
Unveiling the Capabilities of Large Language Models in Detecting Offensive Language with Annotation Disagreement Junyu Lu Kai Ma Kaichun Wang Kelaiti Xiao Roy Ka-Wei Lee Bo Xu Liang Yang Hongfei Lin 49 0 0 10 Feb 2025
Training and Evaluating with Human Label Variation: An Empirical Study K. K. Meladel Mistica Timothy Baldwin Jey Han Lau 65 0 0 03 Feb 2025
AUTALIC: A Dataset for Anti-AUTistic Ableist Language In Context Naba Rizvi Harper Strickland Daniel Gitelman Tristan Cooper Alexis Morales-Flores ... Haaset Owens Saleha Ahmedi Isha Khirwadkar Imani Munyaka Nedjma Ousidhoum 32 0 0 21 Oct 2024
Infrastructure Ombudsman: Mining Future Failure Concerns from Structural Disaster Response Towhid Chowdhury Soumyajit Datta Naveen Sharma Ashiqur R. KhudaBukhsh AI4CE 34 4 0 21 Feb 2024
Modeling subjectivity (by Mimicking Annotator Annotation) in toxic comment identification across diverse communities Senjuti Dutta Sid Mittal Sherol Chen Deepak Ramachandran Ravi Rajakumar Ian D Kivlichan Sunny Mak Alena Butryna Praveen Paritosh University of Tennessee 37 5 0 01 Nov 2023
Examining Temporal Bias in Abusive Language Detection Mali Jin Yida Mu Diana Maynard Kalina Bontcheva 32 5 0 25 Sep 2023
Lon-ea at SemEval-2023 Task 11: A Comparison of Activation Functions for Soft and Hard Label Prediction Peyman Hosseini Mehran Hosseini Sana Al-Azzawi Marcus Liwicki Ignacio Castro Matthew Purver 14 1 0 04 Mar 2023
Consistency is Key: Disentangling Label Variation in Natural Language Processing with Intra-Annotator Agreement Gavin Abercrombie Verena Rieser Dirk Hovy 43 16 0 25 Jan 2023
CoRAL: a Context-aware Croatian Abusive Language Dataset Ravi Shekhar Mladen Karan Matthew Purver 36 5 0 11 Nov 2022
The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation Barbara Plank 30 97 0 04 Nov 2022
The State of Profanity Obfuscation in Natural Language Processing Debora Nozza Dirk Hovy 34 7 0 14 Oct 2022
Understanding Interpersonal Conflict Types and their Impact on Perception Classification Charles F Welch Joan Plepi Béla Neuendorf Lucie Flek 17 6 0 18 Aug 2022
"Stop Asian Hate!" : Refining Detection of Anti-Asian Hate Speech During the COVID-19 Pandemic H. Nghiem Fred Morstatter 25 8 0 04 Dec 2021
Automatic Evaluation and Moderation of Open-domain Dialogue Systems Chen Zhang João Sedoc L. F. D’Haro Rafael E. Banchs Alexander I. Rudnicky 20 36 0 03 Nov 2021