A Taxonomy of Rater Disagreements: Surveying Challenges & Opportunities
from the Perspective of Annotating Online Toxicity

A Taxonomy of Rater Disagreements: Surveying Challenges & Opportunities from the Perspective of Annotating Online Toxicity

7 November 2023

Ian D Kivlichan

Vinodkumar Prabhakaran

ArXiv (abs)PDF HTML

Papers citing "A Taxonomy of Rater Disagreements: Surveying Challenges & Opportunities from the Perspective of Annotating Online Toxicity"

10 / 10 papers shown

Title
When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Tasks Eve Fleisig Rediet Abebe Dan Klein 58 49 0 11 May 2023
Consistency is Key: Disentangling Label Variation in Natural Language Processing with Intra-Annotator Agreement Gavin Abercrombie Verena Rieser Dirk Hovy 71 17 0 25 Jan 2023
Hate Speech and Counter Speech Detection: Conversational Context Does Matter Xinchen Yu Eduardo Blanco Lingzi Hong 74 43 0 13 Jun 2022
Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation Nitesh Goyal Ian D Kivlichan Rachel Rosen Lucy Vasserman 75 93 0 01 May 2022
A New Generation of Perspective API: Efficient Multilingual Character-level Transformers Alyssa Lees Vinh Q. Tran Yi Tay Jeffrey Scott Sorensen Jai Gupta Donald Metzler Lucy Vasserman 88 191 0 22 Feb 2022
Explaining with Examples: Lessons Learned from Crowdsourced Introductory Description of Information Visualizations Leni Yang Cindy Xiong Jason K. Wong Aoyu Wu Huamin Qu 61 22 0 23 Dec 2021
Revisiting Contextual Toxicity Detection in Conversations Atijit Anuchitanukul Julia Ive Lucia Specia 44 15 0 24 Nov 2021
Abuse is Contextual, What about NLP? The Role of Context in Abusive Language Annotation and Detection Stefano Menini Alessio Palmero Aprosio Sara Tonelli 63 40 0 27 Mar 2021
Hate Speech Detection and Racial Bias Mitigation in Social Media based on BERT model Marzieh Mozafari R. Farahbakhsh Noel Crespi 55 222 0 14 Aug 2020
Challenges for Toxic Comment Classification: An In-Depth Error Analysis Betty van Aken Julian Risch Ralf Krestel Alexander Loser 66 222 0 20 Sep 2018