Annotation Sensitivity: Training Data Collection Methods Affect Model Performance

23 November 2023

Papers citing "Annotation Sensitivity: Training Data Collection Methods Affect Model Performance"

5 / 5 papers shown

Title
Ground-Truth, Whose Truth? -- Examining the Challenges with Annotating Toxic Text Datasets Kofi Arhin Ioana Baldini Dennis L. Wei Karthikeyan N. Ramamurthy Moninder Singh 52 19 0 07 Dec 2021
Detecting East Asian Prejudice on Social Media Bertie Vidgen Austin Botelho David A. Broniatowski E. Guest Matthew Hall Helen Z. Margetts Rebekah Tromble Zeerak Talat Scott A. Hale 31 99 0 08 May 2020
Confident Learning: Estimating Uncertainty in Dataset Labels Curtis G. Northcutt Lu Jiang Isaac L. Chuang NoLa 116 691 0 31 Oct 2019
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets Mor Geva Yoav Goldberg Jonathan Berant 320 325 0 21 Aug 2019
Do ImageNet Classifiers Generalize to ImageNet? Benjamin Recht Rebecca Roelofs Ludwig Schmidt Vaishaal Shankar OOD SSeg VLM 109 1,714 0 13 Feb 2019