Let Guidelines Guide You: A Prescriptive Guideline-Centered Data
Annotation Methodology

Let Guidelines Guide You: A Prescriptive Guideline-Centered Data Annotation Methodology

20 June 2024

Federico Ruggeri

Eleonora Misino

Paolo Torroni

Alberto Barrón-Cedeño

Papers citing "Let Guidelines Guide You: A Prescriptive Guideline-Centered Data Annotation Methodology"

10 / 10 papers shown

Title
To Believe or Not to Believe Your LLM Yasin Abbasi-Yadkori Ilja Kuzborskij András György Csaba Szepesvári UQCV 83 51 0 04 Jun 2024
Analyzing Dataset Annotation Quality Management in the Wild Jan-Christoph Klie Richard Eckart de Castilho Iryna Gurevych 50 21 0 16 Jul 2023
When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Tasks Eve Fleisig Rediet Abebe Dan Klein 49 46 0 11 May 2023
AnnoBERT: Effectively Representing Multiple Annotators' Label Choices to Improve Hate Speech Detection Wenjie Yin Vibhor Agarwal Aiqi Jiang A. Zubiaga Nishanth R. Sastry 72 13 0 20 Dec 2022
Needle in a Haystack: An Analysis of High-Agreement Workers on MTurk for Summarization Lining Zhang Simon Mille Yufang Hou Daniel Deutsch Elizabeth Clark ... Saad Mahamood Sebastian Gehrmann Miruna Clinciu Khyathi Chandu João Sedoc 20 10 0 20 Dec 2022
Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AI Mahima Pushkarna Andrew Zaldivar Oddur Kjartansson AI4TS 64 209 0 03 Apr 2022
Stance Detection on Social Media: State of the Art and Trends Abeer Aldayel Walid Magdy 31 267 0 05 Jun 2020
Shortcut Learning in Deep Neural Networks Robert Geirhos J. Jacobsen Claudio Michaelis R. Zemel Wieland Brendel Matthias Bethge Felix Wichmann 184 2,023 0 16 Apr 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 265 42,038 0 03 Dec 2019
Datasheets for Datasets Timnit Gebru Jamie Morgenstern Briana Vecchione Jennifer Wortman Vaughan Hanna M. Wallach Hal Daumé Kate Crawford 214 2,158 0 23 Mar 2018