If in a Crowdsourced Data Annotation Pipeline, a GPT-4

26 February 2024

Ting-Hao 'Kenneth' Huang

ArXiv PDF HTML

Papers citing "If in a Crowdsourced Data Annotation Pipeline, a GPT-4"

23 / 23 papers shown

Title
Improving User Behavior Prediction: Leveraging Annotator Metadata in Supervised Machine Learning Models Lynnette Ng Kokil Jaidka Kaiyuan Tay Hansin Ahuja Niyati Chhaya 54 0 0 26 Mar 2025
From Annotation to Adaptation: Metrics, Synthetic Data, and Aspect Extraction for Aspect-Based Sentiment Analysis with Large Language Models Nikita Neveditsin Pawan Lingras V. Mago 81 0 0 26 Mar 2025
Augmenting Image Annotation: A Human-LMM Collaborative Framework for Efficient Object Selection and Label Generation He Zhang Xinyi Fu John M. Carroll VLM 54 0 0 14 Mar 2025
Prompting in the Dark: Assessing Human Performance in Prompt Engineering for Data Labeling When Gold Labels Are Absent Zeyu He Saniya Naphade Ting-Hao 'Kenneth' Huang 38 0 0 16 Feb 2025
Can LLMs Rank the Harmfulness of Smaller LLMs? We are Not There Yet Berk Atil Vipul Gupta Sarkar Snigdha Sarathi Das R. Passonneau 178 0 0 07 Feb 2025
Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistant Gaole He Gianluca Demartini U. Gadiraju LLMAG 65 8 0 03 Feb 2025
Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Review Rock Yuren Pang Hope Schroeder Kynnedy Simone Smith Solon Barocas Ziang Xiao Emily Tseng Danielle Bragg 77 3 0 22 Jan 2025
ELITR-Bench: A Meeting Assistant Benchmark for Long-Context Language Models Thibaut Thonet Jos Rozen Laurent Besacier RALM 137 2 0 20 Jan 2025
Speech Foundation Models and Crowdsourcing for Efficient, High-Quality Data Collection Beomseok Lee Marco Gaido Ioan Calapodescu Laurent Besacier Matteo Negri 69 0 0 16 Dec 2024
Human-LLM Hybrid Text Answer Aggregation for Crowd Annotations Jiyi Li 32 1 0 22 Oct 2024
ARTICLE: Annotator Reliability Through In-Context Learning Sujan Dutta Deepak Pandita Tharindu Cyril Weerasooriya Marcos Zampieri Christopher M. Homan Ashiqur R. KhudaBukhsh 27 0 0 18 Sep 2024
Model-in-the-Loop (MILO): Accelerating Multimodal AI Data Annotation with LLMs Yifan Wang David Stevens Pranay Shah Wenwen Jiang Miao Liu ... Boying Gong Daniel Lee Jiabo Hu Ning Zhang Bob Kamma 40 1 0 16 Sep 2024
Large Language Models for Automatic Detection of Sensitive Topics Ruoyu Wen Stephanie Elena Crowe Kunal Gupta Xinyue Li Mark Billinghurst S. Hoermann Dwain Allan Alaeddin Nassani Thammathip Piumsomboon AI4MH 29 0 0 02 Sep 2024
Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs John Mendonça Isabel Trancoso A. Lavie ALM 29 1 0 20 Aug 2024
What Color Scheme is More Effective in Assisting Readers to Locate Information in a Color-Coded Article? Ho Yin Ng Zeyu He Ting-Hao 'Kenneth' Huang 23 0 0 12 Aug 2024
Can LLMs Replace Manual Annotation of Software Engineering Artifacts? Toufique Ahmed Premkumar Devanbu Christoph Treude Michael Pradel 72 11 0 10 Aug 2024
Using LLMs to Establish Implicit User Sentiment of Software Desirability Daniel Musekamp John D. Hastings Makoto Takamoto 27 2 0 02 Aug 2024
ANAH-v2: Scaling Analytical Hallucination Annotation of Large Language Models Yuzhe Gu Ziwei Ji Wenwei Zhang Chengqi Lyu Dahua Lin Kai Chen HILM 36 5 0 05 Jul 2024
Assessing Empathy in Large Language Models with Real-World Physician-Patient Interactions Man Luo Christopher J. Warren Lu Cheng Haidar M Abdul-Muhsin Imon Banerjee LM&MA AI4MH 34 10 0 26 May 2024
Generating Hard-Negative Out-of-Scope Data with ChatGPT for Intent Classification Zhijian Li Stefan Larson Kevin Leach OODD 29 1 0 08 Mar 2024
Wisdom of Instruction-Tuned Language Model Crowds. Exploring Model Label Variation Flor Miriam Plaza del Arco Debora Nozza Dirk Hovy ALM 48 6 0 24 Jul 2023
BioTABQA: Instruction Learning for Biomedical Table Question Answering Man Luo S. Saxena Swaroop Mishra Mihir Parmar Chitta Baral LMTD 157 15 0 06 Jul 2022
Learning from Crowds with Crowd-Kit Dmitry Ustalov Nikita Pavlichenko B. Tseitlin 23 19 0 17 Sep 2021