The Reasonable Effectiveness of Diverse Evaluation Data

The Reasonable Effectiveness of Diverse Evaluation Data

23 January 2023

Lora Aroyo

Christopher Homan

Vinodkumar Prabhakaran

Papers citing "The Reasonable Effectiveness of Diverse Evaluation Data"

7 / 7 papers shown

Title
Beyond Multiple-Choice Accuracy: Real-World Challenges of Implementing Large Language Models in Healthcare Yifan Yang Qiao Jin Qingqing Zhu Zhizheng Wang Francisco Erramuspe Álvarez Nicholas Wan Benjamin Hou Zhiyong Lu LM&MA ELM 37 0 0 24 Oct 2024
D3CODE: Disentangling Disagreements in Data across Cultures on Offensiveness Detection and Evaluation Aida Mostafazadeh Davani Mark Díaz Dylan K. Baker Vinodkumar Prabhakaran 34 8 0 16 Apr 2024
MaxMin-RLHF: Towards Equitable Alignment of Large Language Models with Diverse Human Preferences Souradip Chakraborty Jiahao Qiu Hui Yuan Alec Koppel Furong Huang Dinesh Manocha Amrit Singh Bedi Mengdi Wang ALM 35 47 0 14 Feb 2024
Generalized People Diversity: Learning a Human Perception-Aligned Diversity Representation for People Images Hansa Srinivasan Candice Schumann Aradhana Sinha David Madras Gbolahan O. Olanubi Alex Beutel Susanna Ricco Jilin Chen 32 5 0 25 Jan 2024
Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates Aida Mostafazadeh Davani Mark Díaz Dylan K. Baker Vinodkumar Prabhakaran AAML 31 14 0 11 Dec 2023
Scaling Laws Do Not Scale Fernando Diaz Michael A. Madaio 23 8 0 05 Jul 2023
Consensus and Subjectivity of Skin Tone Annotation for ML Fairness Candice Schumann Gbolahan O. Olanubi Auriel Wright Ellis P. Monk Courtney Heldreth Susanna Ricco 30 21 0 16 May 2023