AAVENUE: Detecting LLM Biases on NLU Tasks in AAVE via a Novel Benchmark

AAVENUE: Detecting LLM Biases on NLU Tasks in AAVE via a Novel Benchmark

27 August 2024

Sean O'Brien

Kevin Zhu

ArXiv (abs)PDF HTML

Papers citing "AAVENUE: Detecting LLM Biases on NLU Tasks in AAVE via a Novel Benchmark"

4 / 4 papers shown

Title
Trans-EnV: A Framework for Evaluating the Linguistic Robustness of LLMs Against English Varieties Jiyoung Lee Seungho Kim Jieun Han Jun-Min Lee Kitaek Kim Alice Oh E. Choi 40 0 0 27 May 2025
NovelHopQA: Diagnosing Multi-Hop Reasoning Failures in Long Narrative Contexts Abhay Gupta Michael Lu Kevin Zhu Sean O'Brien Vasu Sharma LRM 9 0 0 20 May 2025
From Large to Super-Tiny: End-to-End Optimization for Cost-Efficient LLMs Jiliang Ni Jiachen Pu Zhongyi Yang Kun Zhou Hui Wang Xiaoliang Xiao Dakui Wang Xin Li Jingfeng Luo Conggang Hu 127 0 0 18 Apr 2025
Assessing Dialect Fairness and Robustness of Large Language Models in Reasoning Tasks Fangru Lin Shaoguang Mao Emanuele La Malfa Valentin Hofmann Adrian de Wynter Jing Yao Si-Qing Chen Michael Wooldridge J. Pierrehumbert Furu Wei 161 3 0 14 Oct 2024