Sociodemographic Bias in Language Models: A Survey and Forward Path

13 June 2023

Vipul Gupta

Pranav Narayanan Venkit

Shomir Wilson

R. Passonneau

ArXiv PDF HTML

Papers citing "Sociodemographic Bias in Language Models: A Survey and Forward Path"

21 / 21 papers shown

Title
A Tale of Two Identities: An Ethical Audit of Human and AI-Crafted Personas Pranav Narayanan Venkit Jiayi Li Yingfan Zhou Sarah Rajtmajer Shomir Wilson 34 0 0 07 May 2025
Can LLMs Rank the Harmfulness of Smaller LLMs? We are Not There Yet Berk Atil Vipul Gupta Sarkar Snigdha Sarathi Das R. Passonneau 243 0 0 07 Feb 2025
Beemo: Benchmark of Expert-edited Machine-generated Outputs Ekaterina Artemova Jason Samuel Lucas Saranya Venkatraman Jooyoung Lee Sergei Tilga Adaku Uchendu Vladislav Mikhailov DeLMO MoE 71 6 0 06 Nov 2024
A Predictive Factor Analysis of Social Biases and Task-Performance in Pretrained Masked Language Models Yi Zhou Jose Camacho-Collados Danushka Bollegala 86 6 0 19 Oct 2023
Semantic Consistency for Assuring Reliability of Large Language Models Harsh Raj Vipul Gupta Domenic Rosati S. Majumdar HILM 110 14 0 17 Aug 2023
How Far Can It Go?: On Intrinsic Gender Bias Mitigation for Text Classification E. Tokpo Pieter Delobelle Bettina Berendt T. Calders 46 7 0 30 Jan 2023
Debiasing Masks: A New Framework for Shortcut Mitigation in NLU Johannes Mario Meissner Saku Sugawara Akiko Aizawa AAML 44 16 0 28 Oct 2022
Quantifying Social Biases Using Templates is Unreliable P. Seshadri Pouya Pezeshkpour Sameer Singh 51 33 0 09 Oct 2022
"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Dataset Eric Michael Smith Melissa Hall Melanie Kambadur Eleonora Presani Adina Williams 83 130 0 18 May 2022
BBQ: A Hand-Built Bias Benchmark for Question Answering Alicia Parrish Angelica Chen Nikita Nangia Vishakh Padmakumar Jason Phang Jana Thompson Phu Mon Htut Sam Bowman 223 378 0 15 Oct 2021
Socially Aware Bias Measurements for Hindi Language Representations Vijit Malik Sunipa Dev A. Nishi Nanyun Peng Kai-Wei Chang 72 38 0 15 Oct 2021
Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models Robert Wolfe Aylin Caliskan 95 51 0 01 Oct 2021
Unpacking the Interdependent Systems of Discrimination: Ableist Bias in NLP Systems through an Intersectional Lens Saad Hassan Matt Huenerfauth Cecilia Ovesdotter Alm 51 38 0 01 Oct 2021
Evaluating Debiasing Techniques for Intersectional Biases Shivashankar Subramanian Xudong Han Timothy Baldwin Trevor Cohn Lea Frermann 110 48 0 21 Sep 2021
Mitigating Language-Dependent Ethnic Bias in BERT Jaimeen Ahn Alice Oh 142 92 0 13 Sep 2021
Assessing the Reliability of Word Embedding Gender Bias Measures Yupei Du Qixiang Fang D. Nguyen 49 21 0 10 Sep 2021
Debiasing Methods in Natural Language Understanding Make Bias More Accessible Michael J. Mendelson Yonatan Belinkov 45 23 0 09 Sep 2021
Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP Timo Schick Sahana Udupa Hinrich Schütze 265 373 0 28 Feb 2021
It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbations Samson Tan Shafiq Joty Min-Yen Kan R. Socher 166 103 0 09 May 2020
HypoNLI: Exploring the Artificial Patterns of Hypothesis-only Bias in Natural Language Inference Tianyu Liu Xin Zheng Baobao Chang Zhifang Sui 53 23 0 05 Mar 2020
A Survey on Bias and Fairness in Machine Learning Ninareh Mehrabi Fred Morstatter N. Saxena Kristina Lerman Aram Galstyan SyDa FaML 341 4,230 0 23 Aug 2019