Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models

1 October 2021

Papers citing "Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models"

38 / 38 papers shown

Title
On the Mutual Influence of Gender and Occupation in LLM Representations Haozhe An Connor Baumler Abhilasha Sancheti Rachel Rudinger AI4CE 55 1 0 09 Mar 2025
Presumed Cultural Identity: How Names Shape LLM Responses Siddhesh Pawar Arnav Arora Lucie-Aimée Kaffee Isabelle Augenstein 58 0 0 17 Feb 2025
Intrinsic Bias is Predicted by Pretraining Data and Correlates with Downstream Performance in Vision-Language Encoders Kshitish Ghate Isaac Slaughter Kyra Wilson Mona Diab Aylin Caliskan 86 1 0 11 Feb 2025
On the Influence of Gender and Race in Romantic Relationship Prediction from Large Language Models Abhilasha Sancheti Haozhe An Rachel Rudinger 39 0 0 05 Oct 2024
Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrieval Kyra Wilson Aylin Caliskan 47 17 0 29 Jul 2024
Do Large Language Models Discriminate in Hiring Decisions on the Basis of Race, Ethnicity, and Gender? Haozhe An Christabel Acquaye Colin Wang Zongxia Li Rachel Rudinger 36 12 0 15 Jun 2024
Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLP Vagrant Gautam Arjun Subramonian Anne Lauscher O. Keyes 40 6 0 27 May 2024
Unifying Bias and Unfairness in Information Retrieval: A Survey of Challenges and Opportunities with Large Language Models Sunhao Dai Chen Xu Shicheng Xu Liang Pang Zhenhua Dong Jun Xu 48 63 0 17 Apr 2024
Reducing Selection Bias in Large Language Models Jonathan E. Eicher Rafael F. Irgoliˇc 24 0 0 29 Jan 2024
General Phrase Debiaser: Debiasing Masked Language Models at a Multi-Token Level Bingkang Shi Xiaodan Zhang Dehan Kong Yulei Wu Zongzhen Liu Honglei Lyu Longtao Huang AI4CE 30 2 0 23 Nov 2023
Bias A-head? Analyzing Bias in Transformer-Based Language Model Attention Heads Yi Yang Hanyu Duan Ahmed Abbasi John P. Lalor Kar Yan Tam 19 6 0 17 Nov 2023
Explore Spurious Correlations at the Concept Level in Language Models for Text Classification Yuhang Zhou Paiheng Xu Xiaoyu Liu Bang An Wei Ai Furong Huang LRM 71 20 0 15 Nov 2023
Evaluating Biased Attitude Associations of Language Models in an Intersectional Context Shiva Omrani Sabbaghi Robert Wolfe Aylin Caliskan 26 22 0 07 Jul 2023
Gender Bias in Transformer Models: A comprehensive survey Praneeth Nemani Yericherla Deepak Joel Pallavi Vijay Farhana Ferdousi Liza 24 3 0 18 Jun 2023
Sociodemographic Bias in Language Models: A Survey and Forward Path Vipul Gupta Pranav Narayanan Venkit Shomir Wilson R. Passonneau 44 21 0 13 Jun 2023
Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Tasks Katelyn Mei Sonia Fereidooni Aylin Caliskan 22 45 0 08 Jun 2023
Examining the Causal Effect of First Names on Language Models: The Case of Social Commonsense Reasoning Sullam Jeoung Jana Diesner H. Kilicoglu LRM 16 5 0 01 Jun 2023
Nichelle and Nancy: The Influence of Demographic Attributes and Tokenization Length on First Name Biases Haozhe An Rachel Rudinger 24 9 0 26 May 2023
Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models Orevaoghene Ahia Sachin Kumar Hila Gonen Jungo Kasai David R. Mortensen Noah A. Smith Yulia Tsvetkov 51 82 0 23 May 2023
Token-Level Fitting Issues of Seq2seq Models Guangsheng Bao Zhiyang Teng Yue Zhang 24 0 0 08 May 2023
Counter-GAP: Counterfactual Bias Evaluation through Gendered Ambiguous Pronouns Zhongbin Xie Vid Kocijan Thomas Lukasiewicz Oana-Maria Camburu 10 2 0 11 Feb 2023
Undesirable Biases in NLP: Addressing Challenges of Measurement Oskar van der Wal Dominik Bachmann Alina Leidinger L. Maanen Willem H. Zuidema K. Schulz 25 6 0 24 Nov 2022
No Word Embedding Model Is Perfect: Evaluating the Representation Accuracy for Social Bias in the Media Maximilian Spliethover Maximilian Keiff Henning Wachsmuth 26 4 0 07 Nov 2022
Discovering Differences in the Representation of People using Contextualized Semantic Axes L. Lucy Divya Tadimeti David Bamman 38 11 0 21 Oct 2022
SODAPOP: Open-Ended Discovery of Social Biases in Social Commonsense Reasoning Models Haozhe An Zongxia Li Jieyu Zhao Rachel Rudinger 30 25 0 13 Oct 2022
American == White in Multimodal Language-and-Image AI Robert Wolfe Aylin Caliskan VLM 29 46 0 01 Jul 2022
Gender Bias in Word Embeddings: A Comprehensive Analysis of Frequency, Syntax, and Semantics Aylin Caliskan Pimparkar Parth Ajay Tessa E. S. Charlesworth Robert Wolfe M. Banaji CVBM FaML 35 50 0 07 Jun 2022
Markedness in Visual Semantic AI Robert Wolfe Aylin Caliskan VLM 30 35 0 23 May 2022
Evidence for Hypodescent in Visual Semantic AI Robert Wolfe M. Banaji Aylin Caliskan VLM 30 36 0 22 May 2022
Richer Countries and Richer Representations Kaitlyn Zhou Kawin Ethayarajh Dan Jurafsky 46 9 0 10 May 2022
ExSum: From Local Explanations to Model Understanding Yilun Zhou Marco Tulio Ribeiro J. Shah FAtt LRM 19 25 0 30 Apr 2022
Towards an Enhanced Understanding of Bias in Pre-trained Neural Language Models: A Survey with Special Emphasis on Affective Bias Anoop Kadan Manjary P.Gangan Deepak P L. LajishV. AI4CE 40 10 0 21 Apr 2022
Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representations Robert Wolfe Aylin Caliskan VLM 21 13 0 14 Mar 2022
VAST: The Valence-Assessing Semantics Test for Contextualizing Language Models Robert Wolfe Aylin Caliskan 26 12 0 14 Mar 2022
Regional Negative Bias in Word Embeddings Predicts Racial Animus--but only via Name Frequency Austin Van Loon Salvatore Giorgi Robb Willer J. Eichstaedt 42 10 0 20 Jan 2022
CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters Hicham El Boukkouri Olivier Ferret Thomas Lavergne Hiroshi Noji Pierre Zweigenbaum Junichi Tsujii 77 156 0 20 Oct 2020
Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigation Tianlu Wang Xi Lin Nazneen Rajani Bryan McCann Vicente Ordonez Caimng Xiong CVBM 157 54 0 03 May 2020
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 207 181 0 03 Sep 2019