Your fairness may vary: Pretrained language model fairness in toxic text classification

3 August 2021

Ioana Baldini

Dennis L. Wei

Karthikeyan N. Ramamurthy

Mikhail Yurochkin

Moninder Singh

ArXiv PDF HTML

Papers citing "Your fairness may vary: Pretrained language model fairness in toxic text classification"

23 / 23 papers shown

Title
Threats, Attacks, and Defenses in Machine Unlearning: A Survey Ziyao Liu Huanyi Ye Chen Chen Yongsen Zheng K. Lam AAML MU 82 31 0 20 Mar 2024
Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metrics Paula Czarnowska Yogarshi Vyas Kashif Shah 54 107 0 28 Jun 2021
Process for Adapting Language Models to Society (PALMS) with Values-Targeted Datasets Irene Solaiman Christy Dennison 82 224 0 18 Jun 2021
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 331 665 0 21 Apr 2021
HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection Binny Mathew Punyajoy Saha Seid Muhie Yimam Chris Biemann Pawan Goyal Animesh Mukherjee 112 570 0 18 Dec 2020
Mapping the Space of Chemical Reactions Using Attention-Based Neural Networks P. Schwaller Daniel Probst Alain C. Vaucher Vishnu H. Nair D. Kreutter Teodoro Laino J. Reymond 175 229 0 09 Dec 2020
Underspecification Presents Challenges for Credibility in Modern Machine Learning Alexander DÁmour Katherine A. Heller D. Moldovan Ben Adlam B. Alipanahi ... Kellie Webster Steve Yadlowsky T. Yun Xiaohua Zhai D. Sculley OffRL 107 685 0 06 Nov 2020
Measuring and Reducing Gendered Correlations in Pre-trained Models Kellie Webster Xuezhi Wang Ian Tenney Alex Beutel Emily Pitler Ellie Pavlick Jilin Chen Ed Chi Slav Petrov FaML 72 258 0 12 Oct 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 129 2,724 0 05 Jun 2020
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing Zihang Dai Guokun Lai Yiming Yang Quoc V. Le 76 233 0 05 Jun 2020
Language (Technology) is Power: A Critical Survey of "Bias" in NLP Su Lin Blodgett Solon Barocas Hal Daumé Hanna M. Wallach 152 1,234 0 28 May 2020
BERTweet: A pre-trained language model for English Tweets Dat Quoc Nguyen Thanh Tien Vu A. Nguyen VLM 73 914 0 20 May 2020
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices Zhiqing Sun Hongkun Yu Xiaodan Song Renjie Liu Yiming Yang Denny Zhou MQ 99 811 0 06 Apr 2020
Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping Jesse Dodge Gabriel Ilharco Roy Schwartz Ali Farhadi Hannaneh Hajishirzi Noah A. Smith 93 595 0 15 Feb 2020
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 192 7,465 0 02 Oct 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 316 6,441 0 26 Sep 2019
Mitigating Gender Bias in Natural Language Processing: Literature Review Tony Sun Andrew Gaut Shirlyn Tang Yuxin Huang Mai Elsherief Jieyu Zhao Diba Mirza E. Belding-Royer Kai-Wei Chang William Yang Wang AI4CE 105 555 0 21 Jun 2019
Leveraging Labeled and Unlabeled Data for Consistent Fair Binary Classification Evgenii Chzhen Christophe Denis Mohamed Hebiri L. Oneto Massimiliano Pontil FaML 155 85 0 12 Jun 2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems Alex Jinpeng Wang Yada Pruksachatkun Nikita Nangia Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 228 2,305 0 02 May 2019
Inferring Which Medical Treatments Work from Reports of Clinical Trials Eric P. Lehman Jay DeYoung Regina Barzilay Byron C. Wallace 75 116 0 02 Apr 2019
The Frontiers of Fairness in Machine Learning Alexandra Chouldechova Aaron Roth FaML 160 415 0 20 Oct 2018
Know What You Don't Know: Unanswerable Questions for SQuAD Pranav Rajpurkar Robin Jia Percy Liang RALM ELM 243 2,835 0 11 Jun 2018
Equality of Opportunity in Supervised Learning Moritz Hardt Eric Price Nathan Srebro FaML 192 4,301 0 07 Oct 2016