Trustworthy Social Bias Measurement

20 December 2022

Papers citing "Trustworthy Social Bias Measurement"

26 / 26 papers shown

Title
Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization? Rishi Bommasani Kathleen A. Creel Ananya Kumar Dan Jurafsky Percy Liang 45 82 0 25 Nov 2022
Assessing the Reliability of Word Embedding Gender Bias Measures Yupei Du Qixiang Fang D. Nguyen 57 21 0 10 Sep 2021
On Measures of Biases and Harms in NLP Sunipa Dev Emily Sheng Jieyu Zhao Aubrie Amstutz Jiao Sun ... M. Sanseverino Jiin Kim Akihiro Nishi Nanyun Peng Kai-Wei Chang 45 83 0 07 Aug 2021
Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metrics Paula Czarnowska Yogarshi Vyas Kashif Shah 42 105 0 28 Jun 2021
How Reliable are Model Diagnostics? V. Aribandi Yi Tay Donald Metzler 87 19 0 12 May 2021
Addressing "Documentation Debt" in Machine Learning Research: A Retrospective Datasheet for BookCorpus Jack Bandy Nicholas Vincent 46 57 0 11 May 2021
Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus Jesse Dodge Maarten Sap Ana Marasović William Agnew Gabriel Ilharco Dirk Groeneveld Margaret Mitchell Matt Gardner AILaw 65 437 0 18 Apr 2021
CLIPScore: A Reference-free Evaluation Metric for Image Captioning Jack Hessel Ari Holtzman Maxwell Forbes Ronan Le Bras Yejin Choi CLIP 82 1,512 0 18 Apr 2021
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets Julia Kreutzer Isaac Caswell Lisa Wang Ahsan Wahab D. Esch ... Duygu Ataman Orevaoghene Ahia Oghenefego Ahia Sweta Agrawal Mofetoluwa Adeyemi 37 276 0 22 Mar 2021
Probing Classifiers: Promises, Shortcomings, and Advances Yonatan Belinkov 236 427 0 24 Feb 2021
Pareto Probing: Trading Off Accuracy for Complexity Tiago Pimentel Naomi Saphra Adina Williams Ryan Cotterell 46 60 0 05 Oct 2020
From Optimizing Engagement to Measuring Value S. Milli Luca Belli Moritz Hardt 16 47 0 21 Aug 2020
Nurse is Closer to Woman than Surgeon? Mitigating Gender-Biased Proximities in Word Embeddings Vaibhav Kumar Tenzin Singhay Bhotia Vaibhav Kumar Tanmoy Chakraborty CVBM 59 46 0 02 Jun 2020
Language (Technology) is Power: A Critical Survey of "Bias" in NLP Su Lin Blodgett Solon Barocas Hal Daumé Hanna M. Wallach 92 1,211 0 28 May 2020
Beyond Accuracy: Behavioral Testing of NLP models with CheckList Marco Tulio Ribeiro Tongshuang Wu Carlos Guestrin Sameer Singh ELM 129 1,089 0 08 May 2020
Unsupervised Discovery of Implicit Gender Bias Anjalie Field Yulia Tsvetkov 45 49 0 17 Apr 2020
Measurement and Fairness Abigail Z. Jacobs Hanna M. Wallach 63 383 0 11 Dec 2019
Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview Deven Santosh Shah H. Andrew Schwartz Dirk Hovy AI4CE 74 258 0 09 Nov 2019
Toward Gender-Inclusive Coreference Resolution Yang Trista Cao Hal Daumé 51 143 0 30 Oct 2019
Fair is Better than Sensational:Man is to Doctor as Woman is to Doctor Malvina Nissim Rik van Noord Rob van der Goot FaML 45 103 0 23 May 2019
Correlation Coefficients and Semantic Textual Similarity V. Zhelezniak Aleksandar Savkov April Shen Nils Y. Hammerla 44 50 0 19 May 2019
Identifying and Reducing Gender Bias in Word-Level Language Models Shikha Bordia Samuel R. Bowman FaML 88 325 0 05 Apr 2019
Assessing Gender Bias in Machine Translation -- A Case Study with Google Translate Marcelo O. R. Prates Pedro H. C. Avelar Luís C. Lamb 50 345 0 06 Sep 2018
Datasheets for Datasets Timnit Gebru Jamie Morgenstern Briana Vecchione Jennifer Wortman Vaughan Hanna M. Wallach Hal Daumé Kate Crawford 217 2,158 0 23 Mar 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 111 11,520 0 15 Feb 2018
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 300 33,445 0 16 Oct 2013