BiasAsker: Measuring the Bias in Conversational AI System

21 May 2023

Michael Lyu

Papers citing "BiasAsker: Measuring the Bias in Conversational AI System"

29 / 29 papers shown

Title
BiasCause: Evaluate Socially Biased Causal Reasoning of Large Language Models Tian Xie Tongxin Yin Vaishakh Keshava Xueru Zhang Siddhartha Reddy Jonnalagadda ELM LRM 121 0 0 08 Apr 2025
VisBias: Measuring Explicit and Implicit Social Biases in Vision Language Models Jen-tse Huang Jiantong Qin Jianping Zhang Youliang Yuan Wenxuan Wang Jieyu Zhao VLM 103 2 0 10 Mar 2025
Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targets Tommaso Giorgi Lorenzo Cima T. Fagni Marco Avvenuti S. Cresci 160 11 0 10 Oct 2024
ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction Benchmark Hao Wu Wenxuan Wang Yuxuan Wan Wenxiang Jiao Michael Lyu ELM AI4MH 94 114 0 15 Mar 2023
Tencent's Multilingual Machine Translation System for WMT22 Large-Scale African Languages Wenxiang Jiao Zhaopeng Tu Jiarui Li Wenxuan Wang Jen-tse Huang Shuming Shi 88 15 0 18 Oct 2022
Improving Adversarial Transferability via Neuron Attribution-Based Attacks Jianping Zhang Weibin Wu Jen-tse Huang Yizhan Huang Wenxuan Wang Yuxin Su Michael R. Lyu AAML 91 136 0 31 Mar 2022
RoMe: A Robust Metric for Evaluating Natural Language Generation Md. Rony Liubov Kovriguina Debanjan Chaudhuri Ricardo Usbeck Jens Lehmann 69 12 0 17 Mar 2022
LaMDA: Language Models for Dialog Applications R. Thoppilan Daniel De Freitas Jamie Hall Noam M. Shazeer Apoorv Kulshreshtha ... Blaise Aguera-Arcas Claire Cui M. Croak Ed H. Chi Quoc Le ALM 146 1,601 0 20 Jan 2022
Bias in Machine Learning Software: Why? How? What to do? Joymallya Chakraborty Suvodeep Majumder Tim Menzies FaML 76 203 0 25 May 2021
Revealing Persona Biases in Dialogue Systems Emily Sheng Josh Arnold Zhou Yu Kai-Wei Chang Nanyun Peng 77 39 0 18 Apr 2021
Mitigating Gender Bias for Neural Dialogue Generation with Adversarial Learning Haochen Liu Wentao Wang Yiqi Wang Hui Liu Zitao Liu Jiliang Tang 62 71 0 28 Sep 2020
RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models Samuel Gehman Suchin Gururangan Maarten Sap Yejin Choi Noah A. Smith 168 1,221 0 24 Sep 2020
Recipes for building an open-domain chatbot Stephen Roller Emily Dinan Naman Goyal Da Ju Mary Williamson ... Myle Ott Kurt Shuster Eric Michael Smith Y-Lan Boureau Jason Weston ALM 125 1,014 0 28 Apr 2020
Towards a Human-like Open-Domain Chatbot Daniel De Freitas Minh-Thang Luong David R. So Jamie Hall Noah Fiedel ... Zi Yang Apoorv Kulshreshtha Gaurav Nemade Yifeng Lu Quoc V. Le 118 939 0 27 Jan 2020
Coverage Guided Testing for Recurrent Neural Networks Wei Huang Youcheng Sun Xing-E. Zhao James Sharp Wenjie Ruan Jie Meng Xiaowei Huang AAML 101 48 0 05 Nov 2019
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation Yizhe Zhang Siqi Sun Michel Galley Yen-Chun Chen Chris Brockett Xiang Gao Jianfeng Gao Jingjing Liu W. Dolan VLM 198 1,527 0 01 Nov 2019
Does Gender Matter? Towards Fairness in Dialogue Systems Haochen Liu Jamell Dacon Wenqi Fan Hui Liu Zitao Liu Jiliang Tang 140 144 0 16 Oct 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 1.3K 12,316 0 27 Aug 2019
Machine Learning Testing: Survey, Landscapes and Horizons Jie M. Zhang Mark Harman Lei Ma Yang Liu VLM AILaw 90 753 0 19 Jun 2019
BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions Christopher Clark Kenton Lee Ming-Wei Chang Tom Kwiatkowski Michael Collins Kristina Toutanova 244 1,560 0 24 May 2019
Unified Language Model Pre-training for Natural Language Understanding and Generation Li Dong Nan Yang Wenhui Wang Furu Wei Xiaodong Liu Yu Wang Jianfeng Gao M. Zhou H. Hon ELM AI4CE 230 1,560 0 08 May 2019
Identifying and Reducing Gender Bias in Word-Level Language Models Shikha Bordia Samuel R. Bowman FaML 126 329 0 05 Apr 2019
Learning to Speak and Act in a Fantasy Text Adventure Game Jack Urbanek Angela Fan Siddharth Karamcheti Saachi Jain Samuel Humeau Emily Dinan Tim Rocktaschel Douwe Kiela Arthur Szlam Jason Weston LLMAG 90 207 0 07 Mar 2019
Automated Directed Fairness Testing Sakshi Udeshi Pryanshu Arora Sudipta Chattopadhyay FaML 60 174 0 02 Jul 2018
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 319 12,151 0 19 Jun 2017
DeepXplore: Automated Whitebox Testing of Deep Learning Systems Kexin Pei Yinzhi Cao Junfeng Yang Suman Jana AAML 109 1,371 0 18 May 2017
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 316 8,177 0 16 Jun 2016
Learning End-to-End Goal-Oriented Dialog Antoine Bordes Y-Lan Boureau Jason Weston 82 782 0 24 May 2016
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 578 27,338 0 01 Sep 2014