Spot The Bot: A Robust and Efficient Framework for the Evaluation of
Conversational Dialogue Systems

Spot The Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systems

5 October 2020

Pius von Daniken

Jon Ander Campos

Álvaro Rodrigo

Thiziri Belkacem

Aitor Soroa Etxabe

Papers citing "Spot The Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systems"

12 / 12 papers shown

Title
DiverseDialogue: A Methodology for Designing Chatbots with Human-Like Diversity Xiaoyu Lin Xinkai Yu Ankit Aich Salvatore Giorgi Lyle Ungar ALM 42 0 0 30 Aug 2024
Psychological Metrics for Dialog System Evaluation Salvatore Giorgi Shreya Havaldar Farhan S. Ahmed Zuhaib Akhtar Shalaka Vaidya Gary Pan Pallavi V. Kulkarni H. A. Schwartz Joao Sedoc 22 2 0 24 May 2023
Evaluating Human-Language Model Interaction Mina Lee Megha Srivastava Amelia Hardy John Thickstun Esin Durmus ... Hancheng Cao Tony Lee Rishi Bommasani Michael S. Bernstein Percy Liang LM&MA ALM 58 99 0 19 Dec 2022
Bipartite-play Dialogue Collection for Practical Automatic Evaluation of Dialogue Systems Shiki Sato Yosuke Kishinami Hiroaki Sugiyama Reina Akama Ryoko Tokuhisa Jun Suzuki 21 2 0 19 Nov 2022
State-of-the-art in Open-domain Conversational AI: A Survey Tosin P. Adewumi F. Liwicki Marcus Liwicki 29 15 0 02 May 2022
Better than Average: Paired Evaluation of NLP Systems Maxime Peyrard Wei-Ye Zhao Steffen Eger Robert West ELM 13 24 0 20 Oct 2021
Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling Emily Dinan Gavin Abercrombie A. S. Bergman Shannon L. Spruit Dirk Hovy Y-Lan Boureau Verena Rieser 43 105 0 07 Jul 2021
A Comprehensive Assessment of Dialog Evaluation Metrics Yi-Ting Yeh M. Eskénazi Shikib Mehri 36 104 0 07 Jun 2021
DynaEval: Unifying Turn and Dialogue Level Evaluation Chen Zhang Yiming Chen L. F. D’Haro Yan Zhang Thomas Friedrichs Grandee Lee Haizhou Li 24 73 0 02 Jun 2021
Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Survey Jinjie Ni Tom Young Vlad Pandelea Fuzhao Xue Min Zhang 54 268 0 10 May 2021
Towards Automated Psychotherapy via Language Modeling Houjun Liu AI4MH 58 3 0 05 Apr 2021
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,925 0 17 Aug 2015