Predictive Engagement: An Efficient Metric For Automatic Evaluation of Open-Domain Dialogue Systems

4 November 2019

Papers citing "Predictive Engagement: An Efficient Metric For Automatic Evaluation of Open-Domain Dialogue Systems"

20 / 20 papers shown

Title
Development and Validation of Engagement and Rapport Scales for Evaluating User Experience in Multimodal Dialogue Systems Fuma Kurata Mao Saeki Masaki Eguchi Shungo Suzuki Hiroaki Takatsu Yoichi Matsuyama 31 3 0 20 May 2025
BoK: Introducing Bag-of-Keywords Loss for Interpretable Dialogue Response Generation Suvodip Dey M. Desarkar OffRL 64 0 0 20 Jan 2025
Approximating Interactive Human Evaluation with Self-Play for Open-Domain Dialog Systems Asma Ghandeharioun J. Shen Natasha Jaques Craig Ferguson Noah J. Jones Àgata Lapedriza Rosalind W. Picard 49 91 0 21 Jun 2019
Towards Coherent and Engaging Spoken Dialog Response Generation Using Automatic Conversation Evaluators Sanghyun Yi Rahul Goel Chandra Khatri Alessandra Cervone Tagyoung Chung Behnam Hedayatnia Anu Venkatesh Raefer Gabriel Dilek Z. Hakkani-Tür 35 60 0 30 Apr 2019
Better Automatic Evaluation of Open-Domain Dialogue Systems with Contextualized Embeddings Sarik Ghazarian Johnny Tian-Zheng Wei Aram Galstyan Nanyun Peng 39 90 0 24 Apr 2019
Unifying Human and Statistical Evaluation for Natural Language Generation Tatsunori B. Hashimoto Hugh Zhang Percy Liang 52 223 0 04 Apr 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 99 728 0 21 Mar 2019
What makes a good conversation? How controllable attributes affect human judgments A. See Stephen Roller Douwe Kiela Jason Weston 89 287 0 22 Feb 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.3K 93,936 0 11 Oct 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 147 11,520 0 15 Feb 2018
Personalizing Dialogue Agents: I have a dog, do you have pets too? Saizheng Zhang Emily Dinan Jack Urbanek Arthur Szlam Douwe Kiela Jason Weston 85 1,442 0 22 Jan 2018
Topic-based Evaluation for Conversational Bots Fenfei Guo A. Metallinou Chandra Khatri A. Raju Anu Venkatesh A. Ram 58 52 0 11 Jan 2018
Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses Ryan J. Lowe Michael Noseworthy Iulian Serban Nicolas Angelard-Gontier Yoshua Bengio Joelle Pineau 51 372 0 23 Aug 2017
Why We Need New Evaluation Metrics for NLG Jekaterina Novikova Ondrej Dusek Amanda Cercas Curry Verena Rieser 69 456 0 21 Jul 2017
Adversarial Evaluation of Dialogue Models Anjuli Kannan Oriol Vinyals AAML ALM 155 76 0 27 Jan 2017
Adversarial Learning for Neural Dialogue Generation Jiwei Li Will Monroe Tianlin Shi Sébastien Jean Alan Ritter Dan Jurafsky 46 898 0 23 Jan 2017
RUBER: An Unsupervised Method for Automatic Evaluation of Open-Domain Dialog Systems Chongyang Tao Lili Mou Dongyan Zhao Rui Yan 55 217 0 11 Jan 2017
Learning End-to-End Goal-Oriented Dialog Antoine Bordes Y-Lan Boureau Jason Weston 74 781 0 24 May 2016
How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation Chia-Wei Liu Ryan J. Lowe Iulian Serban Michael Noseworthy Laurent Charlin Joelle Pineau 94 1,292 0 25 Mar 2016
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 595 31,406 0 16 Jan 2013