Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses

23 August 2017

Ryan J. Lowe

Michael Noseworthy

Iulian Serban

Nicolas Angelard-Gontier

Yoshua Bengio

Joelle Pineau

ArXiv PDF HTML

Papers citing "Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses"

29 / 79 papers shown

Title
Towards a Human-like Open-Domain Chatbot Daniel De Freitas Minh-Thang Luong David R. So Jamie Hall Noah Fiedel ... Zi Yang Apoorv Kulshreshtha Gaurav Nemade Yifeng Lu Quoc V. Le 42 924 0 27 Jan 2020
Counterfactual Story Reasoning and Generation Lianhui Qin Antoine Bosselut Ari Holtzman Chandra Bhagavatula Elizabeth Clark Yejin Choi LRM 21 140 0 09 Sep 2019
ACUTE-EVAL: Improved Dialogue Evaluation with Optimized Questions and Multi-turn Comparisons Margaret Li Jason Weston Stephen Roller 31 175 0 06 Sep 2019
Deep Learning Based Chatbot Models Richard Csaky 29 46 0 23 Aug 2019
A Multi-Turn Emotionally Engaging Dialog Model Yubo Xie Ekaterina Svikhnushina P. Pu 13 15 0 15 Aug 2019
Approximating Interactive Human Evaluation with Self-Play for Open-Domain Dialog Systems Asma Ghandeharioun J. Shen Natasha Jaques Craig Ferguson Noah J. Jones Àgata Lapedriza Rosalind W. Picard 12 91 0 21 Jun 2019
A Survey of Natural Language Generation Techniques with a Focus on Dialogue Systems - Past, Present and Future Directions Sashank Santhanam Samira Shaikh 3DV 25 52 0 02 Jun 2019
Towards Coherent and Engaging Spoken Dialog Response Generation Using Automatic Conversation Evaluators Sanghyun Yi Rahul Goel Chandra Khatri Alessandra Cervone Tagyoung Chung Behnam Hedayatnia Anu Venkatesh Raefer Gabriel Dilek Z. Hakkani-Tür 20 60 0 30 Apr 2019
Re-evaluating ADEM: A Deeper Look at Scoring Dialogue Responses Ananya B. Sai Mithun Das Gupta Mitesh M. Khapra Mukundhan Srinivasan 27 48 0 23 Feb 2019
What makes a good conversation? How controllable attributes affect human judgments A. See Stephen Roller Douwe Kiela Jason Weston 28 286 0 22 Feb 2019
Beyond Turing: Intelligent Agents Centered on the User M. Eskénazi Shikib Mehri E. Razumovskaia Tiancheng Zhao LLMAG 29 12 0 20 Jan 2019
Judge the Judges: A Large-Scale Evaluation Study of Neural Language Models for Online Review Generation Cristina Garbacea Samuel Carton Shiyan Yan Qiaozhu Mei ELM 25 29 0 02 Jan 2019
Augmenting Neural Response Generation with Context-Aware Topical Attention Nouha Dziri Ehsan Kamalloo K. Mathewson Osmar Zaiane BDL 6 80 0 02 Nov 2018
Neural Approaches to Conversational AI Jianfeng Gao Michel Galley Lihong Li 46 669 0 21 Sep 2018
Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints Ashutosh Baheti Alan Ritter Jiwei Li W. Dolan 23 90 0 04 Sep 2018
The price of debiasing automatic metrics in natural language evaluation Arun Tejasvi Chaganty Stephen Mussmann Percy Liang 16 113 0 06 Jul 2018
Learning to Evaluate Image Captioning Huayu Chen Guandao Yang Andreas Veit Xun Huang Serge J. Belongie 35 147 0 17 Jun 2018
Discourse-Aware Neural Rewards for Coherent Text Generation Antoine Bosselut Asli Celikyilmaz Xiaodong He Jianfeng Gao Po-Sen Huang Yejin Choi 23 79 0 10 May 2018
Automatic Article Commenting: the Task and Dataset Lianhui Qin Lemao Liu Victoria Bi Yan Wang Xiaojiang Liu Zhiting Hu Zhao Hai Shuming Shi 25 26 0 09 May 2018
No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling Xin Eric Wang Wenhu Chen Yuan-fang Wang William Yang Wang 16 157 0 24 Apr 2018
RankME: Reliable Human Ratings for Natural Language Generation Jekaterina Novikova Ondrej Dusek Verena Rieser ALM 27 108 0 15 Mar 2018
A Survey on Dialogue Systems: Recent Advances and New Frontiers Hongshen Chen Xiaorui Liu Dawei Yin Jiliang Tang VLM LLMAG 38 695 0 06 Nov 2017
Referenceless Quality Estimation for Natural Language Generation Ondrej Dusek Jekaterina Novikova Verena Rieser 28 29 0 05 Aug 2017
Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generation Shikhar Sharma Layla El Asri Hannes Schulz Jeremie Zumer 26 220 0 29 Jun 2017
Data Distillation for Controlling Specificity in Dialogue Generation Jiwei Li Will Monroe Dan Jurafsky 23 22 0 22 Feb 2017
Adversarial Evaluation of Dialogue Models Anjuli Kannan Oriol Vinyals AAML ALM 141 76 0 27 Jan 2017
Adversarial Learning for Neural Dialogue Generation Jiwei Li Will Monroe Tianlin Shi Sébastien Jean Alan Ritter Dan Jurafsky 21 897 0 23 Jan 2017
RUBER: An Unsupervised Method for Automatic Evaluation of Open-Domain Dialog Systems Chongyang Tao Lili Mou Dongyan Zhao Rui Yan 20 217 0 11 Jan 2017
Deep Reinforcement Learning for Dialogue Generation Jiwei Li Will Monroe Alan Ritter Michel Galley Jianfeng Gao Dan Jurafsky 220 1,328 0 05 Jun 2016