How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation

25 March 2016

Papers citing "How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation"

50 / 293 papers shown

Title
Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading Lianhui Qin Michel Galley Chris Brockett Xiaodong Liu Xiang Gao W. Dolan Yejin Choi Jianfeng Gao 26 109 0 06 Jun 2019
Handling Divergent Reference Texts when Evaluating Table-to-Text Generation Bhuwan Dhingra Manaal Faruqui Ankur P. Parikh Ming-Wei Chang Dipanjan Das William W. Cohen 39 193 0 03 Jun 2019
Exploiting Persona Information for Diverse Generation of Conversational Responses Haoyu Song Weinan Zhang Yiming Cui Dong Wang Ting Liu 19 136 0 29 May 2019
Target-Guided Open-Domain Conversation Jianheng Tang Tiancheng Zhao Chenyan Xiong Xiaodan Liang Eric Xing Zhiting Hu 22 133 0 28 May 2019
Personalizing Dialogue Agents via Meta-Learning Zhaojiang Lin Andrea Madotto Chien-Sheng Wu Pascale Fung 58 180 0 24 May 2019
Recent Advances in Neural Question Generation Liangming Pan Wenqiang Lei Tat-Seng Chua Min-Yen Kan 17 116 0 22 May 2019
Towards Coherent and Engaging Spoken Dialog Response Generation Using Automatic Conversation Evaluators Sanghyun Yi Rahul Goel Chandra Khatri Alessandra Cervone Tagyoung Chung Behnam Hedayatnia Anu Venkatesh Raefer Gabriel Dilek Z. Hakkani-Tür 20 60 0 30 Apr 2019
Review-Driven Answer Generation for Product-Related Questions in E-Commerce Shiqian Chen Chenliang Li Feng Ji Wei Zhou Haiqing Chen 33 49 0 27 Apr 2019
TextKD-GAN: Text Generation using KnowledgeDistillation and Generative Adversarial Networks Md. Akmal Haidar Mehdi Rezagholizadeh 37 52 0 23 Apr 2019
Emergence of Compositional Language with Deep Generational Transmission Michael Cogswell Jiasen Lu Stefan Lee Devi Parikh Dhruv Batra 16 49 0 19 Apr 2019
Factor Graph Attention Idan Schwartz Seunghak Yu Tamir Hazan Alex Schwing 30 110 0 11 Apr 2019
Clinically Accurate Chest X-Ray Report Generation Guanxiong Liu T. Hsu Matthew B. A. McDermott Willie Boag W. Weng Peter Szolovits Marzyeh Ghassemi MedIm 39 271 0 04 Apr 2019
Improve Diverse Text Generation by Self Labeling Conditional Variational Auto Encoder Yuchi Zhang Yongliang Wang Liping Zhang Qing Cui Kun Gai 22 19 0 26 Mar 2019
Consistent Dialogue Generation with Self-supervised Feature Learning Yizhe Zhang Xiang Gao Sungjin Lee Chris Brockett Michel Galley Jianfeng Gao W. Dolan 30 28 0 13 Mar 2019
Negative Training for Neural Dialogue Response Generation Tianxing He James R. Glass 30 59 0 06 Mar 2019
Improving Neural Response Diversity with Frequency-Aware Cross-Entropy Loss Shaojie Jiang Pengjie Ren Christof Monz Maarten de Rijke 23 86 0 25 Feb 2019
Re-evaluating ADEM: A Deeper Look at Scoring Dialogue Responses Ananya B. Sai Mithun Das Gupta Mitesh M. Khapra Mukundhan Srinivasan 27 48 0 23 Feb 2019
What makes a good conversation? How controllable attributes affect human judgments A. See Stephen Roller Douwe Kiela Jason Weston 28 286 0 22 Feb 2019
The Second Conversational Intelligence Challenge (ConvAI2) Emily Dinan V. Logacheva Valentin Malykh Alexander H. Miller Kurt Shuster ... Alexander I. Rudnicky Jason Williams Joelle Pineau Andrey Kravchenko Jason Weston DRL 40 361 0 31 Jan 2019
End-to-End Knowledge-Routed Relational Dialogue System for Automatic Diagnosis Lin Xu Qixian Zhou Ke Gong Xiaodan Liang Jianheng Tang Liang Lin MedIm 24 166 0 30 Jan 2019
Audio-Visual Scene-Aware Dialog Huda AlAmri Vincent Cartillier Abhishek Das Jue Wang A. Cherian ... Tim K. Marks Chiori Hori Peter Anderson Stefan Lee Devi Parikh VGen 27 189 0 25 Jan 2019
TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents Thomas Wolf Victor Sanh Julien Chaumond Clement Delangue 40 493 0 23 Jan 2019
An Adversarial Approach to High-Quality, Sentiment-Controlled Neural Dialogue Generation X. Kong Bohan Li Graham Neubig Eduard H. Hovy Yiming Yang 25 28 0 22 Jan 2019
Beyond Turing: Intelligent Agents Centered on the User M. Eskénazi Shikib Mehri E. Razumovskaia Tiancheng Zhao LLMAG 29 12 0 20 Jan 2019
Judge the Judges: A Large-Scale Evaluation Study of Neural Language Models for Online Review Generation Cristina Garbacea Samuel Carton Shiyan Yan Qiaozhu Mei ELM 25 29 0 02 Jan 2019
From FiLM to Video: Multi-turn Question Answering with Multi-modal Context T. Nguyen Shikhar Sharma Hannes Schulz Layla El Asri 15 33 0 17 Dec 2018
Dialogue Generation: From Imitation Learning to Inverse Reinforcement Learning Ziming Li Julia Kiseleva Maarten de Rijke 25 51 0 09 Dec 2018
Zero-Shot Anticipation for Instructional Activities Fadime Sener Angela Yao LM&Ro 31 68 0 06 Dec 2018
Plan-And-Write: Towards Better Automatic Storytelling Lili Yao Nanyun Peng R. Weischedel Kevin Knight Dongyan Zhao Rui Yan 21 403 0 14 Nov 2018
Generating Multiple Diverse Responses for Short-Text Conversation Jun Gao Wei Bi Xiaojiang Liu Junhui Li Shuming Shi 33 56 0 14 Nov 2018
The RLLChatbot: a solution to the ConvAI challenge Nicolas Angelard-Gontier Koustuv Sinha Peter Henderson Iulian Serban Michael Noseworthy Prasanna Parthasarathi Joelle Pineau OffRL 33 0 0 07 Nov 2018
Augmenting Neural Response Generation with Context-Aware Topical Attention Nouha Dziri Ehsan Kamalloo K. Mathewson Osmar Zaiane BDL 14 80 0 02 Nov 2018
Importance of Search and Evaluation Strategies in Neural Dialogue Modeling Ilia Kulikov Alexander H. Miller Kyunghyun Cho Jason Weston 32 83 0 02 Nov 2018
Towards Empathetic Open-domain Conversation Models: a New Benchmark and Dataset Hannah Rashkin Eric Michael Smith Margaret Li Y-Lan Boureau VLM 17 48 0 01 Nov 2018
Engaging Image Captioning Via Personality Kurt Shuster Samuel Humeau Hexiang Hu Antoine Bordes Jason Weston 40 149 0 25 Oct 2018
Automatic Evaluation of Neural Personality-based Chatbots Yujie Xing Raquel Fernández 16 14 0 30 Sep 2018
MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modelling Paweł Budzianowski Tsung-Hsien Wen Bo-Hsiang Tseng I. Casanueva Stefan Ultes Osman Ramadan Milica Gasic 39 1,300 0 29 Sep 2018
Sentence-Level Fluency Evaluation: References Help, But Can Be Spared! Katharina Kann S. Rothe Katja Filippova 22 71 0 24 Sep 2018
Neural Approaches to Conversational AI Jianfeng Gao Michel Galley Lihong Li 49 670 0 21 Sep 2018
Can Neural Generators for Dialogue Learn Sentence Planning and Discourse Structuring? Lena Reed Shereen Oraby M. Walker 14 37 0 09 Sep 2018
Adversarial Over-Sensitivity and Over-Stability Strategies for Dialogue Models Tong Niu Joey Tianyi Zhou AAML 21 85 0 06 Sep 2018
Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints Ashutosh Baheti Alan Ritter Jiwei Li W. Dolan 23 90 0 04 Sep 2018
Aiming to Know You Better Perhaps Makes Me a More Engaging Dialogue Partner Yury Zemlyanskiy Fei Sha 21 20 0 21 Aug 2018
Improving Conditional Sequence Generative Adversarial Networks by Stepwise Evaluation Yi-Lin Tuan Hung-yi Lee GAN 22 55 0 16 Aug 2018
Retrieve and Refine: Improved Sequence Generation Models For Dialogue Jason Weston Emily Dinan Alexander H. Miller RALM 13 204 0 14 Aug 2018
Latent Semantic Analysis Approach for Document Summarization Based on Word Embeddings Kamal Al-Sabahi Zuping Zhang Kang Yang 19 9 0 08 Jul 2018
The price of debiasing automatic metrics in natural language evaluation Arun Tejasvi Chaganty Stephen Mussmann Percy Liang 19 113 0 06 Jul 2018
Coherence Models for Dialogue Alessandra Cervone Evgeny A. Stepanov Giuseppe Riccardi 26 24 0 21 Jun 2018
Response Generation by Context-aware Prototype Editing Yu Wu Furu Wei Shaohan Huang Yunli Wang Zhoujun Li Ming Zhou KELM 21 121 0 19 Jun 2018
A Syntactically Constrained Bidirectional-Asynchronous Approach for Emotional Conversation Generation Jingyuan Li Xiao Sun 27 46 0 19 Jun 2018