Curious Case of Language Generation Evaluation Metrics: A Cautionary
Tale

Curious Case of Language Generation Evaluation Metrics: A Cautionary Tale

26 October 2020

Pranava Madhyastha

Papers citing "Curious Case of Language Generation Evaluation Metrics: A Cautionary Tale"

17 / 17 papers shown

Title
Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics Nitika Mathur Tim Baldwin Trevor Cohn 26 246 0 11 Jun 2020
Findings of the 2016 WMT Shared Task on Cross-lingual Pronoun Prediction Liane Guillou Christian Hardmeier Preslav Nakov Sara Stymne Jörg Tiedemann Yannick Versley Mauro Cettolo Bonnie L. Webber Andrei Popescu-Belis 27 53 0 27 Nov 2019
Investigating Evaluation of Open-Domain Dialogue Systems With Human Generated Multiple References Prakhar Gupta Shikib Mehri Tiancheng Zhao Amy Pavel M. Eskénazi Jeffrey P. Bigham 50 86 0 24 Jul 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 199 5,668 0 21 Apr 2019
VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Research Xin Eric Wang Jiawei Wu Junkun Chen Lei Li Yuan-fang Wang William Yang Wang 75 550 0 06 Apr 2019
Describing like humans: on diversity in image captioning Qingzhong Wang Antoni B. Chan 43 99 0 28 Mar 2019
Spatio-Temporal Dynamics and Semantic Attribute Enriched Visual Encoding for Video Captioning Nayyer Aafaq Naveed Akhtar Wen Liu Syed Zulqarnain Gilani Ajmal Mian 53 204 0 27 Feb 2019
Neural Baby Talk Jiasen Lu Jianwei Yang Dhruv Batra Devi Parikh VLM 226 434 0 27 Mar 2018
DailyDialog: A Manually Labelled Multi-turn Dialogue Dataset Yanran Li Hui Su Xiaoyu Shen Wenjie Li Ziqiang Cao Shuzi Niu 48 1,291 0 11 Oct 2017
STAIR Captions: Constructing a Large-Scale Japanese Image Caption Dataset Yuya Yoshikawa Yutaro Shigeto A. Takeuchi 3DV 46 118 0 02 May 2017
A Challenge Set Approach to Evaluating Machine Translation P. Isabelle Colin Cherry George F. Foster ELM AAML 51 175 0 24 Apr 2017
Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challenge Oriol Vinyals Alexander Toshev Samy Bengio D. Erhan 65 853 0 21 Sep 2016
Sequence to Sequence -- Video to Text Subhashini Venugopalan Marcus Rohrbach Jeff Donahue Raymond J. Mooney Trevor Darrell Kate Saenko 94 1,417 0 03 May 2015
Microsoft COCO Captions: Data Collection and Evaluation Server Xinlei Chen Hao Fang Nayeon Lee Ramakrishna Vedantam Saurabh Gupta Piotr Dollar C. L. Zitnick 153 2,461 0 01 Apr 2015
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention Ke Xu Jimmy Ba Ryan Kiros Kyunghyun Cho Aaron Courville Ruslan Salakhutdinov R. Zemel Yoshua Bengio DiffM 281 10,034 0 10 Feb 2015
Deep Visual-Semantic Alignments for Generating Image Descriptions A. Karpathy Li Fei-Fei 58 5,569 0 07 Dec 2014
CIDEr: Consensus-based Image Description Evaluation Ramakrishna Vedantam C. L. Zitnick Devi Parikh 224 4,451 0 20 Nov 2014