Underreporting of errors in NLG output, and what to do about it

Underreporting of errors in NLG output, and what to do about it

2 August 2021

Emiel van Miltenburg

Dimitra Gkatzia

Stephanie Inglis

Papers citing "Underreporting of errors in NLG output, and what to do about it"

18 / 18 papers shown

Title
A Rationale-Centric Framework for Human-in-the-loop Machine Learning Jinghui Lu Linyi Yang Brian Mac Namee Yue Zhang 56 39 0 24 Mar 2022
Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation Markus Freitag George F. Foster David Grangier Viresh Ratnakar Qijun Tan Wolfgang Macherey 139 388 0 29 Apr 2021
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics Artidoro Pagnoni Vidhisha Balachandran Yulia Tsvetkov HILM 253 310 0 27 Apr 2021
Preregistering NLP Research Emiel van Miltenburg Chris van der Lee E. Krahmer AI4CE 47 23 0 11 Mar 2021
Generating Intelligible Plumitifs Descriptions: Use Case Application with Ethical Considerations David Beauchemin Nicolas Garneau Eve Gaumond Pierre-Luc Déziel Richard Khoury Luc Lamontagne AILaw 47 9 0 24 Nov 2020
A Gold Standard Methodology for Evaluating Accuracy in Data-To-Text Systems Craig Thomson Ehud Reiter 46 52 0 08 Nov 2020
Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Model Jason Obeid Enamul Hoque 59 137 0 18 Oct 2020
With Little Power Comes Great Responsibility Dallas Card Peter Henderson Urvashi Khandelwal Robin Jia Kyle Mahowald Dan Jurafsky 253 116 0 13 Oct 2020
Beyond Accuracy: Behavioral Testing of NLP models with CheckList Marco Tulio Ribeiro Tongshuang Wu Carlos Guestrin Sameer Singh ELM 162 1,097 0 08 May 2020
Semantic Noise Matters for Neural Natural Language Generation Ondrej Dusek David M. Howcroft Verena Rieser 64 118 0 10 Nov 2019
Show Your Work: Improved Reporting of Experimental Results Jesse Dodge Suchin Gururangan Dallas Card Roy Schwartz Noah A. Smith 62 255 0 06 Sep 2019
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference R. Thomas McCoy Ellie Pavlick Tal Linzen 125 1,234 0 04 Feb 2019
Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challenge Ondrej Dusek Jekaterina Novikova Verena Rieser ELM 73 232 0 23 Jan 2019
Model Cards for Model Reporting Margaret Mitchell Simone Wu Andrew Zaldivar Parker Barnes Lucy Vasserman Ben Hutchinson Elena Spitzer Inioluwa Deborah Raji Timnit Gebru 108 1,885 0 05 Oct 2018
Findings of the E2E NLG Challenge Ondrej Dusek Jekaterina Novikova Verena Rieser 63 115 0 02 Oct 2018
Explaining Explanations: An Overview of Interpretability of Machine Learning Leilani H. Gilpin David Bau Ben Z. Yuan Ayesha Bajwa Michael A. Specter Lalana Kagal XAI 80 1,854 0 31 May 2018
Challenges in Data-to-Document Generation Sam Wiseman Stuart M. Shieber Alexander M. Rush 122 588 0 25 Jul 2017
Room for improvement in automatic image description: an error analysis Emiel van Miltenburg Desmond Elliott 3DV 38 12 0 13 Apr 2017

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.