v1v2 (latest)

MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplification

24 May 2022

Papers citing "MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplification"

23 / 23 papers shown

Title
Spurious Correlations in Reference-Free Evaluation of Text Generation Esin Durmus Faisal Ladhak Tatsunori Hashimoto 62 31 0 21 Apr 2022
BARTScore: Evaluating Generated Text as Text Generation Weizhe Yuan Graham Neubig Pengfei Liu 135 849 0 22 Jun 2021
Evaluating the Efficacy of Summarization Evaluation across Languages Fajri Koto Jey Han Lau Timothy Baldwin 100 19 0 02 Jun 2021
Rethinking Automatic Evaluation in Sentence Simplification Thomas Scialom Louis Martin Jacopo Staiano Eric Villemonte de la Clergerie Benoît Sagot 79 31 0 15 Apr 2021
Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic Evaluation Clément Rebuffel Thomas Scialom Laure Soulier Benjamin Piwowarski Sylvain Lamprier Jacopo Staiano Geoffrey Scoutheeten Patrick Gallinari 69 32 0 15 Apr 2021
QuestEval: Summarization Asks for Fact-based Evaluation Thomas Scialom Paul-Alexis Dray Patrick Gallinari Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano Alex Jinpeng Wang HILM 71 276 0 23 Mar 2021
IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP Fajri Koto Afshin Rahimi Jey Han Lau Timothy Baldwin 59 263 0 02 Nov 2020
FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization Esin Durmus He He Mona T. Diab HILM 95 397 0 07 May 2020
ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations Fernando Alva-Manchego Louis Martin Antoine Bordes Carolina Scarton Benoît Sagot Lucia Specia 61 144 0 01 May 2020
MLSUM: The Multilingual Summarization Corpus Thomas Scialom Paul-Alexis Dray Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 82 177 0 30 Apr 2020
Automatic Machine Translation Evaluation in Many Languages via Zero-Shot Paraphrasing Brian Thompson Matt Post LRM 58 190 0 30 Apr 2020
BLEURT: Learning Robust Metrics for Text Generation Thibault Sellam Dipanjan Das Ankur P. Parikh 103 1,506 0 09 Apr 2020
Asking and Answering Questions to Evaluate the Factual Consistency of Summaries Alex Jinpeng Wang Kyunghyun Cho M. Lewis HILM 86 483 0 08 Apr 2020
MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance Wei Zhao Maxime Peyrard Fei Liu Yang Gao Christian M. Meyer Steffen Eger 194 602 0 05 Sep 2019
Answers Unite! Unsupervised Metrics for Reinforced Summarization Models Thomas Scialom Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 76 150 0 04 Sep 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 365 5,872 0 21 Apr 2019
Reference-less Quality Estimation of Text Simplification Systems Louis Martin Samuel Humeau Pierre-Emmanuel Mazaré Antoine Bordes Eric Villemonte de la Clergerie Benoît Sagot 76 42 0 30 Jan 2019
BLEU is Not Suitable for the Evaluation of Text Simplification Elior Sulem Omri Abend A. Rappoport 60 193 0 14 Oct 2018
Decoupled Weight Decay Regularization I. Loshchilov Frank Hutter OffRL 154 2,158 0 14 Nov 2017
Get To The Point: Summarization with Pointer-Generator Networks A. See Peter J. Liu Christopher D. Manning 3DPC 311 4,029 0 14 Apr 2017
Sentence Simplification with Deep Reinforcement Learning Xingxing Zhang Mirella Lapata 69 398 0 31 Mar 2017
LCSTS: A Large Scale Chinese Short Text Summarization Dataset Baotian Hu Qingcai Chen Fangze Zhu 105 339 0 19 Jun 2015
Teaching Machines to Read and Comprehend Karl Moritz Hermann Tomás Kociský Edward Grefenstette L. Espeholt W. Kay Mustafa Suleyman Phil Blunsom 355 3,555 0 10 Jun 2015