Rethinking Automatic Evaluation in Sentence Simplification

v1v2 (latest)

Rethinking Automatic Evaluation in Sentence Simplification

15 April 2021

Eric Villemonte de la Clergerie

ArXiv (abs)PDF HTML

Papers citing "Rethinking Automatic Evaluation in Sentence Simplification"

16 / 16 papers shown

Title
Mind the Style Gap: Meta-Evaluation of Style and Attribute Transfer Metrics Amalie Brogaard Pauli Isabelle Augenstein Ira Assent 131 0 0 20 Feb 2025
QuestEval: Summarization Asks for Fact-based Evaluation Thomas Scialom Paul-Alexis Dray Patrick Gallinari Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano Alex Jinpeng Wang HILM 64 276 0 23 Mar 2021
ColdGANs: Taming Language GANs with Cautious Sampling Strategies Thomas Scialom Paul-Alexis Dray Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano GAN SyDa 55 18 0 08 Jun 2020
ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations Fernando Alva-Manchego Louis Martin Antoine Bordes Carolina Scarton Benoît Sagot Lucia Specia 59 144 0 01 May 2020
MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases Louis Martin Angela Fan Eric Villemonte de la Clergerie Antoine Bordes Benoît Sagot 63 36 0 01 May 2020
Discriminative Adversarial Search for Abstractive Summarization Thomas Scialom Paul-Alexis Dray Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 81 33 0 24 Feb 2020
Controllable Sentence Simplification Louis Martin Benoît Sagot Eric Villemonte de la Clergerie Antoine Bordes 66 147 0 07 Oct 2019
Answers Unite! Unsupervised Metrics for Reinforced Summarization Models Thomas Scialom Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 74 150 0 04 Sep 2019
EASSE: Easier Automatic Sentence Simplification Evaluation Fernando Alva-Manchego Louis Martin Carolina Scarton Lucia Specia 58 130 0 13 Aug 2019
Defending Against Neural Fake News Rowan Zellers Ari Holtzman Hannah Rashkin Yonatan Bisk Ali Farhadi Franziska Roesner Yejin Choi AAML 134 1,032 0 29 May 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 357 5,872 0 21 Apr 2019
Integrating Transformer and Paraphrase Rules for Sentence Simplification Sanqiang Zhao Rui Meng Daqing He Andi Saptono B. Parmanto 64 120 0 26 Oct 2018
BLEU is Not Suitable for the Evaluation of Text Simplification Elior Sulem Omri Abend A. Rappoport 55 193 0 14 Oct 2018
Why We Need New Evaluation Metrics for NLG Jekaterina Novikova Ondrej Dusek Amanda Cercas Curry Verena Rieser 103 462 0 21 Jul 2017
A Semantic QA-Based Approach for Text Summarization Evaluation Ping Chen Fei Wu Tong Wang Wei Ding 38 42 0 21 Apr 2017
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 316 8,174 0 16 Jun 2016