BLEU is Not Suitable for the Evaluation of Text Simplification

14 October 2018

Papers citing "BLEU is Not Suitable for the Evaluation of Text Simplification"

41 / 41 papers shown

Title
Are LLM-generated plain language summaries truly understandable? A large-scale crowdsourced evaluation Yue Guo Jae Ho Sohn Gondy Leroy Trevor Cohen ELM 23 0 0 15 May 2025
Evaluation Under Imperfect Benchmarks and Ratings: A Case Study in Text Simplification Joseph Liu Yoonsoo Nam Xinyue Cui Swabha Swayamdipta 56 0 0 13 Apr 2025
Self-Rationalization in the Wild: A Large Scale Out-of-Distribution Evaluation on NLI-related tasks Jing Yang Max Glockner Anderson de Rezende Rocha Iryna Gurevych LRM 75 1 0 07 Feb 2025
Enabling Scalable Evaluation of Bias Patterns in Medical LLMs Hamed Fayyaz Raphael Poulain Rahmatollah Beheshti 42 1 0 18 Oct 2024
WikiSplit++: Easy Data Refinement for Split and Rephrase Hayato Tsukagoshi Tsutomu Hirao Makoto Morishita Katsuki Chousa Ryohei Sasano Koichi Takeda 45 1 0 13 Apr 2024
Measuring Bias in a Ranked List using Term-based Representations Amin Abolghasemi Leif Azzopardi Arian Askari Maarten de Rijke Suzan Verberne 42 6 0 09 Mar 2024
LLM-based NLG Evaluation: Current Status and Challenges Mingqi Gao Xinyu Hu Jie Ruan Xiao Pu Xiaojun Wan ELM LM&MA 71 30 0 02 Feb 2024
Metric-Based In-context Learning: A Case Study in Text Simplification Subhadra Vadlamannati Gözde Gül Sahin 27 1 0 27 Jul 2023
Revisiting non-English Text Simplification: A Unified Multilingual Benchmark Michael Joseph Ryan Tarek Naous Wei Xu 31 25 0 25 May 2023
APPLS: Evaluating Evaluation Metrics for Plain Language Summarization Yue Guo Tal August Gondy Leroy T. Cohen Lucy Lu Wang 57 9 0 23 May 2023
Teaching the Pre-trained Model to Generate Simple Texts for Text Simplification Renliang Sun Wei Xu Xiaojun Wan CLL 27 17 0 21 May 2023
Learning to Simulate Natural Language Feedback for Interactive Semantic Parsing Hao Yan Saurabh Srivastava Yintao Tai Sida I. Wang Wen-tau Yih Ziyu Yao 35 17 0 14 May 2023
Sentence Simplification via Large Language Models Yutao Feng Jipeng Qiang Yun Li Yunhao Yuan Yi Zhu 28 17 0 23 Feb 2023
The Fewer Splits are Better: Deconstructing Readability in Sentence Splitting Tadashi Nomoto 33 3 0 02 Feb 2023
Sentence-level Feedback Generation for English Language Learners: Does Data Augmentation Help? Shabnam Behzad Amir Zeldes Nathan Schneider 11 5 0 18 Dec 2022
Cognitive Simplification Operations Improve Text Simplification Eytan Chamovitz Omri Abend 35 4 0 16 Nov 2022
StoryER: Automatic Story Evaluation via Ranking, Rating and Reasoning Hong Chen D. Vo Hiroya Takamura Yusuke Miyao Hideki Nakayama 30 20 0 16 Oct 2022
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code Sebastian Gehrmann Abhik Bhattacharjee Abinaya Mahendiran Alex Jinpeng Wang Alexandros Papangelis ... Yacine Jernite Yi Xu Yisi Sang Yixin Liu Yufang Hou 47 38 0 22 Jun 2022
Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets Philippe Laban Chien-Sheng Wu Wenhao Liu Caiming Xiong 41 5 0 13 May 2022
Global Readiness of Language Technology for Healthcare: What would it Take to Combat the Next Pandemic? Ishani Mondal Kabir Ahuja Mohit Jain Jacki O Neil Kalika Bali Monojit Choudhury ELM LM&MA 29 4 0 06 Apr 2022
Towards more patient friendly clinical notes through language models and ontologies Francesco Moramarco Damir Juric Aleksandar Savkov Jack Flann Maria Lehl ... Tessa Grafen V. Zhelezniak Sunir Gohil Alex Papadopoulos Korfiatis Nils Y. Hammerla 26 7 0 23 Dec 2021
Document-Level Text Simplification: Dataset, Criteria and Baseline Renliang Sun Hanqi Jin Xiao-Yi Wan 19 44 0 11 Oct 2021
BiSECT: Learning to Split and Rephrase Sentences with Bitexts Joongwon Kim Mounica Maddela Reno Kriz Wei Xu Chris Callison-Burch 58 25 0 10 Sep 2021
An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languages Xinyu Lu Jipeng Qiang Yun Li Yunhao Yuan Yi Zhu 33 19 0 01 Sep 2021
A Comprehensive Assessment of Dialog Evaluation Metrics Yi-Ting Yeh M. Eskénazi Shikib Mehri 36 105 0 07 Jun 2021
Rethinking Automatic Evaluation in Sentence Simplification Thomas Scialom Louis Martin Jacopo Staiano Eric Villemonte de la Clergerie Benoît Sagot 30 29 0 15 Apr 2021
Text Simplification by Tagging Kostiantyn Omelianchuk Vipul Raheja Oleksandr Skurzhanskyi 22 45 0 08 Mar 2021
Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering Arij Riabi Thomas Scialom Rachel Keraron Benoît Sagot Djamé Seddah Jacopo Staiano 142 52 0 23 Oct 2020
Controllable Text Simplification with Explicit Paraphrasing Mounica Maddela Fernando Alva-Manchego Wenyuan Xu 23 98 0 21 Oct 2020
Toward Stance-based Personas for Opinionated Dialogues Thomas Scialom Serra Sinem Tekiroğlu Jacopo Staiano Marco Guerini 20 9 0 07 Oct 2020
KoBE: Knowledge-Based Machine Translation Evaluation Zorik Gekhman Roee Aharoni Genady Beryozkin Markus Freitag Wolfgang Macherey 23 15 0 23 Sep 2020
Iterative Edit-Based Unsupervised Sentence Simplification Dhruv Kumar Lili Mou Lukasz Golab Olga Vechtomova 27 67 0 17 Jun 2020
ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations Fernando Alva-Manchego Louis Martin Antoine Bordes Carolina Scarton Benoît Sagot Lucia Specia 23 141 0 01 May 2020
Semi-Supervised Text Simplification with Back-Translation and Asymmetric Denoising Autoencoders Yanbin Zhao Lu Chen Zhi Chen Kai Yu 33 38 0 30 Apr 2020
Discriminative Adversarial Search for Abstractive Summarization Thomas Scialom Paul-Alexis Dray Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 34 33 0 24 Feb 2020
Controllable Sentence Simplification Louis Martin Benoît Sagot Eric Villemonte de la Clergerie Antoine Bordes 15 145 0 07 Oct 2019
EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing Yue Dong Zichao Li Mehdi Rezagholizadeh Jackie C.K. Cheung 23 158 0 19 Jun 2019
Transforming Complex Sentences into a Semantic Hierarchy C. Niklaus Matthias Cetto André Freitas Siegfried Handschuh AILaw 19 41 0 03 Jun 2019
Reference-less Quality Estimation of Text Simplification Systems Louis Martin Samuel Humeau Pierre-Emmanuel Mazaré Antoine Bordes Eric Villemonte de la Clergerie Benoît Sagot 36 42 0 30 Jan 2019
Large-scale Hierarchical Alignment for Data-driven Text Rewriting Nikola I. Nikolov Richard H. R. Hahnloser 46 7 0 18 Oct 2018
Split and Rephrase: Better Evaluation and a Stronger Baseline Roee Aharoni Yoav Goldberg MoE 226 45 0 02 May 2018