DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence

26 January 2022

Papers citing "DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence"

25 / 25 papers shown

Title
Synthetic News Generation for Fake News Classification Abdul Sittar Luka Golob Mateja Smiljanic 40 0 0 31 Mar 2025
How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMs Ran Zhang Wei-Ye Zhao Steffen Eger 76 4 0 24 Oct 2024
Parse Trees Guided LLM Prompt Compression Wenhao Mao Chengbin Hou Tianyu Zhang Xinyu Lin Ke Tang Hairong Lv 26 0 0 23 Sep 2024
What Would You Ask When You First Saw $a^2+b^2=c^2$ ? Evaluating LLM on Curiosity-Driven Questioning Shashidhar Reddy Javaji Zining Zhu ELM ALM 39 0 0 19 Sep 2024
Presence or Absence: Are Unknown Word Usages in Dictionaries? Xianghe Ma Dominik Schlechtweg Wei-Ye Zhao 36 3 0 02 Jun 2024
LLMChain: Blockchain-based Reputation System for Sharing and Evaluating Large Language Models Mouhamed Amine Bouchiha Quentin Telnoff Souhail Bakkali R. Champagnat Mourad Rabah Mickael Coustaty Y. Ghamri-Doudane LRM 36 3 0 20 Apr 2024
CoUDA: Coherence Evaluation via Unified Data Augmentation Dawei Zhu Wenhao Wu Yifan Song Fangwei Zhu Ziqiang Cao Sujian Li 28 0 0 31 Mar 2024
Legally Binding but Unfair? Towards Assessing Fairness of Privacy Policies Vincent Freiberger Erik Buchmann AILaw 38 5 0 12 Mar 2024
Humans or LLMs as the Judge? A Study on Judgement Biases Guiming Hardy Chen Shunian Chen Ziche Liu Feng Jiang Benyou Wang 82 93 0 16 Feb 2024
`Keep it Together': Enforcing Cohesion in Extractive Summaries by Simulating Human Memory Ronald Cardenas Matthias Shen Shay B. Cohen 21 0 0 16 Feb 2024
Unlocking Structure Measuring: Introducing PDD, an Automatic Metric for Positional Discourse Coherence Yinhong Liu Yixuan Su Ehsan Shareghi Nigel Collier 36 4 0 15 Feb 2024
SemScore: Automated Evaluation of Instruction-Tuned LLMs based on Semantic Textual Similarity Ansar Aynetdinov Alan Akbik ALM 44 12 0 30 Jan 2024
LUNA: A Framework for Language Understanding and Naturalness Assessment Marat Saidov A. Bakalova Ekaterina Taktasheva Vladislav Mikhailov Ekaterina Artemova ELM 31 1 0 09 Jan 2024
Nine-year-old children outperformed ChatGPT in emotion: Evidence from Chinese writing Siyi Cao Tongquan Zhou Siruo Zhou 23 0 0 01 Oct 2023
MusicJam: Visualizing Music Insights via Generated Narrative Illustrations Chuer Chen Nan Cao Jiani Hou Yi Guo Yulei Zhang Yang Shi DiffM 24 0 0 22 Aug 2023
Towards Explainable Evaluation Metrics for Machine Translation Christoph Leiter Piyawat Lertvittayakumjorn M. Fomicheva Wei-Ye Zhao Yang Gao Steffen Eger ELM 30 13 0 22 Jun 2023
Cross-lingual Cross-temporal Summarization: Dataset, Models, Evaluation Ran Zhang Jihed Ouni Steffen Eger 24 6 0 22 Jun 2023
AWESOME: GPU Memory-constrained Long Document Summarization using Memory Mechanism and Global Salient Content Shuyang Cao Lu Wang 27 5 0 24 May 2023
Scientific Opinion Summarization: Paper Meta-review Generation Dataset, Methods, and Evaluation Qi Zeng Mankeerat Sidhu Ansel Blume Hou Pong Chan Lu Wang Heng Ji 34 10 0 24 May 2023
Model Criticism for Long-Form Text Generation Yuntian Deng Volodymyr Kuleshov Alexander M. Rush 38 19 0 16 Oct 2022
How to Find Strong Summary Coherence Measures? A Toolbox and a Comparative Study for Summary Coherence Measure Evaluation Julius Steen K. Markert HILM 11 4 0 14 Sep 2022
MENLI: Robust Evaluation Metrics from Natural Language Inference Yanran Chen Steffen Eger 32 15 0 15 Aug 2022
USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation Jonas Belouadi Steffen Eger 33 20 0 21 Feb 2022
Perturbation CheckLists for Evaluating NLG Evaluation Metrics Ananya B. Sai Tanay Dixit D. Y. Sheth S. Mohan Mitesh M. Khapra AAML 113 57 0 13 Sep 2021
Teaching Machines to Read and Comprehend Karl Moritz Hermann Tomás Kociský Edward Grefenstette L. Espeholt W. Kay Mustafa Suleyman Phil Blunsom 175 3,510 0 10 Jun 2015