Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR

20 August 2020

Papers citing "Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR"

16 / 16 papers shown

Title
Natural Language Processing RELIES on Linguistics Juri Opitz Shira Wein Nathan Schneider AI4CE 60 7 0 09 May 2024
AMR4NLI: Interpretable and robust NLI measures from semantic graphs Juri Opitz Shira Wein Julius Steen Anette Frank Nathan Schneider 49 0 0 01 Jun 2023
Investigating the Effect of Relative Positional Embeddings on AMR-to-Text Generation with Structural Adapters Sébastien Montella Alexis Nasr Johannes Heinecke Frédéric Béchet L. Rojas-Barahona 29 2 0 12 Feb 2023
MAUVE Scores for Generative Models: Theory and Practice Krishna Pillutla Lang Liu John Thickstun Sean Welleck Swabha Swayamdipta Rowan Zellers Sewoong Oh Yejin Choi Zaïd Harchaoui EGVM 44 22 0 30 Dec 2022
ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning O. Yu. Golovneva Moya Chen Spencer Poff Martin Corredor Luke Zettlemoyer Maryam Fazel-Zarandi Asli Celikyilmaz ReLM LRM 34 139 0 15 Dec 2022
Better Smatch = Better Parser? AMR evaluation is not so simple anymore Juri Opitz Anette Frank 15 15 0 12 Oct 2022
Graph-to-Text Generation with Dynamic Structure Pruning Liang Li Ruiying Geng Bowen Li Can Ma Yinliang Yue Binhua Li Yongbin Li 55 2 0 15 Sep 2022
SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable Semantic Features Juri Opitz Anette Frank 34 33 0 14 Jun 2022
A Dynamic, Interpreted CheckList for Meaning-oriented NLG Metric Evaluation -- through the Lens of Semantic Similarity Rating Laura Zeidler Juri Opitz Anette Frank 22 6 0 24 May 2022
Weisfeiler-Leman in the BAMBOO: Novel AMR Graph Metrics and a Benchmark for AMR Graph Similarity Juri Opitz Angel Daza A. Frank 29 31 0 26 Aug 2021
Structural Adapters in Pretrained Language Models for AMR-to-text Generation Leonardo F. R. Ribeiro Yue Zhang Iryna Gurevych 41 69 0 16 Mar 2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann Tosin Adewumi Karmanya Aggarwal Pawan Sasanka Ammanamanchi Aremu Anuoluwapo ... Nishant Subramani Wei Xu Diyi Yang Akhila Yerukola Jiawei Zhou VLM 260 285 0 02 Feb 2021
MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers Krishna Pillutla Swabha Swayamdipta Rowan Zellers John Thickstun Sean Welleck Yejin Choi Zaïd Harchaoui 45 343 0 02 Feb 2021
A Survey of Evaluation Metrics Used for NLG Systems Ananya B. Sai Akash Kumar Mohankumar Mitesh M. Khapra ELM 33 230 0 27 Aug 2020
Neural Machine Translation with Error Correction Kaitao Song Xu Tan Jianfeng Lu 132 62 0 21 Jul 2020
Six Challenges for Neural Machine Translation Philipp Koehn Rebecca Knowles AAML AIMat 224 1,211 0 12 Jun 2017