Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR

20 August 2020

Papers citing "Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR"

15 / 15 papers shown

Title
Natural Language Processing RELIES on Linguistics Juri Opitz Shira Wein Nathan Schneider AI4CE 55 7 0 09 May 2024
AMR4NLI: Interpretable and robust NLI measures from semantic graphs Juri Opitz Shira Wein Julius Steen Anette Frank Nathan Schneider 39 0 0 01 Jun 2023
Investigating the Effect of Relative Positional Embeddings on AMR-to-Text Generation with Structural Adapters Sébastien Montella Alexis Nasr Johannes Heinecke Frédéric Béchet L. Rojas-Barahona 26 2 0 12 Feb 2023
MAUVE Scores for Generative Models: Theory and Practice Krishna Pillutla Lang Liu John Thickstun Sean Welleck Swabha Swayamdipta Rowan Zellers Sewoong Oh Yejin Choi Zaïd Harchaoui EGVM 35 21 0 30 Dec 2022
ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning O. Yu. Golovneva Moya Chen Spencer Poff Martin Corredor Luke Zettlemoyer Maryam Fazel-Zarandi Asli Celikyilmaz ReLM LRM 34 138 0 15 Dec 2022
Better Smatch = Better Parser? AMR evaluation is not so simple anymore Juri Opitz Anette Frank 13 15 0 12 Oct 2022
Graph-to-Text Generation with Dynamic Structure Pruning Liang Li Ruiying Geng Bowen Li Can Ma Yinliang Yue Binhua Li Yongbin Li 55 2 0 15 Sep 2022
SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable Semantic Features Juri Opitz Anette Frank 34 33 0 14 Jun 2022
A Dynamic, Interpreted CheckList for Meaning-oriented NLG Metric Evaluation -- through the Lens of Semantic Similarity Rating Laura Zeidler Juri Opitz Anette Frank 19 6 0 24 May 2022
Structural Adapters in Pretrained Language Models for AMR-to-text Generation Leonardo F. R. Ribeiro Yue Zhang Iryna Gurevych 41 69 0 16 Mar 2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann Tosin P. Adewumi Karmanya Aggarwal Pawan Sasanka Ammanamanchi Aremu Anuoluwapo ... Nishant Subramani Wei-ping Xu Diyi Yang Akhila Yerukola Jiawei Zhou VLM 260 285 0 02 Feb 2021
MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers Krishna Pillutla Swabha Swayamdipta Rowan Zellers John Thickstun Sean Welleck Yejin Choi Zaïd Harchaoui 39 343 0 02 Feb 2021
A Survey of Evaluation Metrics Used for NLG Systems Ananya B. Sai Akash Kumar Mohankumar Mitesh M. Khapra ELM 33 230 0 27 Aug 2020
Neural Machine Translation with Error Correction Kaitao Song Xu Tan Jianfeng Lu 132 62 0 21 Jul 2020
Six Challenges for Neural Machine Translation Philipp Koehn Rebecca Knowles AAML AIMat 224 1,208 0 12 Jun 2017