BARTScore: Evaluating Generated Text as Text Generation

22 June 2021

Graham Neubig

Papers citing "BARTScore: Evaluating Generated Text as Text Generation"

50 / 535 papers shown

Title
Do Language Models Understand Measurements? Sungjin Park Seung-kook Ryu Edward Choi ReLM LRM 45 4 0 23 Oct 2022
Salience Allocation as Guidance for Abstractive Summarization Fei Wang Kaiqiang Song Hongming Zhang Lifeng Jin Sangwoo Cho Wenlin Yao Xiaoyang Wang Muhao Chen Dong Yu 60 32 0 22 Oct 2022
Improving Aspect Sentiment Quad Prediction via Template-Order Data Augmentation Mengting Hu Yike Wu H. Gao Yinhao Bai Shiwan Zhao 24 48 0 19 Oct 2022
Taxonomy of Abstractive Dialogue Summarization: Scenarios, Approaches and Future Directions Qi Jia Yizhu Liu Siyu Ren Kenny Q. Zhu 29 6 0 18 Oct 2022
Summary Workbench: Unifying Application and Evaluation of Text Summarization Models S. Syed Dominik Schwabe Martin Potthast 22 0 0 18 Oct 2022
Leveraging Non-dialogue Summaries for Dialogue Summarization Seongmin Park Dongchan Shin Jihwa Lee 21 4 0 17 Oct 2022
Social Biases in Automatic Evaluation Metrics for NLG Mingqi Gao Xiaojun Wan 30 3 0 17 Oct 2022
Model Criticism for Long-Form Text Generation Yuntian Deng Volodymyr Kuleshov Alexander M. Rush 44 19 0 16 Oct 2022
BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation Tianxiang Sun Junliang He Xipeng Qiu Xuanjing Huang 24 44 0 14 Oct 2022
Towards a Unified Multi-Dimensional Evaluator for Text Generation Ming Zhong Yang Liu Da Yin Yuning Mao Yizhu Jiao Peng Liu Chenguang Zhu Heng Ji Jiawei Han ELM 45 255 0 13 Oct 2022
OpenCQA: Open-ended Question Answering with Charts Shankar Kantharaj Do Xuan Long Rixie Tiffany Ko Leong J. Tan Enamul Hoque Chenyu You 29 47 0 12 Oct 2022
DATScore: Evaluating Translation with Data Augmented Translations Moussa Kamal Eddine Guokan Shang Michalis Vazirgiannis 44 5 0 12 Oct 2022
Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis Wenda Xu Yi-Lin Tuan Yujie Lu Michael Stephen Saxon Lei Li William Yang Wang 41 22 0 10 Oct 2022
Safety Verification for Neural Networks Based on Set-boundary Analysis Zhen Liang Dejin Ren Wanwei Liu Ji Wang Wenjing Yang Bai Xue AAML 39 4 0 09 Oct 2022
How Large Language Models are Transforming Machine-Paraphrased Plagiarism Jan Philip Wahle Terry Ruas Frederic Kirstein Bela Gipp 21 32 0 07 Oct 2022
MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text Wenhu Chen Hexiang Hu Xi Chen Pat Verga William W. Cohen RALM 16 143 0 06 Oct 2022
GAPX: Generalized Autoregressive Paraphrase-Identification X Yi Zhou Renyu Li Hayden Housen Ser-Nam Lim BDL 30 0 0 05 Oct 2022
Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements Leandro von Werra Lewis Tunstall A. Thakur A. Luccioni Tristan Thrush ... Julien Chaumond Margaret Mitchell Alexander M. Rush Thomas Wolf Douwe Kiela ELM 23 24 0 30 Sep 2022
Selecting Better Samples from Pre-trained LLMs: A Case Study on Question Generation Xingdi Yuan Tong Wang Yen-Hsiang Wang Emery Fine Rania Abdelghani Pauline Lucas Hélene Sauzéon Pierre-Yves Oudeyer 30 29 0 22 Sep 2022
EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation Metrics Daniil Larionov Jens Grunwald Christoph Leiter Steffen Eger 28 5 0 20 Sep 2022
Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models Zichun Yu Tianyu Gao Zhengyan Zhang Yankai Lin Zhiyuan Liu Maosong Sun Jie Zhou VLM LRM 38 1 0 20 Sep 2022
How to Find Strong Summary Coherence Measures? A Toolbox and a Comparative Study for Summary Coherence Measure Evaluation Julius Steen K. Markert HILM 19 4 0 14 Sep 2022
On Faithfulness and Coherence of Language Explanations for Recommendation Systems Zhouhang Xie Julian McAuley Bodhisattwa Prasad Majumder LRM 29 1 0 12 Sep 2022
Towards explainable evaluation of language models on the semantic similarity of visual concepts Maria Lymperaiou George Manoliadis Orfeas Menis Mastromichalakis Edmund Dervakos Giorgos Stamou AAML 24 5 0 08 Sep 2022
Layer or Representation Space: What makes BERT-based Evaluation Metrics Robust? Doan Nam Long Vu N. Moosavi Steffen Eger 26 9 0 06 Sep 2022
Every picture tells a story: Image-grounded controllable stylistic story generation Holy Lovenia Bryan Wilie Romain Barraud Samuel Cahyawijaya Willy Chung Pascale Fung 26 8 0 04 Sep 2022
Incorporating Task-specific Concept Knowledge into Script Learning Chenkai Sun Tie Xu Chengxiang Zhai Heng Ji 31 4 0 31 Aug 2022
Podcast Summary Assessment: A Resource for Evaluating Summary Assessment Methods Potsawee Manakul Mark J. F. Gales 13 5 0 28 Aug 2022
Multimedia Generative Script Learning for Task Planning Qingyun Wang Manling Li Hou Pong Chan Lifu Huang J. Hockenmaier Girish Chowdhary Heng Ji VGen 41 10 0 25 Aug 2022
Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation Cyril Chhun Pierre Colombo Chloé Clavel Fabian M. Suchanek 53 50 0 24 Aug 2022
SelF-Eval: Self-supervised Fine-grained Dialogue Evaluation Longxuan Ma Ziyu Zhuang Weinan Zhang Mingda Li Ting Liu 29 4 0 17 Aug 2022
MENLI: Robust Evaluation Metrics from Natural Language Inference Yanran Chen Steffen Eger 32 16 0 15 Aug 2022
Abstractive Meeting Summarization: A Survey Virgile Rennard Guokan Shang Julie Hunter Michalis Vazirgiannis 37 15 0 08 Aug 2022
SMART: Sentences as Basic Units for Text Evaluation Reinald Kim Amplayo Peter J. Liu Yao-Min Zhao Shashi Narayan 32 21 0 01 Aug 2022
Contextual Information and Commonsense Based Prompt for Emotion Recognition in Conversation Jingjie Yi Deqing Yang Siyu Yuan Caiyan Cao Zhiyao Zhang Yanghua Xiao 13 9 0 27 Jul 2022
No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence Chaozheng Wang Yuanhang Yang Cuiyun Gao Yun Peng Hongyu Zhang Michael R. Lyu AAML 67 134 0 24 Jul 2022
Can Language Models Make Fun? A Case Study in Chinese Comical Crosstalk Benyou Wang Xiang Wu Xiaokang Liu Jianquan Li Prayag Tiwari Qianqian Xie 33 6 0 02 Jul 2022
Why is constrained neural language generation particularly challenging? Cristina Garbacea Qiaozhu Mei 59 14 0 11 Jun 2022
Learning Locality and Isotropy in Dialogue Modeling Han Wu Hao Hao Tan Mingjie Zhan Gangming Zhao Shaoqing Lu Ding Liang Linqi Song 39 2 0 29 May 2022
Learning a Better Initialization for Soft Prompts via Meta-Learning Yukun Huang Kun Qian Zhou Yu VLM 55 9 0 25 May 2022
MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplification Yu Lu Liu Rachel Bawden Thomas Scaliom Benoît Sagot Jackie C.K. Cheung 35 4 0 24 May 2022
Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models Mirac Suzgun Luke Melas-Kyriazi Dan Jurafsky VLM 82 66 0 23 May 2022
Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding Rishabh Bhardwaj Amrita Saha Guosheng Lin Soujanya Poria VLM VPVLM 25 7 0 23 May 2022
Few-Shot Natural Language Inference Generation with PDD: Prompt and Dynamic Demonstration Kaijian Li Shansan Gong Kenny Q. Zhu 27 0 0 21 May 2022
Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets Philippe Laban Chien-Sheng Wu Wenhao Liu Caiming Xiong 41 5 0 13 May 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 30 9 0 29 Apr 2022
Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code Daniel Deutsch Dan Roth AI4CE 45 2 0 29 Apr 2022
UniTE: Unified Translation Evaluation Boyi Deng Dayiheng Liu Baosong Yang Haibo Zhang Boxing Chen Derek F. Wong Lidia S. Chao 38 41 0 28 Apr 2022
Natural Language to Code Translation with Execution Freda Shi Daniel Fried Marjan Ghazvininejad Luke Zettlemoyer Sida I. Wang 36 124 0 25 Apr 2022
TRUE: Re-evaluating Factual Consistency Evaluation Or Honovich Roee Aharoni Jonathan Herzig Hagai Taitelbaum Doron Kukliansy Vered Cohen Thomas Scialom Idan Szpektor Avinatan Hassidim Yossi Matias HILM 35 3 0 11 Apr 2022