Title
Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation Maria Eriksson Erasmo Purificato Arman Noroozian Joao Vinagre Guillaume Chaslot Emilia Gomez David Fernandez-Llorca ELM 252 6 0 10 Feb 2025
BARTScore: Evaluating Generated Text as Text Generation Weizhe Yuan Graham Neubig Pengfei Liu 139 850 0 22 Jun 2021
SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization Yixin Liu Peng Liu AILaw 79 261 0 03 Jun 2021
SpanNER: Named Entity Re-/Recognition as Span Prediction Jinlan Fu Xuanjing Huang Pengfei Liu 68 100 0 01 Jun 2021
RefSum: Refactoring Neural Summarization Yixin Liu Zi-Yi Dou Pengfei Liu 65 40 0 15 Apr 2021
Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa Junqi Dai Hang Yan Tianxiang Sun Pengfei Liu Xipeng Qiu 53 166 0 11 Apr 2021
Towards More Fine-grained and Reliable NLP Performance Prediction Zihuiwen Ye Pengfei Liu Jinlan Fu Graham Neubig 83 33 0 10 Feb 2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann Tosin Adewumi Karmanya Aggarwal Pawan Sasanka Ammanamanchi Aremu Anuoluwapo ... Nishant Subramani Wei Xu Diyi Yang Akhila Yerukola Jiawei Zhou VLM 313 285 0 02 Feb 2021
FLERT: Document-Level Features for Named Entity Recognition Stefan Schweter Alan Akbik 76 112 0 13 Nov 2020
Interpretable Multi-dataset Evaluation for Named Entity Recognition Jinlan Fu Pengfei Liu Graham Neubig 91 44 0 13 Nov 2020
Re-evaluating Evaluation in Text Summarization Manik Bhandari Pranav Narayan Gour A. Ashfaq Pengfei Liu Graham Neubig 156 178 0 14 Oct 2020
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Ikuya Yamada Akari Asai Hiroyuki Shindo Hideaki Takeda Yuji Matsumoto 123 672 0 02 Oct 2020
The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Models Ian Tenney James Wexler Jasmijn Bastings Tolga Bolukbasi Andy Coenen ... Ellen Jiang Mahima Pushkarna Carey Radebaugh Emily Reif Ann Yuan VLM 128 196 0 12 Aug 2020
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation Yaobo Liang Nan Duan Yeyun Gong Ning Wu Fenfei Guo ... Shuguang Liu Fan Yang Daniel Fernando Campos Rangan Majumder Ming Zhou ELM VLM 115 350 0 03 Apr 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 213 977 0 24 Mar 2020
Rethinking Generalization of Neural Models: A Named Entity Recognition Case Study Jinlan Fu Pengfei Liu Qi Zhang Xuanjing Huang AI4CE 70 75 0 12 Jan 2020
A Closer Look at Data Bias in Neural Extractive Summarization Models Ming Zhong Danqing Wang Pengfei Liu Xipeng Qiu Xuanjing Huang 97 42 0 30 Sep 2019
AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models Eric Wallace Jens Tuyls Junlin Wang Sanjay Subramanian Matt Gardner Sameer Singh MILM 79 138 0 19 Sep 2019
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 465 1,452 0 22 Aug 2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems Alex Jinpeng Wang Yada Pruksachatkun Nikita Nangia Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 281 2,327 0 02 May 2019
SciBERT: A Pretrained Language Model for Scientific Text Iz Beltagy Kyle Lo Arman Cohan 185 2,990 0 26 Mar 2019
compare-mt: A Tool for Holistic Comparison of Language Generation Systems Graham Neubig Zi-Yi Dou Junjie Hu Paul Michel Danish Pruthi Xinyi Wang John Wieting ELM 77 116 0 19 Mar 2019
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau 118 2,751 0 22 Jan 2019
Analysis Methods in Neural Language Processing: A Survey Yonatan Belinkov James R. Glass 104 558 0 21 Dec 2018
Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task Tao Yu Rui Zhang Kai-Chou Yang Michihiro Yasunaga Dongxu Wang ... Irene Li Qingning Yao Shanelle Roman Zilin Zhang Dragomir R. Radev RALM 135 1,245 0 24 Sep 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.1K 7,201 0 20 Apr 2018
Efficient Neural Architecture Search via Parameter Sharing Hieu H. Pham M. Guan Barret Zoph Quoc V. Le J. Dean 117 2,773 0 09 Feb 2018
On Calibration of Modern Neural Networks Chuan Guo Geoff Pleiss Yu Sun Kilian Q. Weinberger UQCV 299 5,877 0 14 Jun 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 498 5,385 0 05 Nov 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 918 6,799 0 26 Sep 2016
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 318 8,177 0 16 Jun 2016
Adversarial Feature Learning Jiasen Lu Philipp Krahenbuhl Trevor Darrell GAN 142 1,612 0 31 May 2016
A Neural Attention Model for Abstractive Sentence Summarization Alexander M. Rush S. Chopra Jason Weston CVBM 186 2,703 0 02 Sep 2015
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 338 4,298 0 21 Aug 2015
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 450 20,611 0 10 Sep 2014