Automated Mining of Leaderboards for Empirical AI Research

31 August 2021

Papers citing "Automated Mining of Leaderboards for Empirical AI Research"

23 / 23 papers shown

Title
A Position Paper on the Automatic Generation of Machine Learning Leaderboards Roelien C Timmer Yufang Hou Stephen Wan 99 0 0 23 May 2025
On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboards Zhimin Zhao A. A. Bangash F. Côgo Bram Adams Ahmed E. Hassan 91 1 0 04 Jul 2024
SemEval-2021 Task 11: NLPContributionGraph -- Structuring Scholarly NLP Contributions for a Research Knowledge Graph Jennifer D'Souza Sören Auer Ted Pedersen 48 31 0 10 Jun 2021
TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metrics Yufang Hou Charles Jochim Martin Gleize Francesca Bonin Debasis Ganguly 48 45 0 25 Jan 2021
Sentence, Phrase, and Triple Annotations to Build a Knowledge Graph of Natural Language Processing Contributions -- A Trial Dataset Jennifer D'Souza Sören Auer 22 8 0 09 Oct 2020
SciBERT-based Semantification of Bioassays in the Open Research Knowledge Graph Marco Anteghini Jennifer D'Souza V. A. M. D. Santos Sören Auer 14 3 0 16 Sep 2020
SciREX: A Challenge Dataset for Document-Level Information Extraction Sarthak Jain Madeleine van Zuylen Hannaneh Hajishirzi Iz Beltagy 37 162 0 01 May 2020
AxCell: Automatic Extraction of Results from Machine Learning Papers Marcin Kardas Piotr Czapla Pontus Stenetorp Sebastian Ruder Sebastian Riedel Ross Taylor Robert Stojnic 12 75 0 29 Apr 2020
Improving Scholarly Knowledge Representation: Evaluating BERT-based Models for Scientific Relation Classification Ming Jiang Jennifer D'Souza Sören Auer J. S. Downie 56 11 0 13 Apr 2020
TAPAS: Weakly Supervised Table Parsing via Pre-training Jonathan Herzig Pawel Krzysztof Nowak Thomas Müller Francesco Piccinno Julian Martin Eisenschlos LMTD RALM 75 640 0 05 Apr 2020
The STEM-ECR Dataset: Grounding Scientific Entity References in STEM Scholarly Content to Authoritative Encyclopedic and Lexicographic Sources Jennifer D'Souza Anett Hoppe Arthur Brack M. Y. Jaradeh Sören Auer Ralph Ewerth AILaw 32 25 0 02 Mar 2020
Annotating and Extracting Synthesis Process of All-Solid-State Batteries from Scientific Literature Fusataka Kuniyoshi Kohei Makino Jun Ozawa Makoto Miwa 52 33 0 18 Feb 2020
Identification of Tasks, Datasets, Evaluation Metrics, and Numeric Scores for Scientific Leaderboards Construction Yufang Hou Charles Jochim Martin Gleize Francesca Bonin Debasis Ganguly 21 92 0 21 Jun 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 178 8,386 0 19 Jun 2019
The Materials Science Procedural Text Corpus: Annotating Materials Synthesis Procedures with Shallow Semantic Structures Sheshera Mysore Z. Jensen Edward J. Kim Kevin Huang Haw-Shiuan Chang Emma Strubell Jeffrey Flanigan Andrew McCallum E. Olivetti 36 94 0 16 May 2019
SciBERT: A Pretrained Language Model for Scientific Text Iz Beltagy Kyle Lo Arman Cohan 75 2,948 0 26 Mar 2019
A framework for information extraction from tables in biomedical literature Nikola Milosevic C. Gregson Robert Hernandez Goran Nenadic LMTD 19 50 0 26 Feb 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai Zhilin Yang Yiming Yang J. Carbonell Quoc V. Le Ruslan Salakhutdinov VLM 133 3,707 0 09 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 882 93,936 0 11 Oct 2018
Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Construction Yi Luan Luheng He Mari Ostendorf Hannaneh Hajishirzi 89 674 0 29 Aug 2018
An Annotated Corpus for Machine Reading of Instructions in Wet Lab Protocols Chaitanya Kulkarni Wei Xu Alan Ritter R. Machiraju 54 62 0 01 May 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 427 129,831 0 12 Jun 2017
SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publications Isabelle Augenstein Mrinal Das Sebastian Riedel Lakshmi Vikraman Andrew McCallum 40 337 0 10 Apr 2017