A critical analysis of metrics used for measuring progress in artificial
intelligence

A critical analysis of metrics used for measuring progress in artificial intelligence

6 August 2020

Matthias Samwald

Papers citing "A critical analysis of metrics used for measuring progress in artificial intelligence"

11 / 11 papers shown

Title
Explaining Decisions of Agents in Mixed-Motive Games Maayan Orner Oleg Maksimov Akiva Kleinerman Charles Ortiz Sarit Kraus 99 1 0 28 Jan 2025
Pyramid-Driven Alignment: Pyramid Principle Guided Integration of Large Language Models and Knowledge Graphs Lei Sun Xinchen Wang Youdi Li RALM 34 0 0 16 Oct 2024
QMViT: A Mushroom is worth 16x16 Words Siddhant Dutta Hemant Singh Kalpita Shankhdhar Sridhar Iyer 34 0 0 11 May 2024
InspectorRAGet: An Introspection Platform for RAG Evaluation Kshitij P. Fadnis Siva Sankalp Patel O. Boni Yannis Katsis Sara Rosenthal Benjamin Sznajder Marina Danilevsky 40 2 0 26 Apr 2024
A Survey of Learning Curves with Bad Behavior: or How More Data Need Not Lead to Better Performance Marco Loog T. Viering 26 1 0 25 Nov 2022
Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements Leandro von Werra Lewis Tunstall A. Thakur A. Luccioni Tristan Thrush ... Julien Chaumond Margaret Mitchell Alexander M. Rush Thomas Wolf Douwe Kiela ELM 23 24 0 30 Sep 2022
Metaethical Perspectives on 'Benchmarking' AI Ethics Travis LaCroix A. Luccioni 30 7 0 11 Apr 2022
Mapping global dynamics of benchmark creation and saturation in artificial intelligence Simon Ott A. Barbosa-Silva Kathrin Blagec J. Brauner Matthias Samwald 32 36 0 09 Mar 2022
A curated, ontology-based, large-scale knowledge graph of artificial intelligence tasks and benchmarks Kathrin Blagec A. Barbosa-Silva Simon Ott Matthias Samwald 22 26 0 04 Oct 2021
How to avoid machine learning pitfalls: a guide for academic researchers M. Lones VLM FaML OnRL 62 77 0 05 Aug 2021
The Shape of Learning Curves: a Review T. Viering Marco Loog 18 122 0 19 Mar 2021