Title
Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation Maria Eriksson Erasmo Purificato Arman Noroozian Joao Vinagre Guillaume Chaslot Emilia Gomez David Fernandez-Llorca ELM 198 2 0 10 Feb 2025
Evolving Hard Maximum Cut Instances for Quantum Approximate Optimization Algorithms Shuaiqun Pan Yash J. Patel Aneta Neumann Frank Neumann Thomas Bäck Hao Wang 79 0 0 30 Jan 2025
Deconstructing What Makes a Good Optimizer for Language Models Rosie Zhao Depen Morwani David Brandfonbrener Nikhil Vyas Sham Kakade 77 19 0 10 Jul 2024
Generalizability of experimental studies Federico Matteucci Vadim Arzamasov Jose Cribeiro-Ramallo Marco Heyden Konstantin Ntounas Klemens Bohm 71 0 0 25 Jun 2024
The Dynamic Travelling Thief Problem: Benchmarks and Performance of Evolutionary Algorithms Ragav Sachdeva Frank Neumann Markus Wagner 26 8 0 25 Apr 2020
Benchmarking Discrete Optimization Heuristics with IOHprofiler Carola Doerr Furong Ye Naama Horesh Hao Wang O. M. Shir Thomas Bäck 64 72 0 19 Dec 2019
Fully Parallel Hyperparameter Search: Reshaped Space-Filling Marie-Liesse Cauwet Camille Couprie J. Dehos Pauline Luc Jérémy Rapin M. Rivière F. Teytaud O. Teytaud 72 23 0 18 Oct 2019
Optuna: A Next-generation Hyperparameter Optimization Framework Takuya Akiba Shotaro Sano Toshihiko Yanase Takeru Ohta Masanori Koyama 398 5,714 0 25 Jul 2019
In a Nutshell -- The Sequential Parameter Optimization Toolbox Thomas Bartz-Beielstein Martin Zaefferer Lorenzo Gentile 23 7 0 12 Dec 2017
Automated Algorithm Selection on Continuous Black-Box Problems By Combining Exploratory Landscape Analysis and Machine Learning P. Kerschke Heike Trautmann 51 151 0 24 Nov 2017
Comprehensive Feature-Based Landscape Analysis of Continuous and Constrained Optimization Problems Using the R-Package flacco P. Kerschke 32 101 0 17 Aug 2017
COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting N. Hansen A. Auger Raymond Ros Olaf Mersmann Tea Tušar D. Brockhoff 26 421 0 29 Mar 2016
ASlib: A Benchmark Library for Algorithm Selection B. Bischl P. Kerschke Lars Kotthoff Marius Lindauer Y. Malitsky ... Holger Hoos Frank Hutter Kevin Leyton-Brown Kevin Tierney Joaquin Vanschoren 50 220 0 08 Jun 2015