HPO-B: A Large-Scale Reproducible Benchmark for Black-Box HPO based on
OpenML

v1v2 (latest)

HPO-B: A Large-Scale Reproducible Benchmark for Black-Box HPO based on OpenML

11 June 2021

Sebastian Pineda Arango

ArXiv (abs)PDF HTML

Papers citing "HPO-B: A Large-Scale Reproducible Benchmark for Black-Box HPO based on OpenML"

19 / 19 papers shown

Title
MetaBox-v2: A Unified Benchmark Platform for Meta-Black-Box Optimization Zeyuan Ma Yue-Jiao Gong Hongshu Guo Wenjie Qiu Sijie Ma ... Zhiyang Huang Zechuan Huang Guojun Peng Ran Cheng Yining Ma OffRL 56 0 0 23 May 2025
DesignX: Human-Competitive Algorithm Designer for Black-Box Optimization Hongshu Guo Zeyuan Ma Yining Ma Xinglin Zhang Wei-Neng Chen Yue-Jiao Gong 194 0 0 23 May 2025
Amortized Bayesian Experimental Design for Decision-Making Daolang Huang Yujia Guo Luigi Acerbi Samuel Kaski 94 3 0 03 Jan 2025
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO Katharina Eggensperger Philip Muller Neeratyoy Mallik Matthias Feurer René Sass Aaron Klein Noor H. Awad Marius Lindauer Frank Hutter 196 104 0 14 Sep 2021
Few-Shot Bayesian Optimization with Deep Kernel Surrogates Martin Wistuba Josif Grabocka BDL 86 70 0 19 Jan 2021
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search Xuanyi Dong Yi Yang 141 714 0 02 Jan 2020
OpenML-Python: an extensible Python API for OpenML Matthias Feurer Jan N. van Rijn Arlind Kadra Pieter Gijsbers Neeratyoy Mallik Sahithya Ravi Andreas Müller Joaquin Vanschoren Frank Hutter ELM GP 78 91 0 06 Nov 2019
Achieving Robustness to Aleatoric Uncertainty with Heteroscedastic Bayesian Optimisation Ryan-Rhys Griffiths Alexander A. Aldrick Miguel García-Ortegón Vidhi R. Lalchand A. Lee 70 35 0 17 Oct 2019
Learning search spaces for Bayesian optimization: Another view of hyperparameter transfer learning Valerio Perrone Huibin Shen Matthias Seeger Cédric Archambeau Rodolphe Jenatton 68 97 0 27 Sep 2019
Hyp-RL : Hyperparameter Optimization by Reinforcement Learning H. Jomaa Josif Grabocka Lars Schmidt-Thieme 71 65 0 27 Jun 2019
Dataset2Vec: Learning Dataset Meta-Features H. Jomaa Lars Schmidt-Thieme Josif Grabocka SSL 84 62 0 27 May 2019
Meta-Learning Acquisition Functions for Transfer Learning in Bayesian Optimization Michael Volpp Lukas P. Frohlich Kirsten Fischer Andreas Doerr Stefan Falkner Frank Hutter Christian Daniel 81 85 0 04 Apr 2019
NAS-Bench-101: Towards Reproducible Neural Architecture Search Chris Ying Aaron Klein Esteban Real Eric Christiansen Kevin Patrick Murphy Frank Hutter 83 684 0 25 Feb 2019
Automatic Exploration of Machine Learning Experiments on OpenML D. Kühn Philipp Probst Janek Thomas B. Bischl AI4CE 59 20 0 28 Jun 2018
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization Lisha Li Kevin Jamieson Giulia DeSalvo Afshin Rostamizadeh Ameet Talwalkar 227 2,333 0 21 Mar 2016
XGBoost: A Scalable Tree Boosting System Tianqi Chen Carlos Guestrin 809 39,062 0 09 Mar 2016
Scalable Bayesian Optimization Using Deep Neural Networks Jasper Snoek Oren Rippel Kevin Swersky Ryan Kiros N. Satish N. Sundaram Md. Mostofa Ali Patwary P. Prabhat Ryan P. Adams BDL UQCV 95 1,045 0 19 Feb 2015
OpenML: networked science in machine learning Joaquin Vanschoren Jan N. van Rijn B. Bischl Luís Torgo FedML AI4CE 163 1,327 0 29 Jul 2014
Practical Bayesian Optimization of Machine Learning Algorithms Jasper Snoek Hugo Larochelle Ryan P. Adams 362 7,954 0 13 Jun 2012