YAHPO Gym -- An Efficient Multi-Objective Multi-Fidelity Benchmark for Hyperparameter Optimization

8 September 2021

Papers citing "YAHPO Gym -- An Efficient Multi-Objective Multi-Fidelity Benchmark for Hyperparameter Optimization"

27 / 27 papers shown

Title
Put CASH on Bandits: A Max K-Armed Problem for Automated Machine Learning Amir Rezaei Balef Claire Vernade Katharina Eggensperger 38 0 0 08 May 2025
LMEMs for post-hoc analysis of HPO Benchmarking Anton Geburek Neeratyoy Mallik Danny Stoll Xavier Bouthillier Frank Hutter 23 0 0 05 Aug 2024
Hybridizing Target- and SHAP-encoded Features for Algorithm Selection in Mixed-variable Black-box Optimization Konstantin Dietrich Raphael Patrick Prager Carola Doerr Heike Trautmann 26 0 0 10 Jul 2024
Reshuffling Resampling Splits Can Improve Generalization of Hyperparameter Optimization Thomas Nagler Lennart Schneider B. Bischl Matthias Feurer 45 2 0 24 May 2024
Trajectory-Based Multi-Objective Hyperparameter Optimization for Model Retraining Wenyu Wang Zheyi Fan Szu Hui Ng 33 0 0 24 May 2024
The Unreasonable Effectiveness Of Early Discarding After One Epoch In Neural Network Hyperparameter Optimization Romain Egele Felix Mohr Tom Viering Prasanna Balaprakash 26 5 0 05 Apr 2024
Fast Benchmarking of Asynchronous Multi-Fidelity Optimization on Zero-Cost Benchmarks Shuhei Watanabe Neeratyoy Mallik Eddie Bergman Frank Hutter 29 0 0 04 Mar 2024
Exploratory Landscape Analysis for Mixed-Variable Problems Raphael Patrick Prager Heike Trautmann 22 2 0 26 Feb 2024
Multi-Fidelity Methods for Optimization: A Survey Ke Li Fan Li AI4CE 35 6 0 15 Feb 2024
Strong convexity-guided hyper-parameter optimization for flatter losses Rahul Yedida Snehanshu Saha 21 0 0 07 Feb 2024
Datasets and Benchmarks for Nanophotonic Structure and Parametric Design Simulations Jungtaek Kim Mingxuan Li Oliver Hinder Paul W. Leu 24 1 0 29 Oct 2023
Parallel Multi-Objective Hyperparameter Optimization with Uniform Normalization and Bounded Objectives Romain Egele Tyler Chang Yixuan Sun V. Vishwanath Prasanna Balaprakash 41 2 0 26 Sep 2023
Is One Epoch All You Need For Multi-Fidelity Hyperparameter Optimization? Romain Egele Isabelle M Guyon Yixuan Sun Prasanna Balaprakash 32 2 0 28 Jul 2023
Obeying the Order: Introducing Ordered Transfer Hyperparameter Optimisation Sigrid Passano Hellan Huibin Shen Franccois-Xavier Aubet David Salinas Aaron Klein 35 1 0 29 Jun 2023
Framework and Benchmarks for Combinatorial and Mixed-variable Bayesian Optimization Kamil Dreczkowski Antoine Grosnit Haitham Bou-Ammar 24 7 0 16 Jun 2023
Multi-Fidelity Multi-Armed Bandits Revisited Xuchuang Wang Qingyun Wu Wei Chen John C. S. Lui 31 3 0 13 Jun 2023
Python Wrapper for Simulating Multi-Fidelity Optimization on HPO Benchmarks without Any Wait Shuhei Watanabe 38 1 0 27 May 2023
MO-DEHB: Evolutionary-based Hyperband for Multi-Objective Optimization Noor H. Awad Ayush Sharma Philipp Muller Janek Thomas Frank Hutter 28 1 0 08 May 2023
Optimizing Hyperparameters with Conformal Quantile Regression David Salinas Jacek Golebiowski Aaron Klein Matthias Seeger Cédric Archambeau 19 8 0 05 May 2023
Iterative Deepening Hyperband Jasmin Brandt Marcel Wever Dimitrios Iliadis Viktor Bengs Eyke Hüllermeier 11 1 0 01 Feb 2023
HPO: We won't get fooled again Kalifou René Traoré Andrés Camero Xiao Xiang Zhu 18 0 0 04 Aug 2022
Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview Florian Karl Tobias Pielok Julia Moosbauer Florian Pfisterer Stefan Coors ... Jakob Richter Michel Lang Eduardo C. Garrido-Merchán Juergen Branke B. Bischl AI4CE 26 56 0 15 Jun 2022
FedHPO-B: A Benchmark Suite for Federated Hyperparameter Optimization Zhen Wang Weirui Kuang Ce Zhang Bolin Ding Yaliang Li FedML 25 13 0 08 Jun 2022
Towards Meta-learned Algorithm Selection using Implicit Fidelity Information Aditya Mohan Tim Ruhkopf Marius Lindauer FedML 13 3 0 07 Jun 2022
A Collection of Quality Diversity Optimization Problems Derived from Hyperparameter Optimization of Machine Learning Models Lennart Schneider Florian Pfisterer Janek Thomas B. Bischl 22 3 0 28 Apr 2022
SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization Marius Lindauer Katharina Eggensperger Matthias Feurer André Biedenkapp Difan Deng C. Benjamins Tim Ruhopf René Sass Frank Hutter 85 327 0 20 Sep 2021
Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challenges B. Bischl Martin Binder Michel Lang Tobias Pielok Jakob Richter ... Theresa Ullmann Marc Becker A. Boulesteix Difan Deng Marius Lindauer 79 448 0 13 Jul 2021