Scaling Laws for Hyperparameter Optimization

Scaling Laws for Hyperparameter Optimization

1 February 2023

Maciej Janowski

Papers citing "Scaling Laws for Hyperparameter Optimization"

12 / 12 papers shown

Title
Position: A Call to Action for a Human-Centered AutoML Paradigm Marius Lindauer Florian Karl A. Klier Julia Moosbauer Alexander Tornede Andreas Mueller Frank Hutter Matthias Feurer Bernd Bischl 41 6 0 05 Jun 2024
Cost-Sensitive Multi-Fidelity Bayesian Optimization with Transfer of Learning Curve Extrapolation Dong Bok Lee Aoxuan Silvia Zhang Byung-Hoon Kim Junhyeon Park Juho Lee Sung Ju Hwang Haebeom Lee 36 1 0 28 May 2024
Reshuffling Resampling Splits Can Improve Generalization of Hyperparameter Optimization Thomas Nagler Lennart Schneider B. Bischl Matthias Feurer 45 2 0 24 May 2024
Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Sebastian Pineda Arango Fabio Ferreira Arlind Kadra Frank Hutter Frank Hutter Josif Grabocka 42 15 0 06 Jun 2023
Deep Ranking Ensembles for Hyperparameter Optimization Abdus Salam Khazi Sebastian Pineda Arango Josif Grabocka BDL 39 7 0 27 Mar 2023
Optimizing Data Collection for Machine Learning Rafid Mahmood James Lucas J. Álvarez Sanja Fidler M. Law 96 26 0 03 Oct 2022
SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization Marius Lindauer Katharina Eggensperger Matthias Feurer André Biedenkapp Difan Deng C. Benjamins Tim Ruhopf René Sass Frank Hutter 85 330 0 20 Sep 2021
Provably Efficient Online Hyperparameter Optimization with Population-Based Bandits Jack Parker-Holder Vu Nguyen Stephen J. Roberts OffRL 75 83 0 06 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 264 4,505 0 23 Jan 2020
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 133 409 0 06 Mar 2017
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 276 5,675 0 05 Dec 2016
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 300 10,233 0 16 Nov 2016