Hyper-Parameter Optimization: A Review of Algorithms and Applications

12 March 2020

Papers citing "Hyper-Parameter Optimization: A Review of Algorithms and Applications"

50 / 63 papers shown

Title
Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems Shaokun Zhang Ming Yin Jieyu Zhang Jing Liu Zhiguang Han ... Beibin Li Chi Wang Hongru Wang Yuxiao Chen Qingyun Wu 111 6 0 30 Apr 2025
A Unified Hyperparameter Optimization Pipeline for Transformer-Based Time Series Forecasting Models Jingjing Xu Caesar Wu Yuan-Fang Li Grégoire Danoy Pascal Bouvry TPM AI4TS 70 0 0 03 Jan 2025
Large Language Model Agent for Hyper-Parameter Optimization Siyi Liu Chen Gao Yong Li 100 23 0 02 Feb 2024
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 475 42,407 0 03 Dec 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 137 18,115 0 28 May 2019
A Generalized Framework for Population Based Training Ang Li Ola Spyra Sagi Perel Valentin Dalibard Max Jaderberg Chenjie Gu David Budden Tim Harley Pramod Gupta 56 68 0 05 Feb 2019
Automated Machine Learning: From Principles to Practices Quanming Yao Mengshuo Wang Hugo Jair Escalante Huan Zhao Qiang Yang 60 259 0 31 Oct 2018
A System for Massively Parallel Hyperparameter Tuning Liam Li Kevin Jamieson Afshin Rostamizadeh Ekaterina Gonina Moritz Hardt Benjamin Recht Ameet Talwalkar 60 384 0 13 Oct 2018
Meta-Learning: A Survey Joaquin Vanschoren FedML OOD 63 762 0 08 Oct 2018
Collapse of Deep and Narrow Neural Nets Lu Lu Yanhui Su George Karniadakis ODL 62 155 0 15 Aug 2018
MnasNet: Platform-Aware Neural Architecture Search for Mobile Mingxing Tan Bo Chen Ruoming Pang Vijay Vasudevan Mark Sandler Andrew G. Howard Quoc V. Le MQ 117 3,009 0 31 Jul 2018
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design Ningning Ma Xiangyu Zhang Haitao Zheng Jian Sun 174 4,987 0 30 Jul 2018
Tune: A Research Platform for Distributed Model Selection and Training Richard Liaw Eric Liang Robert Nishihara Philipp Moritz Joseph E. Gonzalez Ion Stoica 209 901 0 13 Jul 2018
A Tutorial on Bayesian Optimization P. Frazier GP 104 1,786 0 08 Jul 2018
BOHB: Robust and Efficient Hyperparameter Optimization at Scale Stefan Falkner Aaron Klein Frank Hutter BDL 201 1,096 0 04 Jul 2018
Auto-Keras: An Efficient Neural Architecture Search System Haifeng Jin Qingquan Song Xia Hu 99 806 0 27 Jun 2018
Revisiting Small Batch Training for Deep Neural Networks Dominic Masters Carlo Luschi ODL 69 665 0 20 Apr 2018
Deep Learning using Rectified Linear Units (ReLU) Abien Fred Agarap 58 3,223 0 22 Mar 2018
MobileNetV2: Inverted Residuals and Linear Bottlenecks Mark Sandler Andrew G. Howard Menglong Zhu A. Zhmoginov Liang-Chieh Chen 178 19,271 0 13 Jan 2018
Combination of Hyperband and Bayesian Optimization for Hyperparameter Optimization in Deep Learning Jiazhuo Wang Jason Xu Xuejun Wang 48 72 0 05 Jan 2018
Momentum and Stochastic Momentum for Stochastic Gradient, Newton, Proximal Point and Subspace Descent Methods Nicolas Loizou Peter Richtárik 65 201 0 27 Dec 2017
The Effectiveness of Data Augmentation in Image Classification using Deep Learning Luis Perez Jason Wang 77 2,786 0 13 Dec 2017
Population Based Training of Neural Networks Max Jaderberg Valentin Dalibard Simon Osindero Wojciech M. Czarnecki Jeff Donahue ... Tim Green Iain Dunning Karen Simonyan Chrisantha Fernando Koray Kavukcuoglu 71 741 0 27 Nov 2017
Searching for Activation Functions Prajit Ramachandran Barret Zoph Quoc V. Le 64 609 0 16 Oct 2017
Neural Optimizer Search with Reinforcement Learning Irwan Bello Barret Zoph Vijay Vasudevan Quoc V. Le ODL 59 385 0 21 Sep 2017
Improved Regularization of Convolutional Neural Networks with Cutout Terrance Devries Graham W. Taylor 109 3,764 0 15 Aug 2017
Large Batch Training of Convolutional Networks Yang You Igor Gitman Boris Ginsburg ODL 128 848 0 13 Aug 2017
On the State of the Art of Evaluation in Neural Language Models Gábor Melis Chris Dyer Phil Blunsom 65 535 0 18 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 687 131,526 0 12 Jun 2017
Dealing with Integer-valued Variables in Bayesian Optimization with Gaussian Processes E.C. Garrido-Merchán Daniel Hernández-Lobato 89 231 0 12 Jun 2017
Learning the distribution with largest mean: two bandit frameworks E. Kaufmann Aurélien Garivier 48 19 0 31 Jan 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 451 5,369 0 05 Nov 2016
An overview of gradient descent optimization algorithms Sebastian Ruder ODL 204 6,184 0 15 Sep 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 334 7,984 0 23 May 2016
The CMA Evolution Strategy: A Tutorial N. Hansen 66 1,372 0 04 Apr 2016
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization Lisha Li Kevin Jamieson Giulia DeSalvo Afshin Rostamizadeh Ameet Talwalkar 222 2,327 0 21 Mar 2016
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems Martín Abadi Ashish Agarwal P. Barham E. Brevdo Zhiwen Chen ... Pete Warden Martin Wattenberg Martin Wicke Yuan Yu Xiaoqiang Zheng 269 11,152 0 14 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 193,878 0 10 Dec 2015
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems Tianqi Chen Mu Li Yutian Li Min Lin Naiyan Wang Minjie Wang Tianjun Xiao Bing Xu Chiyuan Zhang Zheng Zhang 196 2,246 0 03 Dec 2015
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 872 27,350 0 02 Dec 2015
You Only Look Once: Unified, Real-Time Object Detection Joseph Redmon S. Divvala Ross B. Girshick Ali Farhadi ObjD 686 36,935 0 08 Jun 2015
Cyclical Learning Rates for Training Neural Networks L. Smith ODL 197 2,525 0 03 Jun 2015
Fast R-CNN Ross B. Girshick ObjD 301 25,045 0 30 Apr 2015
Non-stochastic Best Arm Identification and Hyperparameter Optimization Kevin Jamieson Ameet Talwalkar 198 579 0 27 Feb 2015
Scalable Bayesian Optimization Using Deep Neural Networks Jasper Snoek Oren Rippel Kevin Swersky Ryan Kiros N. Satish N. Sundaram Md. Mostofa Ali Patwary P. Prabhat Ryan P. Adams BDL UQCV 89 1,043 0 19 Feb 2015
TuPAQ: An Efficient Planner for Large-scale Predictive Analytic Queries Evan R. Sparks Ameet Talwalkar Michael Franklin Michael I. Jordan Tim Kraska 59 25 0 31 Jan 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.8K 150,039 0 22 Dec 2014
How transferable are features in deep neural networks? J. Yosinski Jeff Clune Yoshua Bengio Hod Lipson OOD 231 8,336 0 06 Nov 2014
Caffe: Convolutional Architecture for Fast Feature Embedding Yangqing Jia Evan Shelhamer Jeff Donahue Sergey Karayev Jonathan Long Ross B. Girshick S. Guadarrama Trevor Darrell VLM BDL 3DV 271 14,707 0 20 Jun 2014
An Entropy Search Portfolio for Bayesian Optimization Bobak Shahriari Ziyun Wang Matthew W. Hoffman Alexandre Bouchard-Côté Nando de Freitas 59 57 0 18 Jun 2014