Stabilizing Bi-Level Hyperparameter Optimization using Moreau-Yosida Regularization

27 July 2020

Papers citing "Stabilizing Bi-Level Hyperparameter Optimization using Moreau-Yosida Regularization"

12 / 12 papers shown

Title
Penalty Method for Inversion-Free Deep Bilevel Optimization Akshay Mehra Jihun Hamm 90 46 0 08 Nov 2019
Auptimizer -- an Extensible, Open-Source Framework for Hyperparameter Tuning Jiayi Liu S. Tripathi Unmesh Kurup Mohak Shah 52 18 0 06 Nov 2019
Variable Metric Proximal Gradient Method with Diagonal Barzilai-Borwein Stepsize Youngsuk Park Sauptik Dhar Stephen P. Boyd Mohak Shah 33 26 0 15 Oct 2019
Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions M. Mackay Paul Vicol Jonathan Lorraine David Duvenaud Roger C. Grosse 78 164 0 07 Mar 2019
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 179 728 0 13 Jun 2018
Stochastic Hyperparameter Optimization through Hypernetworks Jonathan Lorraine David Duvenaud 74 140 0 26 Feb 2018
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 213 417 0 06 Mar 2017
AdaNet: Adaptive Structural Learning of Artificial Neural Networks Corinna Cortes X. Gonzalvo Vitaly Kuznetsov M. Mohri Scott Yang 83 285 0 05 Jul 2016
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization Lisha Li Kevin Jamieson Giulia DeSalvo Afshin Rostamizadeh Ameet Talwalkar 227 2,329 0 21 Mar 2016
Hyperparameter optimization with approximate gradient Fabian Pedregosa 109 450 0 07 Feb 2016
Gradient-based Hyperparameter Optimization through Reversible Learning D. Maclaurin David Duvenaud Ryan P. Adams DD 227 945 0 11 Feb 2015
Practical Bayesian Optimization of Machine Learning Algorithms Jasper Snoek Hugo Larochelle Ryan P. Adams 359 7,942 0 13 Jun 2012