Forward and Reverse Gradient-Based Hyperparameter Optimization

6 March 2017

Luca Franceschi

Papers citing "Forward and Reverse Gradient-Based Hyperparameter Optimization"

44 / 94 papers shown

Title
Meta Mirror Descent: Optimiser Learning for Fast Convergence Boyan Gao Henry Gouk Haebeom Lee Timothy M. Hospedales 27 6 0 05 Mar 2022
Amortized Proximal Optimization Juhan Bae Paul Vicol Jeff Z. HaoChen Roger C. Grosse ODL 25 14 0 28 Feb 2022
Short-answer scoring with ensembles of pretrained language models Christopher M. Ormerod 36 8 0 23 Feb 2022
Tutorial on amortized optimization Brandon Amos OffRL 75 43 0 01 Feb 2022
Unbiased Gradient Estimation in Unrolled Computation Graphs with Persistent Evolution Strategies Paul Vicol Luke Metz Jascha Narain Sohl-Dickstein 27 67 0 27 Dec 2021
CONFAIR: Configurable and Interpretable Algorithmic Fairness Ankit Kulshrestha Ilya Safro FaML 22 2 0 17 Nov 2021
On Training Implicit Models Zhengyang Geng Xinyu Zhang Shaojie Bai Yisen Wang Zhouchen Lin 61 69 0 09 Nov 2021
Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiation Ross M. Clarke E. T. Oldewage José Miguel Hernández-Lobato 28 9 0 20 Oct 2021
HRKD: Hierarchical Relational Knowledge Distillation for Cross-domain Language Model Compression Chenhe Dong Yaliang Li Ying Shen Minghui Qiu VLM 34 7 0 16 Oct 2021
On the Convergence Theory for Hessian-Free Bilevel Algorithms Daouda Sow Kaiyi Ji Yingbin Liang 26 28 0 13 Oct 2021
Value-Function-based Sequential Minimization for Bi-level Optimization Risheng Liu Xuan Liu Shangzhi Zeng Jin Zhang Yixuan Zhang 40 30 0 11 Oct 2021
Online Hyperparameter Meta-Learning with Hypergradient Distillation Haebeom Lee Hayeon Lee Jaewoong Shin Eunho Yang Timothy M. Hospedales Sung Ju Hwang DD 20 2 0 06 Oct 2021
Towards Gradient-based Bilevel Optimization with Non-convex Followers and Beyond Risheng Liu Yaohua Liu Shangzhi Zeng Jin Zhang 19 80 0 01 Oct 2021
Data Summarization via Bilevel Optimization Zalan Borsos Mojmír Mutný Marco Tagliasacchi Andreas Krause 30 8 0 26 Sep 2021
Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challenges B. Bischl Martin Binder Michel Lang Tobias Pielok Jakob Richter ... Theresa Ullmann Marc Becker A. Boulesteix Difan Deng Marius Lindauer 79 448 0 13 Jul 2021
A Value-Function-based Interior-point Method for Non-convex Bi-level Optimization Risheng Liu Xuan Liu Xiaoming Yuan Shangzhi Zeng Jin Zhang 13 79 0 15 Jun 2021
Graph Contrastive Learning Automated Yuning You Tianlong Chen Yang Shen Zhangyang Wang 24 447 0 10 Jun 2021
Provably Faster Algorithms for Bilevel Optimization Junjie Yang Kaiyi Ji Yingbin Liang 46 132 0 08 Jun 2021
An End-to-End Framework for Molecular Conformation Generation via Bilevel Programming Minkai Xu Wujie Wang Shitong Luo Chence Shi Yoshua Bengio Rafael Gómez-Bombarelli Jian Tang 3DV 37 78 0 15 May 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 59 222 0 27 Jan 2021
Discrete Graph Structure Learning for Forecasting Multiple Time Series Chao Shang Jie Chen J. Bi CML BDL AI4TS 108 227 0 18 Jan 2021
Convergence Properties of Stochastic Hypergradients Riccardo Grazzi Massimiliano Pontil Saverio Salzo 17 26 0 13 Nov 2020
Delta-STN: Efficient Bilevel Optimization for Neural Networks using Structured Response Jacobians Juhan Bae Roger C. Grosse 27 24 0 26 Oct 2020
Bilevel Optimization: Convergence Analysis and Enhanced Design Kaiyi Ji Junjie Yang Yingbin Liang 28 245 0 15 Oct 2020
BOML: A Modularized Bilevel Optimization Library in Python for Meta Learning Yaohua Liu Risheng Liu 25 10 0 28 Sep 2020
Improved Bilevel Model: Fast and Optimal Algorithm with Theoretical Guarantee Junyi Li Bin Gu Heng-Chiao Huang 16 41 0 01 Sep 2020
On the Iteration Complexity of Hypergradient Computation Riccardo Grazzi Luca Franceschi Massimiliano Pontil Saverio Salzo 48 192 0 29 Jun 2020
UFO-BLO: Unbiased First-Order Bilevel Optimization Valerii Likhosherstov Xingyou Song K. Choromanski Jared Davis Adrian Weller 32 7 0 05 Jun 2020
Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond Risheng Liu Zi Li Xin-Yue Fan Chenying Zhao Hao Huang Zhongxuan Luo 3DH 19 32 0 30 Apr 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 49 1,928 0 11 Apr 2020
Robust Federated Learning Through Representation Matching and Adaptive Hyper-parameters Hesham Mostafa FedML 23 39 0 30 Dec 2019
Understanding and Robustifying Differentiable Architecture Search Arber Zela T. Elsken Tonmoy Saikia Yassine Marrakchi Thomas Brox Frank Hutter OOD AAML 66 366 0 20 Sep 2019
AutoML: A Survey of the State-of-the-Art Xin He Kaiyong Zhao X. Chu 20 1,420 0 02 Aug 2019
Meta-Learning via Learned Loss Sarah Bechtle Artem Molchanov Yevgen Chebotar Edward Grefenstette Ludovic Righetti Gaurav Sukhatme Franziska Meier 18 110 0 12 Jun 2019
Learning What and Where to Transfer Yunhun Jang Hankook Lee Sung Ju Hwang Jinwoo Shin 6 148 0 15 May 2019
Addressing the Loss-Metric Mismatch with Adaptive Loss Alignment Chen Huang Shuangfei Zhai Walter A. Talbott Miguel Angel Bautista Shi Sun Carlos Guestrin J. Susskind 26 75 0 15 May 2019
Software Engineering for Fairness: A Case Study with Hyperparameter Optimization Joymallya Chakraborty Tianpei Xia F. M. Fahid Tim Menzies FaML 22 40 0 14 May 2019
Reducing The Search Space For Hyperparameter Optimization Using Group Sparsity Minsu Cho C. Hegde 14 11 0 24 Apr 2019
Truncated Back-propagation for Bilevel Optimization Amirreza Shaban Ching-An Cheng Nathan Hatch Byron Boots 24 261 0 25 Oct 2018
Far-HO: A Bilevel Programming Package for Hyperparameter Optimization and Meta-Learning Luca Franceschi Riccardo Grazzi Massimiliano Pontil Saverio Salzo P. Frasconi 17 2 0 13 Jun 2018
Meta-Gradient Reinforcement Learning Zhongwen Xu H. V. Hasselt David Silver 11 324 0 24 May 2018
Stochastic Hyperparameter Optimization through Hypernetworks Jonathan Lorraine David Duvenaud 30 139 0 26 Feb 2018
A Bridge Between Hyperparameter Optimization and Learning-to-learn Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 35 20 0 18 Dec 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,329 0 05 Nov 2016