Delta-STN: Efficient Bilevel Optimization for Neural Networks using Structured Response Jacobians

26 October 2020

Papers citing "Delta-STN: Efficient Bilevel Optimization for Neural Networks using Structured Response Jacobians"

14 / 14 papers shown

Title
Relax and penalize: a new bilevel approach to mixed-binary hyperparameter optimization M. D. Santis Jordan Frécon Francesco Rinaldi Saverio Salzo Martin Schmidt Martin Schmidt 53 0 0 21 Aug 2023
Achieving Hierarchy-Free Approximation for Bilevel Programs With Equilibrium Constraints Jiayang Li J. Yu Boyi Liu Zhaoran Wang Y. Nie 32 6 0 20 Feb 2023
CPMLHO:Hyperparameter Tuning via Cutting Plane and Mixed-Level Optimization Shu-Bo Yang Yang Jiao Shaoyu Dou Mana Zheng Chen Zhu 17 0 0 11 Dec 2022
Gradient-based Bi-level Optimization for Deep Learning: A Survey Can Chen Xiangshan Chen Chen-li Ma Zixuan Liu Xue Liu 84 35 0 24 Jul 2022
Online Bilevel Optimization: Regret Analysis of Online Alternating Gradient Methods Davoud Ataee Tarzanagh Parvin Nazari Bojian Hou Li Shen Laura Balzano 44 10 0 06 Jul 2022
Layer-wised Model Aggregation for Personalized Federated Learning Xiaosong Ma Jie M. Zhang Song Guo Wenchao Xu FedML 16 170 0 09 May 2022
On the Convergence Theory for Hessian-Free Bilevel Algorithms Daouda Sow Kaiyi Ji Yingbin Liang 26 28 0 13 Oct 2021
Personalized Federated Learning using Hypernetworks Aviv Shamsian Aviv Navon Ethan Fetaya Gal Chechik FedML 25 324 0 08 Mar 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 48 221 0 27 Jan 2021
On Solving Minimax Optimization Locally: A Follow-the-Ridge Approach Yuanhao Wang Guodong Zhang Jimmy Ba 31 100 0 16 Oct 2019
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 104 716 0 13 Jun 2018
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 127 406 0 06 Mar 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 264 5,326 0 05 Nov 2016
Variational Optimization J. Staines David Barber DRL 65 53 0 18 Dec 2012