Double Momentum Method for Lower-Level Constrained Bilevel Optimization

Double Momentum Method for Lower-Level Constrained Bilevel Optimization

25 June 2024

Bin Gu

ArXiv (abs)PDF HTML

Papers citing "Double Momentum Method for Lower-Level Constrained Bilevel Optimization"

10 / 10 papers shown

Title
On Penalty-based Bilevel Gradient Descent Method Han Shen Quan-Wu Xiao Tianyi Chen 103 58 0 08 Jan 2025
Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization Tianyi Lin Zeyu Zheng Michael I. Jordan 100 55 0 12 Sep 2022
Towards Gradient-based Bilevel Optimization with Non-convex Followers and Beyond Risheng Liu Yaohua Liu Shangzhi Zeng Jin Zhang 99 83 0 01 Oct 2021
A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum Prashant Khanduri Siliang Zeng Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 65 131 0 15 Feb 2021
Learning to solve TV regularized problems with unrolled algorithms Hamza Cherkaoui Jeremias Sulam Thomas Moreau 64 12 0 19 Oct 2020
Implicit differentiation of Lasso-type models for hyperparameter optimization Quentin Bertrand Quentin Klopfenstein Mathieu Blondel Samuel Vaiter Alexandre Gramfort Joseph Salmon 83 66 0 20 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 520 42,449 0 03 Dec 2019
Meta-Learning with Implicit Gradients Aravind Rajeswaran Chelsea Finn Sham Kakade Sergey Levine 113 855 0 10 Sep 2019
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 179 728 0 13 Jun 2018
A Regularized Framework for Sparse and Structured Neural Attention Vlad Niculae Mathieu Blondel 84 100 0 22 May 2017