v1v2 (latest)

A Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse

9 December 2021

Papers citing "A Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse"

44 / 44 papers shown

Title
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 458 0 0 04 May 2025
Bilevel ZOFO: Bridging Parameter-Efficient and Zeroth-Order Techniques for Efficient LLM Fine-Tuning and Meta-Training Reza Shirkavand Qi He Peiran Yu Heng-Chiao Huang ALM 99 0 0 05 Feb 2025
On Penalty-based Bilevel Gradient Descent Method Han Shen Quan-Wu Xiao Tianyi Chen 132 59 0 08 Jan 2025
Provably Faster Algorithms for Bilevel Optimization via Without-Replacement Sampling Junyi Li Heng Huang 102 1 0 07 Nov 2024
Single-Timescale Multi-Sequence Stochastic Approximation Without Fixed Point Smoothness: Theories and Applications Yue Huang Zhaoxian Wu Shiqian Ma Qing Ling 107 1 0 17 Oct 2024
A Stochastic Approach to Bi-Level Optimization for Hyperparameter Optimization and Meta Learning Minyoung Kim Timothy M. Hospedales BDL 120 0 0 14 Oct 2024
Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization Feihu Huang 101 5 0 25 Jul 2024
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints Liuyuan Jiang Quan-Wu Xiao Victor M. Tenorio Fernando Real-Rojas Antonio G. Marques Tianyi Chen 138 2 0 14 Jun 2024
Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity Yan Yang Bin Gao Ya-xiang Yuan 133 2 0 30 May 2024
Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy Risheng Liu Zhu Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 84 8 0 16 May 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace Bin Gao Yan Yang Ya-xiang Yuan 111 2 0 04 Apr 2024
Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF Han Shen Zhuoran Yang Tianyi Chen OffRL 110 15 0 10 Feb 2024
Federated Learning Can Find Friends That Are Advantageous N. Tupitsa Samuel Horváth Martin Takávc Eduard A. Gorbunov FedML 97 2 0 07 Feb 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 108 8 0 17 Jan 2024
On the Communication Complexity of Decentralized Bilevel Optimization Yihan Zhang My T. Thai Jie Wu Hongchang Gao 112 4 0 19 Nov 2023
Adaptive Mirror Descent Bilevel Optimization Feihu Huang 107 1 0 08 Nov 2023
A Challenge in Reweighting Data with Bilevel Optimization Anastasia Ivanova Pierre Ablin 115 1 0 26 Oct 2023
On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation Jeongyeol Kwon Dohyun Kwon Steve Wright Robert D. Nowak 93 30 0 04 Sep 2023
An adaptively inexact first-order method for bilevel optimization with application to hyperparameter learning Mohammad Salehi Subhadip Mukherjee Lindon Roberts Matthias Joachim Ehrhardt 107 5 0 19 Aug 2023
Non-Convex Bilevel Optimization with Time-Varying Objective Functions Sen-Fon Lin Daouda Sow Kaiyi Ji Yitao Liang Ness B. Shroff 80 4 0 07 Aug 2023
PARL: A Unified Framework for Policy Alignment in Reinforcement Learning from Human Feedback Souradip Chakraborty Amrit Singh Bedi Alec Koppel Dinesh Manocha Huazheng Wang Mengdi Wang Furong Huang 104 27 0 03 Aug 2023
Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions Xuxing Chen Tesi Xiao Krishnakumar Balasubramanian 99 26 0 21 Jun 2023
A Generalized Alternating Method for Bilevel Learning under the Polyak-Łojasiewicz Condition Quan-Wu Xiao Songtao Lu Tianyi Chen 78 2 0 04 Jun 2023
Blockwise Stochastic Variance-Reduced Methods with Parallel Speedup for Multi-Block Bilevel Optimization Quanqi Hu Zimeng Qiu Zhishuai Guo Lijun Zhang Tianbao Yang 43 5 0 30 May 2023
On Momentum-Based Gradient Methods for Bilevel Optimization with Nonconvex Lower-Level Feihu Huang 113 19 0 07 Mar 2023
Achieving Hierarchy-Free Approximation for Bilevel Programs With Equilibrium Constraints Jiayang Li Jiahao Yu Boyi Liu Zhaoran Wang Y. Nie 94 6 0 20 Feb 2023
A Lower Bound and a Near-Optimal Algorithm for Bilevel Empirical Risk Minimization Mathieu Dagréou Thomas Moreau Samuel Vaiter Pierre Ablin 109 12 0 17 Feb 2023
Communication-Efficient Federated Bilevel Optimization with Local and Global Lower Level Problems Junyi Li Feihu Huang Heng Huang FedML 75 12 0 13 Feb 2023
Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong Convexity Risheng Liu Yaohua Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 102 24 0 07 Feb 2023
Analyzing Inexact Hypergradients for Bilevel Learning Matthias Joachim Ehrhardt Lindon Roberts 61 8 0 11 Jan 2023
First-order penalty methods for bilevel optimization Zhaosong Lu Sanyou Mei 129 36 0 04 Jan 2023
Alternating Implicit Projected SGD and Its Efficient Variants for Equality-constrained Bilevel Optimization Quan-Wu Xiao Han Shen W. Yin Tianyi Chen 82 8 0 14 Nov 2022
Fast Adaptive Federated Bilevel Optimization Feihu Huang FedML 91 7 0 02 Nov 2022
BOME! Bilevel Optimization Made Easy: A Simple First-Order Approach Mao Ye B. Liu S. Wright Peter Stone Qian Liu 118 90 0 19 Sep 2022
A Single-Timescale Analysis For Stochastic Approximation With Multiple Coupled Sequences Han Shen Tianyi Chen 105 15 0 21 Jun 2022
Communication-Efficient Robust Federated Learning with Noisy Labels Junyi Li Jian Pei Heng Huang FedML 83 18 0 11 Jun 2022
Algorithmic Foundations of Empirical X-risk Minimization Tianbao Yang 147 6 0 01 Jun 2022
Multi-block Min-max Bilevel Optimization with Applications in Multi-task Deep AUC Maximization Quanqi Hu Yongjian Zhong Tianbao Yang 98 16 0 01 Jun 2022
Will Bilevel Optimizers Benefit from Loops Kaiyi Ji Mingrui Liu Yingbin Liang Lei Ying 97 41 0 27 May 2022
Local Stochastic Bilevel Optimization with Momentum-Based Variance Reduction Junyi Li Feihu Huang Heng-Chiao Huang FedML 87 27 0 03 May 2022
Distributed Dynamic Safe Screening Algorithms for Sparse Regularization Runxue Bao Xidong Wu Wenhan Xian Heng-Chiao Huang 82 1 0 23 Apr 2022
Bilevel Optimization with a Lower-level Contraction: Optimal Sample Complexity without Warm-start Riccardo Grazzi Massimiliano Pontil Saverio Salzo 99 13 0 07 Feb 2022
Enhanced Bilevel Optimization via Bregman Distance Feihu Huang Junyi Li Shangqian Gao Heng-Chiao Huang 80 33 0 26 Jul 2021
Penalty Method for Inversion-Free Deep Bilevel Optimization Akshay Mehra Jihun Hamm 143 46 0 08 Nov 2019