Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions

21 June 2023

Papers citing "Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions"

23 / 23 papers shown

Title
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 230 0 0 04 May 2025
On the Convergence of Adam-Type Algorithm for Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 58 0 0 05 Mar 2025
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 62 3 0 31 Dec 2024
Exploring the Generalization Capabilities of AID-based Bi-level Optimization C. L. Philip Chen Li Shen Zhiqiang Xu Wen Liu Zhi-Quan Luo Peilin Zhao 73 1 0 25 Nov 2024
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 42 0 0 25 Oct 2024
Single-Timescale Multi-Sequence Stochastic Approximation Without Fixed Point Smoothness: Theories and Applications Yue Huang Zhaoxian Wu Shiqian Ma Qing Ling 41 1 0 17 Oct 2024
SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection Han Shen Pin-Yu Chen Payel Das Tianyi Chen ALM 36 15 0 09 Oct 2024
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 55 2 0 28 Sep 2024
Fast Two-Time-Scale Stochastic Gradient Method with Applications in Reinforcement Learning Sihan Zeng Thinh T. Doan 56 5 0 15 May 2024
Fully Zeroth-Order Bilevel Programming via Gaussian Smoothing Alireza Aghasi Saeed Ghadimi 41 2 0 29 Mar 2024
Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF Han Shen Zhuoran Yang Tianyi Chen OffRL 45 14 0 10 Feb 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 33 7 0 17 Jan 2024
An adaptively inexact first-order method for bilevel optimization with application to hyperparameter learning Mohammad Salehi Subhadip Mukherjee Lindon Roberts Matthias Joachim Ehrhardt 31 5 0 19 Aug 2023
Stochastic Controlled Averaging for Federated Learning with Communication Compression Xinmeng Huang Ping Li Xiaoyun Li 43 199 0 16 Aug 2023
Stochastic Nested Compositional Bi-level Optimization for Robust Feature Learning Xuxing Chen Krishnakumar Balasubramanian Saeed Ghadimi 28 1 0 11 Jul 2023
Momentum Benefits Non-IID Federated Learning Simply and Provably Ziheng Cheng Xinmeng Huang Pengfei Wu Kun Yuan FedML 37 17 0 28 Jun 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles Le‐Yu Chen Yaohua Ma Jiaming Zhang 86 2 0 26 Jun 2023
BOME! Bilevel Optimization Made Easy: A Simple First-Order Approach Mao Ye B. Liu S. Wright Peter Stone Qian Liu 72 83 0 19 Sep 2022
A framework for bilevel optimization that enables stochastic and global variance reduction algorithms Mathieu Dagréou Pierre Ablin Samuel Vaiter Thomas Moreau 143 96 0 31 Jan 2022
Amortized Implicit Differentiation for Stochastic Bilevel Optimization Michael Arbel Julien Mairal 105 58 0 29 Nov 2021
Solving Stochastic Compositional Optimization is Nearly as Easy as Solving Stochastic Optimization Tianyi Chen Yuejiao Sun W. Yin 48 81 0 25 Aug 2020
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 112 718 0 13 Jun 2018
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 133 409 0 06 Mar 2017