An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning

1 August 2023

Papers citing "An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning"

20 / 20 papers shown

Title
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 130 0 0 04 May 2025
Scalable Meta-Learning via Mixed-Mode Differentiation Iurii Kemaev Dan A Calian Luisa M Zintgraf Gregory Farquhar H. V. Hasselt 57 0 0 01 May 2025
Think Smarter not Harder: Adaptive Reasoning with Inference Aware Optimization Zishun Yu Tengyu Xu Di Jin Karthik Abinav Sankararaman Yun He ... Eryk Helenowski Chen Zhu Sinong Wang Hao Ma Han Fang LRM 54 4 0 29 Jan 2025
WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models Jinghan Jia Jiancheng Liu Yihua Zhang Parikshit Ram Nathalie Baracaldo Sijia Liu MU 35 2 0 23 Oct 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace Bin Gao Yan Yang Ya-xiang Yuan 39 2 0 04 Apr 2024
Robust Mixture-of-Expert Training for Convolutional Neural Networks Yihua Zhang Ruisi Cai Tianlong Chen Guanhua Zhang Huan Zhang Pin-Yu Chen Shiyu Chang Zhangyang Wang Sijia Liu MoE AAML OOD 34 16 0 19 Aug 2023
Adversarial Training Should Be Cast as a Non-Zero-Sum Game Alexander Robey Fabian Latorre George J. Pappas Hamed Hassani V. Cevher AAML 66 12 0 19 Jun 2023
Robustness-preserving Lifelong Learning via Dataset Condensation Jinghan Jia Yihua Zhang Dogyoon Song Sijia Liu Alfred Hero DD 28 4 0 07 Mar 2023
BOME! Bilevel Optimization Made Easy: A Simple First-Order Approach Mao Ye B. Liu S. Wright Peter Stone Qian Liu 72 82 0 19 Sep 2022
Gradient-based Bi-level Optimization for Deep Learning: A Survey Can Chen Xiangshan Chen Chen-li Ma Zixuan Liu Xue Liu 86 35 0 24 Jul 2022
A framework for bilevel optimization that enables stochastic and global variance reduction algorithms Mathieu Dagréou Pierre Ablin Samuel Vaiter Thomas Moreau 139 96 0 31 Jan 2022
Amortized Implicit Differentiation for Stochastic Bilevel Optimization Michael Arbel Julien Mairal 105 58 0 29 Nov 2021
Predicting Flat-Fading Channels via Meta-Learned Closed-Form Linear Filters and Equilibrium Propagation Sangwoo Park Osvaldo Simeone 34 8 0 01 Oct 2021
Sign-MAML: Efficient Model-Agnostic Meta-Learning by SignSGD Chen Fan Parikshit Ram Sijia Liu FedML 61 16 0 15 Sep 2021
Learning to Continuously Optimize Wireless Resource in a Dynamic Environment: A Bilevel Optimization Perspective Haoran Sun Wenqiang Pu Xiao Fu Tsung-Hui Chang Mingyi Hong 42 30 0 03 May 2021
Does Invariant Risk Minimization Capture Invariance? Pritish Kamath Akilesh Tangella Danica J. Sutherland Nathan Srebro OOD 196 125 0 04 Jan 2021
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML Aniruddh Raghu M. Raghu Samy Bengio Oriol Vinyals 177 639 0 19 Sep 2019
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 110 716 0 13 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 338 11,684 0 09 Mar 2017
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 127 406 0 06 Mar 2017