Gradient-based Bi-level Optimization for Deep Learning: A Survey

24 July 2022

Xue Liu

Papers citing "Gradient-based Bi-level Optimization for Deep Learning: A Survey"

25 / 25 papers shown

Title
Offline Model-Based Optimization: Comprehensive Review Minsu Kim Jiayao Gu Ye Yuan Taeyoung Yun Ziqiang Liu Yoshua Bengio Can Chen OffRL 67 2 0 21 Mar 2025
Commute Your Domains: Trajectory Optimality Criterion for Multi-Domain Learning Alexey Rukhovich Alexander Podolskiy Irina Piontkovskaya 48 0 0 28 Jan 2025
AutoAL: Automated Active Learning with Differentiable Query Strategy Search Yifeng Wang Xueying Zhan Siyu Huang OOD 38 0 0 17 Oct 2024
Adapting to Distribution Shift by Visual Domain Prompt Generation Zhixiang Chi Li Gu Tao Zhong Huan Liu Yuanhao Yu Konstantinos N Plataniotis Yang Wang VLM OOD 39 7 0 05 May 2024
Fast and Efficient Local Search for Genetic Programming Based Loss Function Learning Christian Raymond Qi Chen Bing Xue Mengjie Zhang 46 2 0 01 Mar 2024
Federated Learning Can Find Friends That Are Advantageous N. Tupitsa Samuel Horváth Martin Takávc Eduard A. Gorbunov FedML 49 2 0 07 Feb 2024
Towards Hybrid-grained Feature Interaction Selection for Deep Sparse Network Fuyuan Lyu Xing Tang Dugang Liu Chen-li Ma Weihong Luo Liang Chen Xiuqiang He Xue Liu 18 2 0 23 Oct 2023
Jointly-Learned Exit and Inference for a Dynamic Neural Network : JEI-DNN Florence Regol Joud Chataoui Mark J. Coates 32 6 0 13 Oct 2023
MetaGCD: Learning to Continually Learn in Generalized Category Discovery Yanan Wu Zhixiang Chi Yang Wang Songhe Feng BDL CLL 26 26 0 21 Aug 2023
An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning Yihua Zhang Prashant Khanduri Ioannis C. Tsaknakis Yuguang Yao Min-Fong Hong Sijia Liu AI4CE 41 25 0 01 Aug 2023
Think Before You Act: Decision Transformers with Working Memory Jikun Kang Romain Laroche Xingdi Yuan Adam Trischler Xuefei Liu Jie Fu OffRL 27 0 0 24 May 2023
Class-Incremental Exemplar Compression for Class-Incremental Learning Zilin Luo Yaoyao Liu Bernt Schiele Qianru Sun VLM CLL 91 44 0 24 Mar 2023
Multi-task Meta Label Correction for Time Series Prediction Luxuan Yang Ting Gao Wei Wei Min Dai Cheng Fang Jinqiao Duan AI4TS 39 3 0 09 Mar 2023
Meta-Learning with Self-Improving Momentum Target Jihoon Tack Jongjin Park Hankook Lee Jaeho Lee Jinwoo Shin LRM 65 12 0 11 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 49 68 0 08 Oct 2022
Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts Tao Zhong Zhixiang Chi Li Gu Yang Wang Yuanhao Yu Jingshan Tang OOD 66 29 0 08 Oct 2022
Improving ProtoNet for Few-Shot Video Object Recognition: Winner of ORBIT Challenge 2022 Liming Gu Zhixiang Chi Huan Liu Yuanhao Yu Yang Wang 27 5 0 01 Oct 2022
Adapting Triplet Importance of Implicit Feedback for Personalized Recommendation Haolun Wu Chen-li Ma Yingxue Zhang Xue Liu Ruiming Tang Mark J. Coates 45 7 0 02 Aug 2022
Structure-aware Protein Self-supervised Learning Can Chen Jingbo Zhou Fan Wang Xue Liu Dejing Dou SSL 18 65 0 06 Apr 2022
Min-Max Bilevel Multi-objective Optimization with Applications in Machine Learning Alex Gu Songtao Lu Parikshit Ram Tsui-Wei Weng 40 10 0 03 Mar 2022
Inexact bilevel stochastic gradient methods for constrained and unconstrained lower-level problems Tommaso Giovannelli G. Kent Luis Nunes Vicente 33 12 0 01 Oct 2021
Probabilistic Metric Learning with Adaptive Margin for Top-K Recommendation Chen-li Ma Liheng Ma Yingxue Zhang Ruiming Tang Xue Liu Mark J. Coates 53 49 0 13 Jan 2021
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 110 716 0 13 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 359 11,684 0 09 Mar 2017
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 133 406 0 06 Mar 2017