Truncated Back-propagation for Bilevel Optimization

25 October 2018

Papers citing "Truncated Back-propagation for Bilevel Optimization"

50 / 166 papers shown

Title
Scalable Meta-Learning via Mixed-Mode Differentiation Iurii Kemaev Dan A Calian Luisa M Zintgraf Gregory Farquhar H. V. Hasselt 57 0 0 01 May 2025
Group-robust Sample Reweighting for Subpopulation Shifts via Influence Functions Rui Qiao Zhaoxuan Wu Jingtan Wang Pang Wei Koh Bryan Kian Hsiang Low OOD 53 2 0 10 Mar 2025
PRDP: Progressively Refined Differentiable Physics Kanishk Bhatia Felix Koehler Nils Thuerey AI4CE 66 0 0 26 Feb 2025
Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy Chen Wang Kaiyi Ji Junyi Geng Zhongqiang Ren Taimeng Fu ... Yi Du Qihang Li Yuqing Yang Xiao Lin Zhipeng Zhao SSL 86 9 0 28 Jan 2025
On Penalty-based Bilevel Gradient Descent Method Han Shen Quan-Wu Xiao Tianyi Chen 60 51 0 08 Jan 2025
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 46 3 0 31 Dec 2024
Memory-Reduced Meta-Learning with Guaranteed Convergence Honglin Yang Ji Ma Xiao Yu 74 0 0 16 Dec 2024
Provably Faster Algorithms for Bilevel Optimization via Without-Replacement Sampling Junyi Li Heng Huang 39 1 0 07 Nov 2024
Single-Timescale Multi-Sequence Stochastic Approximation Without Fixed Point Smoothness: Theories and Applications Yue Huang Zhaoxian Wu Shiqian Ma Qing Ling 31 1 0 17 Oct 2024
Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparator Siyuan Xu Minghui Zhu OffRL 30 1 0 13 Oct 2024
A New First-Order Meta-Learning Algorithm with Convergence Guarantees El Mahdi Chayti Martin Jaggi 25 1 0 05 Sep 2024
Flexora: Flexible Low Rank Adaptation for Large Language Models Chenxing Wei Yao Shu Ying Tiffany He Fei Richard Yu AI4CE 31 3 0 20 Aug 2024
Narrowing the Focus: Learned Optimizers for Pretrained Models Gus Kristiansen Mark Sandler A. Zhmoginov Nolan Miller Anirudh Goyal Jihwan Lee Max Vladymyrov 39 1 0 17 Aug 2024
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting Rui Pan Jipeng Zhang Xingyuan Pan Renjie Pi Xiaoyu Wang Tong Zhang 58 5 0 28 Jun 2024
Trace is the New AutoDiff -- Unlocking Efficient Optimization of Computational Workflows Ching-An Cheng Allen Nie Adith Swaminathan AI4CE 33 12 0 23 Jun 2024
Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimization Qianli Shen Yezhen Wang Zhouhao Yang Xiang Li Haonan Wang Yang Zhang Jonathan Scarlett Zhanxing Zhu Kenji Kawaguchi AI4CE 69 4 0 20 Jun 2024
First-Order Methods for Linearly Constrained Bilevel Optimization Guy Kornowski Swati Padmanabhan Kai Wang Zhe Zhang S. Sra 75 5 0 18 Jun 2024
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints Liuyuan Jiang Quan-Wu Xiao Victor M. Tenorio Fernando Real-Rojas Antonio G. Marques Tianyi Chen 48 1 0 14 Jun 2024
Let Go of Your Labels with Unsupervised Transfer Artyom Gadetsky Yulun Jiang Maria Brbić VLM 40 6 0 11 Jun 2024
Watermarking Counterfactual Explanations Hangzhi Guo Amulya Yadav AAML 35 0 0 29 May 2024
Calibrated Dataset Condensation for Faster Hyperparameter Search Mucong Ding Yuancheng Xu Tahseen Rabbani Xiaoyu Liu Brian J Gravelle Teresa M. Ranadive Tai-Ching Tuan Furong Huang DD 34 0 0 27 May 2024
Derivatives of Stochastic Gradient Descent F. Iutzeler Edouard Pauwels Samuel Vaiter 42 1 0 24 May 2024
Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization Chris Junchi Li 56 0 0 01 May 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace Bin Gao Yan Yang Ya-xiang Yuan 39 2 0 04 Apr 2024
Functional Bilevel Optimization for Machine Learning Ieva Petrulionyte Julien Mairal Michael Arbel 51 2 0 29 Mar 2024
Challenging Forgets: Unveiling the Worst-Case Forget Sets in Machine Unlearning Chongyu Fan Jiancheng Liu Alfred Hero Sijia Liu MU 32 28 0 12 Mar 2024
Fast and Efficient Local Search for Genetic Programming Based Loss Function Learning Christian Raymond Qi Chen Bing Xue Mengjie Zhang 43 2 0 01 Mar 2024
Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF Han Shen Zhuoran Yang Tianyi Chen OffRL 37 14 0 10 Feb 2024
Constrained Bi-Level Optimization: Proximal Lagrangian Value function Approach and Hessian-free Algorithm Wei-Ting Yao Chengming Yu Shangzhi Zeng Jin Zhang 23 13 0 29 Jan 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 30 7 0 17 Jan 2024
A First-Order Multi-Gradient Algorithm for Multi-Objective Bi-Level Optimization Feiyang Ye Baijiong Lin Xiao-Qun Cao Yu Zhang Ivor Tsang 50 6 0 17 Jan 2024
BrainWash: A Poisoning Attack to Forget in Continual Learning Ali Abbasi Parsa Nooralinejad Hamed Pirsiavash Soheil Kolouri CLL KELM AAML 32 5 0 20 Nov 2023
A Single-Loop Algorithm for Decentralized Bilevel Optimization Youran Dong Shiqian Ma Junfeng Yang Chao Yin 33 7 0 15 Nov 2023
Embarassingly Simple Dataset Distillation Yunzhen Feng Ramakrishna Vedantam Julia Kempe DD 36 5 0 13 Nov 2023
When Meta-Learning Meets Online and Continual Learning: A Survey Jaehyeon Son Soochan Lee Gunhee Kim OOD CLL 32 10 0 09 Nov 2023
Series of Hessian-Vector Products for Tractable Saddle-Free Newton Optimisation of Neural Networks E. T. Oldewage Ross M. Clarke José Miguel Hernández-Lobato ODL 17 1 0 23 Oct 2023
Projection-Free Methods for Stochastic Simple Bilevel Optimization with Convex Lower-level Problem Jincheng Cao Ruichen Jiang Nazanin Abolfazli E. Y. Hamedani Aryan Mokhtari 84 8 0 15 Aug 2023
Non-Convex Bilevel Optimization with Time-Varying Objective Functions Sen-Fon Lin Daouda Sow Kaiyi Ji Yitao Liang Ness B. Shroff 36 2 0 07 Aug 2023
Novel Class Discovery for Long-tailed Recognition Zhang Chuyu Rui Xu Xuming He 29 16 0 06 Aug 2023
An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning Yihua Zhang Prashant Khanduri Ioannis C. Tsaknakis Yuguang Yao Min-Fong Hong Sijia Liu AI4CE 41 25 0 01 Aug 2023
Doubly Robust Instance-Reweighted Adversarial Training Daouda Sow Sen-Fon Lin Zhangyang Wang Yitao Liang AAML OOD 33 2 0 01 Aug 2023
Learning with Constraint Learning: New Perspective, Solution Strategy and Various Applications Risheng Liu Jiaxin Gao Xuan Liu Xin-Yue Fan 37 9 0 28 Jul 2023
Accelerating Inexact HyperGradient Descent for Bilevel Optimization Hai-Long Yang Luo Luo C. J. Li Michael I. Jordan 23 13 0 30 Jun 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles Le‐Yu Chen Yaohua Ma Junzhe Zhang 84 2 0 26 Jun 2023
Differentiable Instruction Optimization for Cross-Task Generalization Masaru Isonuma Junichiro Mori Ichiro Sakata 29 0 0 16 Jun 2023
Probabilistic Unrolling: Scalable, Inverse-Free Maximum Likelihood Estimation for Latent Gaussian Models Alexander Lin Bahareh Tolooshams Yves Atchadé Demba E. Ba 36 1 0 05 Jun 2023
Federated Multi-Sequence Stochastic Approximation with Local Hypergradient Estimation Davoud Ataee Tarzanagh Mingchen Li Pranay Sharma Samet Oymak 24 0 0 02 Jun 2023
SimFBO: Towards Simple, Flexible and Communication-efficient Federated Bilevel Learning Yifan Yang Peiyao Xiao Kaiyi Ji FedML 24 14 0 30 May 2023
BiSLS/SPS: Auto-tune Step Sizes for Stable Bi-level Optimization Chen Fan Gaspard Choné-Ducasse Mark W. Schmidt Christos Thrampoulidis 19 3 0 30 May 2023
Sharpness-Aware Data Poisoning Attack Pengfei He Han Xu J. Ren Yingqian Cui Hui Liu Charu C. Aggarwal Jiliang Tang AAML 41 7 0 24 May 2023