Truncated Back-propagation for Bilevel Optimization

25 October 2018

Papers citing "Truncated Back-propagation for Bilevel Optimization"

50 / 166 papers shown

Title
One-step differentiation of iterative algorithms Jérôme Bolte Edouard Pauwels Samuel Vaiter 69 13 0 23 May 2023
Effective Bilevel Optimization via Minimax Reformulation Xiaoyu Wang Rui Pan Renjie Pi Tong Zhang 42 1 0 22 May 2023
Low-Variance Gradient Estimation in Unrolled Computation Graphs with ES-Single Paul Vicol Zico Kolter Kevin Swersky 18 6 0 21 Apr 2023
Predictive Heterogeneity: Measures and Applications Jiashuo Liu Jiayun Wu Yangqiu Song Peng Cui 25 1 0 01 Apr 2023
Achieving Hierarchy-Free Approximation for Bilevel Programs With Equilibrium Constraints Jiayang Li Jiahao Yu Boyi Liu Zhaoran Wang Y. Nie 35 6 0 20 Feb 2023
Nystrom Method for Accurate and Scalable Implicit Differentiation Ryuichiro Hataya M. Yamada ODL 34 7 0 20 Feb 2023
Communication-Efficient Federated Bilevel Optimization with Local and Global Lower Level Problems Junyi Li Feihu Huang Heng Huang FedML 27 12 0 13 Feb 2023
Hierarchical Optimization-Derived Learning Risheng Liu Xuan Liu Shangzhi Zeng Jin Zhang Yixuan Zhang 28 3 0 11 Feb 2023
Achieving Linear Speedup in Non-IID Federated Bilevel Learning Minhui Huang Dewei Zhang Kaiyi Ji FedML 27 18 0 10 Feb 2023
Communication-Efficient Federated Hypergradient Computation via Aggregated Iterative Differentiation Peiyao Xiao Kaiyi Ji FedML 32 10 0 09 Feb 2023
Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong Convexity Risheng Liu Yaohua Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 32 24 0 07 Feb 2023
Efficient Gradient Approximation Method for Constrained Bilevel Optimization Siyuan Xu Minghui Zhu 29 20 0 03 Feb 2023
Follower Agnostic Methods for Stackelberg Games C. Maheshwari James Cheng S. S. Sasty Lillian J. Ratliff Eric Mazumdar 30 1 0 02 Feb 2023
Model Agnostic Sample Reweighting for Out-of-Distribution Learning Xiao Zhou Yong Lin Renjie Pi Weizhong Zhang Renzhe Xu Peng Cui Tong Zhang OODD 39 60 0 24 Jan 2023
Analyzing Inexact Hypergradients for Bilevel Learning Matthias Joachim Ehrhardt Lindon Roberts 24 8 0 11 Jan 2023
On Finding Small Hyper-Gradients in Bilevel Optimization: Hardness Results and Improved Analysis Le‐Yu Chen Jing Xu Junzhe Zhang 29 11 0 02 Jan 2023
On Implicit Bias in Overparameterized Bilevel Optimization Paul Vicol Jon Lorraine Fabian Pedregosa David Duvenaud Roger C. Grosse AI4CE 33 37 0 28 Dec 2022
CPMLHO:Hyperparameter Tuning via Cutting Plane and Mixed-Level Optimization Shu-Bo Yang Yang Jiao Shaoyu Dou Mana Zheng Chen Zhu 25 0 0 11 Dec 2022
DIAMOND: Taming Sample and Communication Complexities in Decentralized Bilevel Optimization Pei-Yuan Qiu Yining Li Zhuqing Liu Prashant Khanduri Jia Liu Ness B. Shroff Elizabeth S. Bentley K. Turck 16 4 0 05 Dec 2022
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming Parvin Nazari Ahmad Mousavi Davoud Ataee Tarzanagh George Michailidis 28 4 0 08 Nov 2022
Fast Adaptive Federated Bilevel Optimization Feihu Huang FedML 20 7 0 02 Nov 2022
Passage-Mask: A Learnable Regularization Strategy for Retriever-Reader Models Shujian Zhang Chengyue Gong Xingchao Liu RALM 49 6 0 02 Nov 2022
Improving Object-centric Learning with Query Optimization Baoxiong Jia Yu Liu Siyuan Huang OCL 29 49 0 17 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 49 68 0 08 Oct 2022
On Stability and Generalization of Bilevel Optimization Problem Meng Ding Ming Lei Yunwen Lei Di Wang Jinhui Xu 32 0 0 03 Oct 2022
Learning Symbolic Model-Agnostic Loss Functions via Meta-Learning Christian Raymond Qi Chen Bing Xue Mengjie Zhang FedML 29 11 0 19 Sep 2022
BOME! Bilevel Optimization Made Easy: A Simple First-Order Approach Mao Ye B. Liu S. Wright Peter Stone Qian Liu 72 82 0 19 Sep 2022
Differentiable Bilevel Programming for Stackelberg Congestion Games Jiayang Li Jiahao Yu Qianni Wang Boyi Liu Zhaoran Wang Y. Nie 31 13 0 15 Sep 2022
Graph Contrastive Learning with Personalized Augmentation X. Zhang Qiaoyu Tan Xiao Shi Huang Bo-wen Li 41 15 0 14 Sep 2022
Simple and Effective Gradient-Based Tuning of Sequence-to-Sequence Models Jared Lichtarge Chris Alberti Shankar Kumar 37 4 0 10 Sep 2022
Gradient-based Bi-level Optimization for Deep Learning: A Survey Can Chen Xiangshan Chen Chen-li Ma Zixuan Liu Xue Liu 94 35 0 24 Jul 2022
Federated Learning on Adaptively Weighted Nodes by Bilevel Optimization Yan Huang Qihang Lin N. Street Stephen Seung-Yeob Baek FedML 30 9 0 21 Jul 2022
Theseus: A Library for Differentiable Nonlinear Optimization Luis Pineda Taosha Fan Maurizio Monge S. Venkataraman Paloma Sodhi ... Austin S. Wang Stuart Anderson Jing Dong Brandon Amos Mustafa Mukadam 29 76 0 19 Jul 2022
Online Bilevel Optimization: Regret Analysis of Online Alternating Gradient Methods Davoud Ataee Tarzanagh Parvin Nazari Bojian Hou Li Shen Laura Balzano 47 10 0 06 Jul 2022
Object Representations as Fixed Points: Training Iterative Refinement Algorithms with Implicit Differentiation Michael Chang Thomas L. Griffiths Sergey Levine OCL 59 58 0 02 Jul 2022
A Conditional Gradient-based Method for Simple Bilevel Optimization with Convex Lower-level Problem Ruichen Jiang Nazanin Abolfazli Aryan Mokhtari E. Y. Hamedani 40 21 0 17 Jun 2022
Two-Timescale Stochastic Approximation for Bilevel Optimisation Problems in Continuous-Time Models Louis Sharrock 20 2 0 14 Jun 2022
Value Function Based Difference-of-Convex Algorithm for Bilevel Hyperparameter Selection Problems Lucy L. Gao J. Ye Haian Yin Shangzhi Zeng Jin Zhang 29 23 0 13 Jun 2022
Enhancing Distributional Stability among Sub-populations Jiashuo Liu Jiayun Wu Jie Peng Xiaoyu Wu Zheyan Shen Yangqiu Song Peng Cui OOD 23 2 0 07 Jun 2022
RoCourseNet: Distributionally Robust Training of a Prediction Aware Recourse Model Hangzhi Guo Feiran Jia Jinghui Chen Anna Squicciarini A. Yadav OOD 31 7 0 01 Jun 2022
Algorithmic Foundations of Empirical X-risk Minimization Tianbao Yang 38 5 0 01 Jun 2022
Will Bilevel Optimizers Benefit from Loops Kaiyi Ji Mingrui Liu Yingbin Liang Lei Ying 45 41 0 27 May 2022
Self-Guided Noise-Free Data Generation for Efficient Zero-Shot Learning Jiahui Gao Renjie Pi Yong Lin Hang Xu Jiacheng Ye Zhiyong Wu Weizhong Zhang Xiaodan Liang Zhenguo Li Lingpeng Kong SyDa VLM 70 45 0 25 May 2022
Beyond backpropagation: bilevel optimization through implicit differentiation and equilibrium propagation Nicolas Zucchet João Sacramento 28 15 0 06 May 2022
FedNest: Federated Bilevel, Minimax, and Compositional Optimization Davoud Ataee Tarzanagh Mingchen Li Christos Thrampoulidis Samet Oymak FedML 42 73 0 04 May 2022
Local Stochastic Bilevel Optimization with Momentum-Based Variance Reduction Junyi Li Feihu Huang Heng-Chiao Huang FedML 19 27 0 03 May 2022
Learning to Scaffold: Optimizing Model Explanations for Teaching Patrick Fernandes Marcos Vinícius Treviso Danish Pruthi André F. T. Martins Graham Neubig FAtt 25 22 0 22 Apr 2022
Equivariance Discovery by Learned Parameter-Sharing Raymond A. Yeh Yuan-Ting Hu M. Hasegawa-Johnson A. Schwing FedML 29 14 0 07 Apr 2022
A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimization Ziyi Chen B. Kailkhura Yi Zhou 26 8 0 30 Mar 2022
Continuous-Time Meta-Learning with Forward Mode Differentiation T. Deleu David Kanaa Leo Feng Giancarlo Kerg Yoshua Bengio Guillaume Lajoie Pierre-Luc Bacon 23 19 0 02 Mar 2022