Truncated Back-propagation for Bilevel Optimization

25 October 2018

Papers citing "Truncated Back-propagation for Bilevel Optimization"

50 / 166 papers shown

Title
A Primal-Dual Approach to Bilevel Optimization with Multiple Inner Minima Daouda Sow Kaiyi Ji Ziwei Guan Yingbin Liang 29 8 0 01 Mar 2022
Efficiently Escaping Saddle Points in Bilevel Optimization Minhui Huang Xuxing Chen Kaiyi Ji Shiqian Ma Lifeng Lai 28 21 0 08 Feb 2022
Tutorial on amortized optimization Brandon Amos OffRL 75 43 0 01 Feb 2022
AutoBalance: Optimized Loss Functions for Imbalanced Data Mingchen Li Xuechen Zhang Christos Thrampoulidis Jiasi Chen Samet Oymak 19 67 0 04 Jan 2022
Unbiased Gradient Estimation in Unrolled Computation Graphs with Persistent Evolution Strategies Paul Vicol Luke Metz Jascha Narain Sohl-Dickstein 27 67 0 27 Dec 2021
Automated Deep Learning: Neural Architecture Search Is Not the End Xuanyi Dong D. Kedziora Katarzyna Musial Bogdan Gabrys 25 26 0 16 Dec 2021
A Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse Junyi Li Bin Gu Heng-Chiao Huang 26 72 0 09 Dec 2021
Amortized Implicit Differentiation for Stochastic Bilevel Optimization Michael Arbel Julien Mairal 105 58 0 29 Nov 2021
Going Grayscale: The Road to Understanding and Improving Unlearnable Examples Zhuoran Liu Zhengyu Zhao A. Kolmus Tijn Berns Twan van Laarhoven Tom Heskes Martha Larson AAML 39 6 0 25 Nov 2021
On Training Implicit Models Zhengyang Geng Xinyu Zhang Shaojie Bai Yisen Wang Zhouchen Lin 61 69 0 09 Nov 2021
Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiation Ross M. Clarke E. T. Oldewage José Miguel Hernández-Lobato 28 9 0 20 Oct 2021
An Empirical Study: Extensive Deep Temporal Point Process Haitao Lin Cheng Tan Lirong Wu Zhangyang Gao Stan. Z. Li AI4TS 13 12 0 19 Oct 2021
On the Convergence Theory for Hessian-Free Bilevel Algorithms Daouda Sow Kaiyi Ji Yingbin Liang 28 28 0 13 Oct 2021
Value-Function-based Sequential Minimization for Bi-level Optimization Risheng Liu Xuan Liu Shangzhi Zeng Jin Zhang Yixuan Zhang 40 30 0 11 Oct 2021
Online Hyperparameter Meta-Learning with Hypergradient Distillation Haebeom Lee Hayeon Lee Jaewoong Shin Eunho Yang Timothy M. Hospedales Sung Ju Hwang DD 23 2 0 06 Oct 2021
Towards Gradient-based Bilevel Optimization with Non-convex Followers and Beyond Risheng Liu Yaohua Liu Shangzhi Zeng Jin Zhang 21 80 0 01 Oct 2021
DHA: End-to-End Joint Optimization of Data Augmentation Policy, Hyper-parameter and Architecture Kaichen Zhou Lanqing Hong Shuailiang Hu Fengwei Zhou Binxin Ru Jiashi Feng Zhenguo Li 59 10 0 13 Sep 2021
Is Attention Better Than Matrix Decomposition? Zhengyang Geng Meng-Hao Guo Hongxu Chen Xia Li Ke Wei Zhouchen Lin 62 137 0 09 Sep 2021
CMML: Contextual Modulation Meta Learning for Cold-Start Recommendation Xidong Feng Chong Chen Dong Li Mengchen Zhao Jianye Hao Jun Wang OffRL 21 23 0 24 Aug 2021
Enhanced Bilevel Optimization via Bregman Distance Feihu Huang Junyi Li Shangqian Gao Heng-Chiao Huang 27 33 0 26 Jul 2021
Tighter Analysis of Alternating Stochastic Gradient Method for Stochastic Nested Problems Tianyi Chen Yuejiao Sun W. Yin 24 33 0 25 Jun 2021
iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients Miao Zhang Steven W. Su Shirui Pan Xiaojun Chang Ehsan Abbasnejad Reza Haffari 24 68 0 21 Jun 2021
EvoGrad: Efficient Gradient-Based Meta-Learning and Hyperparameter Optimization Ondrej Bohdal Yongxin Yang Timothy M. Hospedales 18 20 0 19 Jun 2021
A Value-Function-based Interior-point Method for Non-convex Bi-level Optimization Risheng Liu Xuan Liu Xiaoming Yuan Shangzhi Zeng Jin Zhang 13 79 0 15 Jun 2021
Understanding approximate and unrolled dictionary learning for pattern recovery Benoit Malézieux Thomas Moreau M. Kowalski MU 22 10 0 11 Jun 2021
Graph Contrastive Learning Automated Yuning You Tianlong Chen Yang Shen Zhangyang Wang 24 447 0 10 Jun 2021
Provably Faster Algorithms for Bilevel Optimization Junjie Yang Kaiyi Ji Yingbin Liang 49 132 0 08 Jun 2021
Stability and Generalization of Bilevel Programming in Hyperparameter Optimization Fan Bao Guoqiang Wu Chongxuan Li Jun Zhu Bo Zhang 30 30 0 08 Jun 2021
Debiasing a First-order Heuristic for Approximate Bi-level Optimization Valerii Likhosherstov Xingyou Song K. Choromanski Jared Davis Adrian Weller AI4CE 19 5 0 04 Jun 2021
Fair Machine Learning under Limited Demographically Labeled Data Mustafa Safa Ozdayi Murat Kantarcioglu Rishabh K. Iyer FaML 17 3 0 03 Jun 2021
A Gradient Method for Multilevel Optimization Ryo Sato Mirai Tanaka Akiko Takeda 12 18 0 28 May 2021
Graph Sanitation with Application to Node Classification Zhe Xu Boxin Du Hanghang Tong 24 35 0 19 May 2021
Randomized Stochastic Variance-Reduced Methods for Multi-Task Stochastic Bilevel Optimization Zhishuai Guo Quan Hu Lijun Zhang Tianbao Yang 61 30 0 05 May 2021
A contrastive rule for meta-learning Nicolas Zucchet Simon Schug J. Oswald Dominic Zhao João Sacramento MLT 30 19 0 04 Apr 2021
A General Descent Aggregation Framework for Gradient-based Bi-level Optimization Risheng Liu Pan Mu Xiaoming Yuan Shangzhi Zeng Jin Zhang AI4CE 33 36 0 16 Feb 2021
A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum Prashant Khanduri Siliang Zeng Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 17 129 0 15 Feb 2021
Multi-Objective Meta Learning Feiyang Ye Baijiong Lin Zhixiong Yue Pengxin Guo Qiao Xiao Yu Zhang 41 47 0 14 Feb 2021
A Single-Timescale Method for Stochastic Bilevel Optimization Tianyi Chen Yuejiao Sun Quan-Wu Xiao W. Yin 21 77 0 09 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 59 222 0 27 Jan 2021
How Robust are Randomized Smoothing based Defenses to Data Poisoning? Akshay Mehra B. Kailkhura Pin-Yu Chen Jihun Hamm OOD AAML 12 32 0 02 Dec 2020
Delta-STN: Efficient Bilevel Optimization for Neural Networks using Structured Response Jacobians Juhan Bae Roger C. Grosse 27 24 0 26 Oct 2020
Bilevel Optimization: Convergence Analysis and Enhanced Design Kaiyi Ji Junjie Yang Yingbin Liang 28 245 0 15 Oct 2020
BOML: A Modularized Bilevel Optimization Library in Python for Meta Learning Yaohua Liu Risheng Liu 25 10 0 28 Sep 2020
Improved Bilevel Model: Fast and Optimal Algorithm with Theoretical Guarantee Junyi Li Bin Gu Heng-Chiao Huang 16 41 0 01 Sep 2020
Efficient hyperparameter optimization by way of PAC-Bayes bound minimization John J. Cherian Andrew G. Taube R. McGibbon Panagiotis Angelikopoulos Guy Blanc M. Snarski D. D. Richman J. L. Klepeis D. Shaw 12 6 0 14 Aug 2020
Gradient-based Hyperparameter Optimization Over Long Horizons P. Micaelli Amos Storkey 10 15 0 15 Jul 2020
A Two-Timescale Framework for Bilevel Optimization: Complexity Analysis and Application to Actor-Critic Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 18 134 0 10 Jul 2020
Not All Unlabeled Data are Equal: Learning to Weight Data in Semi-supervised Learning Zhongzheng Ren Raymond A. Yeh A. Schwing 36 95 0 02 Jul 2020
On the Iteration Complexity of Hypergradient Computation Riccardo Grazzi Luca Franceschi Massimiliano Pontil Saverio Salzo 48 192 0 29 Jun 2020
Meta Approach to Data Augmentation Optimization Ryuichiro Hataya Jan Zdenek Kazuki Yoshizoe Hideki Nakayama 32 34 0 14 Jun 2020