Bilevel Programming for Hyperparameter Optimization and Meta-Learning

13 June 2018

Luca Franceschi

Papers citing "Bilevel Programming for Hyperparameter Optimization and Meta-Learning"

50 / 150 papers shown

Title
The Role of Global Labels in Few-Shot Classification and How to Infer Them Ruohan Wang Massimiliano Pontil C. Ciliberto VLM 34 17 0 09 Aug 2021
Enhanced Bilevel Optimization via Bregman Distance Feihu Huang Junyi Li Shangqian Gao Heng-Chiao Huang 19 33 0 26 Jul 2021
Tighter Analysis of Alternating Stochastic Gradient Method for Stochastic Nested Problems Tianyi Chen Yuejiao Sun W. Yin 24 33 0 25 Jun 2021
iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients Miao Zhang Steven W. Su Shirui Pan Xiaojun Chang Ehsan Abbasnejad Reza Haffari 18 68 0 21 Jun 2021
A Value-Function-based Interior-point Method for Non-convex Bi-level Optimization Risheng Liu Xuan Liu Xiaoming Yuan Shangzhi Zeng Jin Zhang 13 79 0 15 Jun 2021
Provably Faster Algorithms for Bilevel Optimization Junjie Yang Kaiyi Ji Yingbin Liang 41 132 0 08 Jun 2021
Debiasing a First-order Heuristic for Approximate Bi-level Optimization Valerii Likhosherstov Xingyou Song K. Choromanski Jared Davis Adrian Weller AI4CE 19 5 0 04 Jun 2021
An End-to-End Framework for Molecular Conformation Generation via Bilevel Programming Minkai Xu Wujie Wang Shitong Luo Chence Shi Yoshua Bengio Rafael Gómez-Bombarelli Jian Tang 3DV 34 78 0 15 May 2021
Generalization Guarantees for Neural Architecture Search with Train-Validation Split Samet Oymak Mingchen Li Mahdi Soltanolkotabi AI4CE OOD 31 13 0 29 Apr 2021
Contrastive Learning Improves Model Robustness Under Label Noise Aritra Ghosh Andrew S. Lan NoLa 19 58 0 19 Apr 2021
Application-Driven Learning: A Closed-Loop Prediction and Optimization Approach Applied to Dynamic Reserves and Demand Forecasting J. Garcia A. Street Tito Homem-de-Mello F. Muñoz 22 10 0 26 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 50 222 0 27 Jan 2021
HyperMorph: Amortized Hyperparameter Learning for Image Registration Andrew Hoopes Malte Hoffmann Bruce Fischl John Guttag Adrian V. Dalca 32 128 0 04 Jan 2021
Are We Ready For Learned Cardinality Estimation? Xiaoying Wang Changbo Qu Weiyuan Wu Jiannan Wang Qingqing Zhou 37 113 0 12 Dec 2020
Delta-STN: Efficient Bilevel Optimization for Neural Networks using Structured Response Jacobians Juhan Bae Roger C. Grosse 24 24 0 26 Oct 2020
Bilevel Optimization: Convergence Analysis and Enhanced Design Kaiyi Ji Junjie Yang Yingbin Liang 28 244 0 15 Oct 2020
BOML: A Modularized Bilevel Optimization Library in Python for Meta Learning Yaohua Liu Risheng Liu 17 10 0 28 Sep 2020
Tasks, stability, architecture, and compute: Training more effective learned optimizers, and using them to train themselves Luke Metz Niru Maheswaranathan C. Freeman Ben Poole Jascha Narain Sohl-Dickstein 22 62 0 23 Sep 2020
Improved Bilevel Model: Fast and Optimal Algorithm with Theoretical Guarantee Junyi Li Bin Gu Heng-Chiao Huang 16 41 0 01 Sep 2020
Network Architecture Search for Domain Adaptation Yichen Li Xingchao Peng OOD 19 15 0 13 Aug 2020
Meta Feature Modulator for Long-tailed Recognition Renzhen Wang Kaiqin Hu Yanwen Zhu Jun Shu Qian Zhao Deyu Meng 16 12 0 08 Aug 2020
MetAL: Active Semi-Supervised Learning on Graphs via Meta Learning Kaushalya Madhawa T. Murata AI4CE 22 8 0 22 Jul 2020
A Two-Timescale Framework for Bilevel Optimization: Complexity Analysis and Application to Actor-Critic Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 18 134 0 10 Jul 2020
Consistency analysis of bilevel data-driven learning in inverse problems Neil K. Chada C. Schillings Xin T. Tong Simon Weissmann 17 8 0 06 Jul 2020
Few-shot Relation Extraction via Bayesian Meta-learning on Relation Graphs Meng Qu Tianyu Gao Louis-Pascal Xhonneux Jian Tang BDL 16 106 0 05 Jul 2020
Not All Unlabeled Data are Equal: Learning to Weight Data in Semi-supervised Learning Zhongzheng Ren Raymond A. Yeh A. Schwing 33 95 0 02 Jul 2020
On the Iteration Complexity of Hypergradient Computation Riccardo Grazzi Luca Franceschi Massimiliano Pontil Saverio Salzo 42 191 0 29 Jun 2020
Meta Approach to Data Augmentation Optimization Ryuichiro Hataya Jan Zdenek Kazuki Yoshizoe Hideki Nakayama 32 34 0 14 Jun 2020
Meta Transition Adaptation for Robust Deep Learning with Noisy Labels Jun Shu Qian Zhao Zengben Xu Deyu Meng NoLa 31 29 0 10 Jun 2020
Coresets via Bilevel Optimization for Continual Learning and Streaming Zalan Borsos Mojmír Mutný Andreas Krause CLL 21 226 0 06 Jun 2020
UFO-BLO: Unbiased First-Order Bilevel Optimization Valerii Likhosherstov Xingyou Song K. Choromanski Jared Davis Adrian Weller 27 7 0 05 Jun 2020
Geometry-Aware Gradient Algorithms for Neural Architecture Search Liam Li M. Khodak Maria-Florina Balcan Ameet Talwalkar 25 66 0 16 Apr 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 40 1,927 0 11 Apr 2020
Online Meta-Learning for Multi-Source and Semi-Supervised Domain Adaptation Da Li Timothy M. Hospedales 17 102 0 09 Apr 2020
Online Meta-Critic Learning for Off-Policy Actor-Critic Methods Wei Zhou Yiying Li Yongxin Yang Huaimin Wang Timothy M. Hospedales OffRL 27 46 0 11 Mar 2020
Diversity Transfer Network for Few-Shot Learning Mengting Chen Yuxin Fang Xinggang Wang Heng Luo Yifeng Geng Xinyu Zhang Chang Huang Wenyu Liu Bo Wang 15 69 0 31 Dec 2019
Automatic Design of CNNs via Differentiable Neural Architecture Search for PolSAR Image Classification Hongwei Dong Siyu Zhang B. Zou Lamei Zhang 13 47 0 16 Nov 2019
Meta-Transfer Learning through Hard Tasks Qianru Sun Yaoyao Liu Zhaozheng Chen Tat-Seng Chua Bernt Schiele 14 98 0 07 Oct 2019
Understanding and Robustifying Differentiable Architecture Search Arber Zela T. Elsken Tonmoy Saikia Yassine Marrakchi Thomas Brox Frank Hutter OOD AAML 66 366 0 20 Sep 2019
Learning Surrogate Losses Josif Grabocka Randolf Scholz Lars Schmidt-Thieme 24 41 0 24 May 2019
An Ensemble of Epoch-wise Empirical Bayes for Few-shot Learning Yaoyao Liu Bernt Schiele Qianru Sun BDL 27 128 0 17 Apr 2019
Learning-to-Learn Stochastic Gradient Descent with Biased Regularization Giulia Denevi C. Ciliberto Riccardo Grazzi Massimiliano Pontil 18 108 0 25 Mar 2019
Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions M. Mackay Paul Vicol Jonathan Lorraine D. Duvenaud Roger C. Grosse 27 164 0 07 Mar 2019
Provable Guarantees for Gradient-Based Meta-Learning M. Khodak Maria-Florina Balcan Ameet Talwalkar FedML 19 147 0 27 Feb 2019
Optimization Problems for Machine Learning: A Survey Claudio Gambella Bissan Ghaddar Joe Naoum-Sawaya AI4CE 30 178 0 16 Jan 2019
Meta-Transfer Learning for Few-Shot Learning Qianru Sun Yaoyao Liu Tat-Seng Chua Bernt Schiele 48 1,057 0 06 Dec 2018
Far-HO: A Bilevel Programming Package for Hyperparameter Optimization and Meta-Learning Luca Franceschi Riccardo Grazzi Massimiliano Pontil Saverio Salzo P. Frasconi 14 2 0 13 Jun 2018
Incremental Learning-to-Learn with Statistical Guarantees Giulia Denevi C. Ciliberto Dimitris Stamos Massimiliano Pontil CLL 18 48 0 21 Mar 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 329 11,681 0 09 Mar 2017
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 127 406 0 06 Mar 2017