Hyperparameter optimization with approximate gradient

7 February 2016

Papers citing "Hyperparameter optimization with approximate gradient"

50 / 247 papers shown

Title
Stability and Generalization of Bilevel Programming in Hyperparameter Optimization Fan Bao Guoqiang Wu Chongxuan Li Jun Zhu Bo Zhang 30 30 0 08 Jun 2021
Debiasing a First-order Heuristic for Approximate Bi-level Optimization Valerii Likhosherstov Xingyou Song K. Choromanski Jared Davis Adrian Weller AI4CE 19 5 0 04 Jun 2021
SHINE: SHaring the INverse Estimate from the forward pass for bi-level optimization and implicit models Zaccharie Ramzi Florian Mannel Shaojie Bai Jean-Luc Starck P. Ciuciu Thomas Moreau 29 28 0 01 Jun 2021
Efficient and Modular Implicit Differentiation Mathieu Blondel Quentin Berthet Marco Cuturi Roy Frostig Stephan Hoyer Felipe Llinares-López Fabian Pedregosa Jean-Philippe Vert 27 217 0 31 May 2021
Optimization Induced Equilibrium Networks Xingyu Xie Qiuhao Wang Zenan Ling Xia Li Yisen Wang Guangcan Liu Zhouchen Lin 13 9 0 27 May 2021
Implicit differentiation for fast hyperparameter selection in non-smooth convex learning Quentin Bertrand Quentin Klopfenstein Mathurin Massias Mathieu Blondel Samuel Vaiter Alexandre Gramfort Joseph Salmon 53 26 0 04 May 2021
A contrastive rule for meta-learning Nicolas Zucchet Simon Schug J. Oswald Dominic Zhao João Sacramento MLT 33 19 0 04 Apr 2021
AutoDO: Robust AutoAugment for Biased Data with Label Noise via Scalable Probabilistic Implicit Differentiation Denis A. Gudovskiy Luca Rigazio Shun Ishizaka Kazuki Kozuka Sotaro Tsukizawa NoLa 30 21 0 10 Mar 2021
Optimizing Large-Scale Hyperparameters via Automated Learning Algorithm Bin Gu Guodong Liu Yanfu Zhang Xiang Geng Heng-Chiao Huang 36 19 0 17 Feb 2021
Muddling Labels for Regularization, a novel approach to generalization Karim Lounici Katia Méziani Benjamin Riu OOD 6 1 0 17 Feb 2021
A General Descent Aggregation Framework for Gradient-based Bi-level Optimization Risheng Liu Pan Mu Xiaoming Yuan Shangzhi Zeng Jin Zhang AI4CE 33 36 0 16 Feb 2021
Online hyperparameter optimization by real-time recurrent learning Daniel Jiwoong Im Cristina Savin Kyunghyun Cho 19 7 0 15 Feb 2021
A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum Prashant Khanduri Siliang Zeng Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 17 129 0 15 Feb 2021
Multi-Objective Meta Learning Feiyang Ye Baijiong Lin Zhixiong Yue Pengxin Guo Qiao Xiao Yu Zhang 43 47 0 14 Feb 2021
A Single-Timescale Method for Stochastic Bilevel Optimization Tianyi Chen Yuejiao Sun Quan-Wu Xiao W. Yin 24 77 0 09 Feb 2021
Lower Bounds and Accelerated Algorithms for Bilevel Optimization Kaiyi Ji Yingbin Liang 18 57 0 07 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 59 222 0 27 Jan 2021
Cost-Efficient Online Hyperparameter Optimization Jingkang Wang Mengye Ren Ilija Bogunovic Yuwen Xiong R. Urtasun 34 2 0 17 Jan 2021
HyperMorph: Amortized Hyperparameter Learning for Image Registration Andrew Hoopes Malte Hoffmann Bruce Fischl John Guttag Adrian V. Dalca 36 128 0 04 Jan 2021
Ada-Segment: Automated Multi-loss Adaptation for Panoptic Segmentation Gengwei Zhang Yiming Gao Hang Xu Hao Zhang Zhenguo Li Xiaodan Liang SSeg 49 5 0 07 Dec 2020
How Robust are Randomized Smoothing based Defenses to Data Poisoning? Akshay Mehra B. Kailkhura Pin-Yu Chen Jihun Hamm OOD AAML 17 32 0 02 Dec 2020
Convergence Properties of Stochastic Hypergradients Riccardo Grazzi Massimiliano Pontil Saverio Salzo 22 26 0 13 Nov 2020
Delta-STN: Efficient Bilevel Optimization for Neural Networks using Structured Response Jacobians Juhan Bae Roger C. Grosse 27 24 0 26 Oct 2020
Semi-supervised Batch Active Learning via Bilevel Optimization Zalan Borsos Marco Tagliasacchi Andreas Krause 32 23 0 19 Oct 2020
Bilevel Optimization: Convergence Analysis and Enhanced Design Kaiyi Ji Junjie Yang Yingbin Liang 28 249 0 15 Oct 2020
Learning Binary Decision Trees by Argmin Differentiation Valentina Zantedeschi Matt J. Kusner Vlad Niculae 24 13 0 09 Oct 2020
BOML: A Modularized Bilevel Optimization Library in Python for Meta Learning Yaohua Liu Risheng Liu 25 10 0 28 Sep 2020
Parameters for the best convergence of an optimization algorithm On-The-Fly Valdimir Pieter 6 0 0 23 Sep 2020
Improved Bilevel Model: Fast and Optimal Algorithm with Theoretical Guarantee Junyi Li Bin Gu Heng-Chiao Huang 18 41 0 01 Sep 2020
Network Architecture Search for Domain Adaptation Yichen Li Xingchao Peng OOD 21 15 0 13 Aug 2020
Stabilizing Bi-Level Hyperparameter Optimization using Moreau-Yosida Regularization Sauptik Dhar Unmesh Kurup Mohak Shah 30 2 0 27 Jul 2020
A Gradient-based Bilevel Optimization Approach for Tuning Hyperparameters in Machine Learning Ankur Sinha Tanmay Khandait R. Mohanty 35 16 0 21 Jul 2020
Gradient-based Hyperparameter Optimization Over Long Horizons P. Micaelli Amos Storkey 13 15 0 15 Jul 2020
A Two-Timescale Framework for Bilevel Optimization: Complexity Analysis and Application to Actor-Critic Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 18 135 0 10 Jul 2020
On the Iteration Complexity of Hypergradient Computation Riccardo Grazzi Luca Franceschi Massimiliano Pontil Saverio Salzo 48 193 0 29 Jun 2020
Learning Data Augmentation with Online Bilevel Optimization for Image Classification Saypraseuth Mounsaveng I. Laradji Ismail Ben Ayed David Vazquez M. Pedersoli 19 36 0 25 Jun 2020
Auxiliary Learning by Implicit Differentiation Aviv Navon Idan Achituve Haggai Maron Gal Chechik Ethan Fetaya 28 59 0 22 Jun 2020
Multi-fidelity Neural Architecture Search with Knowledge Distillation I. Trofimov Nikita Klyuchnikov Mikhail Salnikov Alexander N. Filippov Evgeny Burnaev 32 15 0 15 Jun 2020
Meta Approach to Data Augmentation Optimization Ryuichiro Hataya Jan Zdenek Kazuki Yoshizoe Hideki Nakayama 32 34 0 14 Jun 2020
Optimizing generalization on the train set: a novel gradient-based framework to train parameters and hyperparameters simultaneously Karim Lounici Katia Méziani Benjamin Riu 27 1 0 11 Jun 2020
Differentiable Neural Input Search for Recommender Systems Weiyu Cheng Yanyan Shen Linpeng Huang 23 36 0 08 Jun 2020
Multi-step Estimation for Gradient-based Meta-learning Jin-Hwa Kim Junyoung Park Yongseok Choi 22 1 0 08 Jun 2020
Coresets via Bilevel Optimization for Continual Learning and Streaming Zalan Borsos Mojmír Mutný Andreas Krause CLL 38 226 0 06 Jun 2020
AutoHAS: Efficient Hyperparameter and Architecture Search Xuanyi Dong Mingxing Tan Adams Wei Yu Daiyi Peng Bogdan Gabrys Quoc V. Le TPM 16 23 0 05 Jun 2020
UFO-BLO: Unbiased First-Order Bilevel Optimization Valerii Likhosherstov Xingyou Song K. Choromanski Jared Davis Adrian Weller 32 7 0 05 Jun 2020
HyperSTAR: Task-Aware Hyperparameters for Deep Networks Gaurav Mittal Chang Liu Nikolaos Karianakis Victor Fragoso Mei Chen Y. Fu VLM 40 23 0 21 May 2020
Two-Level Lattice Neural Network Architectures for Control of Nonlinear Systems James Ferlez Xiaowu Sun Yasser Shoukry 9 7 0 20 Apr 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 67 1,935 0 11 Apr 2020
Online Hyperparameter Search Interleaved with Proximal Parameter Updates Luis Miguel Lopez Ramos B. Beferull-Lozano 11 3 0 06 Apr 2020
Regularisation Can Mitigate Poisoning Attacks: A Novel Analysis Based on Multiobjective Bilevel Optimisation Javier Carnerero-Cano Luis Muñoz-González P. Spencer Emil C. Lupu AAML 20 11 0 28 Feb 2020