Hyperparameter optimization with approximate gradient

7 February 2016

Papers citing "Hyperparameter optimization with approximate gradient"

50 / 247 papers shown

Title
Data Selection: A General Principle for Building Small Interpretable Models Abhishek Ghose 29 0 0 08 Oct 2022
Decentralized Hyper-Gradient Computation over Time-Varying Directed Networks Naoyuki Terashita Satoshi Hara FedML 26 1 0 05 Oct 2022
On Stability and Generalization of Bilevel Optimization Problem Meng Ding Ming Lei Yunwen Lei Di Wang Jinhui Xu 32 1 0 03 Oct 2022
The Curse of Unrolling: Rate of Differentiating Through Optimization Damien Scieur Quentin Bertrand Gauthier Gidel Fabian Pedregosa 40 12 0 27 Sep 2022
BOME! Bilevel Optimization Made Easy: A Simple First-Order Approach Mao Ye B. Liu S. Wright Peter Stone Qian Liu 72 82 0 19 Sep 2022
Simple and Effective Gradient-Based Tuning of Sequence-to-Sequence Models Jared Lichtarge Chris Alberti Shankar Kumar 39 4 0 10 Sep 2022
A Globally Convergent Gradient-based Bilevel Hyperparameter Optimization Method Ankur Sinha Satender Gunwal Shivam Kumar 9 2 0 25 Aug 2022
Fixed-Point Automatic Differentiation of Forward--Backward Splitting Algorithms for Partly Smooth Functions Sheheryar Mehmood Peter Ochs 33 3 0 05 Aug 2022
INTERACT: Achieving Low Sample and Communication Complexities in Decentralized Bilevel Learning over Networks Zhuqing Liu Xin Zhang Prashant Khanduri Songtao Lu Jia Liu 35 11 0 27 Jul 2022
Gradient-based Bi-level Optimization for Deep Learning: A Survey Can Chen Xiangshan Chen Chen Ma Zixuan Liu Xue Liu 94 35 0 24 Jul 2022
Online Bilevel Optimization: Regret Analysis of Online Alternating Gradient Methods Davoud Ataee Tarzanagh Parvin Nazari Bojian Hou Li Shen Laura Balzano 49 10 0 06 Jul 2022
A Conditional Gradient-based Method for Simple Bilevel Optimization with Convex Lower-level Problem Ruichen Jiang Nazanin Abolfazli Aryan Mokhtari E. Y. Hamedani 40 21 0 17 Jun 2022
Value Function Based Difference-of-Convex Algorithm for Bilevel Hyperparameter Selection Problems Lucy L. Gao J. Ye Haian Yin Shangzhi Zeng Jin Zhang 29 23 0 13 Jun 2022
Communication-Efficient Robust Federated Learning with Noisy Labels Junyi Li Jian Pei Heng Huang FedML 23 18 0 11 Jun 2022
Automatic differentiation of nonsmooth iterative algorithms Jérôme Bolte Edouard Pauwels Samuel Vaiter 23 22 0 31 May 2022
Will Bilevel Optimizers Benefit from Loops Kaiyi Ji Mingrui Liu Yingbin Liang Lei Ying 45 41 0 27 May 2022
Fair Representation Learning through Implicit Path Alignment Changjian Shui Qi Chen Jiaqi Li Boyu Wang Christian Gagné 41 28 0 26 May 2022
Revisiting GANs by Best-Response Constraint: Perspective, Methodology, and Application Risheng Liu Jiaxin Gao Xuan Liu Xin-Yue Fan 37 4 0 20 May 2022
Towards Extremely Fast Bilevel Optimization with Self-governed Convergence Guarantees Risheng Liu Xuan Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 28 3 0 20 May 2022
Hyper-Learning for Gradient-Based Batch Size Adaptation Calum MacLellan Feng Dong 19 0 0 17 May 2022
Beyond backpropagation: bilevel optimization through implicit differentiation and equilibrium propagation Nicolas Zucchet João Sacramento 33 15 0 06 May 2022
Meta-learning Adaptive Deep Kernel Gaussian Processes for Molecular Property Prediction Wenlin Chen Austin Tripp José Miguel Hernández-Lobato 22 23 0 05 May 2022
FedNest: Federated Bilevel, Minimax, and Compositional Optimization Davoud Ataee Tarzanagh Mingchen Li Christos Thrampoulidis Samet Oymak FedML 42 73 0 04 May 2022
Local Stochastic Bilevel Optimization with Momentum-Based Variance Reduction Junyi Li Feihu Huang Heng-Chiao Huang FedML 22 27 0 03 May 2022
Learning the Effect of Registration Hyperparameters with HyperMorph Andrew Hoopes Malte Hoffmann Douglas N. Greve Bruce Fischl John Guttag Adrian V. Dalca 28 38 0 30 Mar 2022
A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimization Ziyi Chen B. Kailkhura Yi Zhou 26 8 0 30 Mar 2022
A Primal-Dual Approach to Bilevel Optimization with Multiple Inner Minima Daouda Sow Kaiyi Ji Ziwei Guan Yingbin Liang 29 9 0 01 Mar 2022
Efficiently Escaping Saddle Points in Bilevel Optimization Minhui Huang Xuxing Chen Kaiyi Ji Shiqian Ma Lifeng Lai 31 21 0 08 Feb 2022
Bilevel Optimization with a Lower-level Contraction: Optimal Sample Complexity without Warm-start Riccardo Grazzi Massimiliano Pontil Saverio Salzo 28 12 0 07 Feb 2022
Learning to Minimize the Remainder in Supervised Learning Yan Luo Yongkang Wong Mohan S. Kankanhalli Qi Zhao 49 1 0 23 Jan 2022
Efficient Hyperparameter Tuning for Large Scale Kernel Ridge Regression Giacomo Meanti Luigi Carratino E. De Vito Lorenzo Rosasco 24 12 0 17 Jan 2022
Discrete Simulation Optimization for Tuning Machine Learning Method Hyperparameters V. Ramamohan Shobhit Singhal Aditya Gupta N. Bolia 16 1 0 16 Jan 2022
Automated Deep Learning: Neural Architecture Search Is Not the End Xuanyi Dong D. Kedziora Katarzyna Musial Bogdan Gabrys 25 26 0 16 Dec 2021
A Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse Junyi Li Bin Gu Heng-Chiao Huang 26 72 0 09 Dec 2021
Hyper-parameter optimization based on soft actor critic and hierarchical mixture regularization Chaoyue Liu Yulai Zhang 11 0 0 08 Dec 2021
Amortized Implicit Differentiation for Stochastic Bilevel Optimization Michael Arbel Julien Mairal 105 58 0 29 Nov 2021
Adversarially Robust Learning for Security-Constrained Optimal Power Flow P. Donti Aayushya Agarwal Neeraj Vijay J. Pileggi Zico Kolter AAML 6 17 0 12 Nov 2021
On Training Implicit Models Zhengyang Geng Xinyu Zhang Shaojie Bai Yisen Wang Zhouchen Lin 61 69 0 09 Nov 2021
On the Convergence Theory for Hessian-Free Bilevel Algorithms Daouda Sow Kaiyi Ji Yingbin Liang 28 28 0 13 Oct 2021
Value-Function-based Sequential Minimization for Bi-level Optimization Risheng Liu Xuan Liu Shangzhi Zeng Jin Zhang Yixuan Zhang 40 30 0 11 Oct 2021
Online Hyperparameter Meta-Learning with Hypergradient Distillation Haebeom Lee Hayeon Lee Jaewoong Shin Eunho Yang Timothy M. Hospedales Sung Ju Hwang DD 30 2 0 06 Oct 2021
Inexact bilevel stochastic gradient methods for constrained and unconstrained lower-level problems Tommaso Giovannelli G. Kent Luis Nunes Vicente 33 12 0 01 Oct 2021
Towards Gradient-based Bilevel Optimization with Non-convex Followers and Beyond Risheng Liu Yaohua Liu Shangzhi Zeng Jin Zhang 21 80 0 01 Oct 2021
Data Summarization via Bilevel Optimization Zalan Borsos Mojmír Mutný Marco Tagliasacchi Andreas Krause 30 8 0 26 Sep 2021
Can we globally optimize cross-validation loss? Quasiconvexity in ridge regression William T. Stephenson Zachary Frangella Madeleine Udell Tamara Broderick 22 12 0 19 Jul 2021
iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients Miao Zhang Steven W. Su Shirui Pan Xiaojun Chang Ehsan Abbasnejad Reza Haffari 24 68 0 21 Jun 2021
A Value-Function-based Interior-point Method for Non-convex Bi-level Optimization Risheng Liu Xuan Liu Xiaoming Yuan Shangzhi Zeng Jin Zhang 15 79 0 15 Jun 2021
Graph Contrastive Learning Automated Yuning You Tianlong Chen Yang Shen Zhangyang Wang 24 447 0 10 Jun 2021
Provably Faster Algorithms for Bilevel Optimization Junjie Yang Kaiyi Ji Yingbin Liang 49 132 0 08 Jun 2021
Nonsmooth Implicit Differentiation for Machine Learning and Optimization Jérôme Bolte Tam Le Edouard Pauwels Antonio Silveti-Falls 24 54 0 08 Jun 2021