Hyperparameter optimization with approximate gradient

7 February 2016

Papers citing "Hyperparameter optimization with approximate gradient"

50 / 247 papers shown

Title
A Challenge in Reweighting Data with Bilevel Optimization Anastasia Ivanova Pierre Ablin 40 1 0 26 Oct 2023
Making Scalable Meta Learning Practical Sang Keun Choe Sanket Vaibhav Mehta Hwijeen Ahn Willie Neiswanger Pengtao Xie Emma Strubell Eric Xing 55 15 0 09 Oct 2023
On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation Jeongyeol Kwon Dohyun Kwon Steve Wright Robert D. Nowak 34 25 0 04 Sep 2023
Relax and penalize: a new bilevel approach to mixed-binary hyperparameter optimization M. D. Santis Jordan Frécon Francesco Rinaldi Saverio Salzo Martin Schmidt Martin Schmidt 53 0 0 21 Aug 2023
An adaptively inexact first-order method for bilevel optimization with application to hyperparameter learning Mohammad Salehi Subhadip Mukherjee Lindon Roberts Matthias Joachim Ehrhardt 26 5 0 19 Aug 2023
Non-Convex Bilevel Optimization with Time-Varying Objective Functions Sen-Fon Lin Daouda Sow Kaiyi Ji Yitao Liang Ness B. Shroff 36 2 0 07 Aug 2023
Doubly Robust Instance-Reweighted Adversarial Training Daouda Sow Sen-Fon Lin Zhangyang Wang Yitao Liang AAML OOD 33 2 0 01 Aug 2023
You Shall Pass: Dealing with the Zero-Gradient Problem in Predict and Optimize for Convex Optimization Grigorii Veviurko Wendelin Bohmer Mathijs de Weerdt 38 2 0 30 Jul 2023
Learning with Constraint Learning: New Perspective, Solution Strategy and Various Applications Risheng Liu Jiaxin Gao Xuan Liu Xin-Yue Fan 40 9 0 28 Jul 2023
Automatic Data Augmentation Learning using Bilevel Optimization for Histopathological Images Saypraseuth Mounsaveng I. Laradji David Vázquez M. Pedersoli Ismail Ben Ayed OOD 25 1 0 21 Jul 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles Le‐Yu Chen Yaohua Ma J.N. Zhang 86 2 0 26 Jun 2023
Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions Xuxing Chen Tesi Xiao Krishnakumar Balasubramanian 27 24 0 21 Jun 2023
PINQI: An End-to-End Physics-Informed Approach to Learned Quantitative MRI Reconstruction F. Zimmermann C. Kolbitsch Patrick Schuenke A. Kofler 26 5 0 19 Jun 2023
A Generalized Alternating Method for Bilevel Learning under the Polyak-Łojasiewicz Condition Quan-Wu Xiao Songtao Lu Tianyi Chen 24 2 0 04 Jun 2023
Federated Multi-Sequence Stochastic Approximation with Local Hypergradient Estimation Davoud Ataee Tarzanagh Mingchen Li Pranay Sharma Samet Oymak 34 0 0 02 Jun 2023
Hyperparameter Learning under Data Poisoning: Analysis of the Influence of Regularization via Multiobjective Bilevel Optimization Javier Carnerero-Cano Luis Muñoz-González P. Spencer Emil C. Lupu AAML 19 3 0 02 Jun 2023
SimFBO: Towards Simple, Flexible and Communication-efficient Federated Bilevel Learning Yifan Yang Peiyao Xiao Kaiyi Ji FedML 26 14 0 30 May 2023
Joint Optimization of Class-Specific Training- and Test-Time Data Augmentation in Segmentation Zeju Li Konstantinos Kamnitsas Qi Dou C. Qin Ben Glocker 21 6 0 30 May 2023
Effective Bilevel Optimization via Minimax Reformulation Xiaoyu Wang Rui Pan Renjie Pi Tong Zhang 42 1 0 22 May 2023
Low-Variance Gradient Estimation in Unrolled Computation Graphs with ES-Single Paul Vicol Zico Kolter Kevin Swersky 21 6 0 21 Apr 2023
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models Dohwan Ko Joon-Young Choi Hyeong Kyu Choi Kyoung-Woon On Byungseok Roh Hyunwoo J. Kim 52 19 0 23 Mar 2023
Achieving Hierarchy-Free Approximation for Bilevel Programs With Equilibrium Constraints Jiayang Li Jiahao Yu Boyi Liu Zhaoran Wang Y. Nie 35 6 0 20 Feb 2023
Nystrom Method for Accurate and Scalable Implicit Differentiation Ryuichiro Hataya M. Yamada ODL 42 8 0 20 Feb 2023
A Lower Bound and a Near-Optimal Algorithm for Bilevel Empirical Risk Minimization Mathieu Dagréou Thomas Moreau Samuel Vaiter Pierre Ablin 39 12 0 17 Feb 2023
Communication-Efficient Federated Bilevel Optimization with Local and Global Lower Level Problems Junyi Li Feihu Huang Heng Huang FedML 27 12 0 13 Feb 2023
Hierarchical Optimization-Derived Learning Risheng Liu Xuan Liu Shangzhi Zeng Jin Zhang Yixuan Zhang 43 3 0 11 Feb 2023
Achieving Linear Speedup in Non-IID Federated Bilevel Learning Minhui Huang Dewei Zhang Kaiyi Ji FedML 35 18 0 10 Feb 2023
Communication-Efficient Federated Hypergradient Computation via Aggregated Iterative Differentiation Peiyao Xiao Kaiyi Ji FedML 32 11 0 09 Feb 2023
Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong Convexity Risheng Liu Yaohua Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 32 24 0 07 Feb 2023
Efficient Gradient Approximation Method for Constrained Bilevel Optimization Siyuan Xu Minghui Zhu 29 20 0 03 Feb 2023
Follower Agnostic Methods for Stackelberg Games C. Maheshwari James Cheng S. S. Sasty Lillian J. Ratliff Eric Mazumdar 30 1 0 02 Feb 2023
Auxiliary Learning as an Asymmetric Bargaining Game Aviv Shamsian Aviv Navon Neta Glazer Kenji Kawaguchi Gal Chechik Ethan Fetaya 35 8 0 31 Jan 2023
Massively Scaling Heteroscedastic Classifiers Mark Collier Rodolphe Jenatton Basil Mustafa N. Houlsby Jesse Berent E. Kokiopoulou 26 8 0 30 Jan 2023
Probabilistic Bilevel Coreset Selection Xiao Zhou Renjie Pi Weizhong Zhang Yong Lin Tong Zhang NoLa 31 27 0 24 Jan 2023
Model Agnostic Sample Reweighting for Out-of-Distribution Learning Xiao Zhou Yong Lin Renjie Pi Weizhong Zhang Renzhe Xu Peng Cui Tong Zhang OODD 39 60 0 24 Jan 2023
Learning-Rate-Free Learning by D-Adaptation Aaron Defazio Konstantin Mishchenko 30 77 0 18 Jan 2023
Analyzing Inexact Hypergradients for Bilevel Learning Matthias Joachim Ehrhardt Lindon Roberts 24 8 0 11 Jan 2023
Network Utility Maximization with Unknown Utility Functions: A Distributed, Data-Driven Bilevel Optimization Approach Kaiyi Ji Lei Ying 27 7 0 04 Jan 2023
First-order penalty methods for bilevel optimization Zhaosong Lu Sanyou Mei 66 31 0 04 Jan 2023
On Finding Small Hyper-Gradients in Bilevel Optimization: Hardness Results and Improved Analysis Le‐Yu Chen Jing Xu J.N. Zhang 34 11 0 02 Jan 2023
On Implicit Bias in Overparameterized Bilevel Optimization Paul Vicol Jon Lorraine Fabian Pedregosa David Duvenaud Roger C. Grosse AI4CE 33 37 0 28 Dec 2022
Context Label Learning: Improving Background Class Representations in Semantic Segmentation Zeju Li Konstantinos Kamnitsas Cheng Ouyang Chen Chen Ben Glocker VLM 30 6 0 16 Dec 2022
Differentiating Nonsmooth Solutions to Parametric Monotone Inclusion Problems Jérôme Bolte Edouard Pauwels Antonio Silveti-Falls 26 13 0 15 Dec 2022
CPMLHO:Hyperparameter Tuning via Cutting Plane and Mixed-Level Optimization Shu-Bo Yang Yang Jiao Shaoyu Dou Mana Zheng Chen Zhu 25 0 0 11 Dec 2022
DIAMOND: Taming Sample and Communication Complexities in Decentralized Bilevel Optimization Pei-Yuan Qiu Yining Li Zhuqing Liu Prashant Khanduri Jia Liu Ness B. Shroff Elizabeth S. Bentley K. Turck 19 4 0 05 Dec 2022
Task Discovery: Finding the Tasks that Neural Networks Generalize on Andrei Atanov Andrei Filatov Teresa Yeo Ajay Sohmshetty Amir Zamir OOD 50 10 0 01 Dec 2022
Synergies between Disentanglement and Sparsity: Generalization and Identifiability in Multi-Task Learning Sébastien Lachapelle T. Deleu Divyat Mahajan Ioannis Mitliagkas Yoshua Bengio Simon Lacoste-Julien Quentin Bertrand 31 32 0 26 Nov 2022
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming Parvin Nazari Ahmad Mousavi Davoud Ataee Tarzanagh George Michailidis 41 4 0 08 Nov 2022
Decentralized Stochastic Bilevel Optimization with Improved per-Iteration Complexity Xuxing Chen Minhui Huang Shiqian Ma Krishnakumar Balasubramanian 27 25 0 23 Oct 2022
Improving Object-centric Learning with Query Optimization Baoxiong Jia Yu Liu Siyuan Huang OCL 31 49 0 17 Oct 2022