Hyperparameter optimization with approximate gradient

7 February 2016

Papers citing "Hyperparameter optimization with approximate gradient"

50 / 247 papers shown

Title
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 130 0 0 04 May 2025
Bridging the Gap Between Preference Alignment and Machine Unlearning Xiaohua Feng Yuyuan Li Huwei Ji Jiaming Zhang L. Zhang Tianyu Du Chaochao Chen MU 40 0 0 09 Apr 2025
Exploring the Potential of Bilevel Optimization for Calibrating Neural Networks Gabriele Sanguin Arjun Pakrashi Marco Viola Francesco Rinaldi 58 0 0 17 Mar 2025
Nash Equilibrium Constrained Auto-bidding With Bi-level Reinforcement Learning Zhiyu Mou Miao Xu Rongquan Bai Zhuoran Yang Chuan Yu Jian Xu Bo Zheng 41 0 0 13 Mar 2025
Group-robust Sample Reweighting for Subpopulation Shifts via Influence Functions Rui Qiao Zhaoxuan Wu Jingtan Wang Pang Wei Koh Bryan Kian Hsiang Low OOD 53 2 0 10 Mar 2025
PRDP: Progressively Refined Differentiable Physics Kanishk Bhatia Felix Koehler Nils Thuerey AI4CE 66 0 0 26 Feb 2025
qNBO: quasi-Newton Meets Bilevel Optimization Sheng Fang Yong Liu Wei-Ting Yao Chengming Yu Jin Zhang 92 0 0 03 Feb 2025
Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy Chen Wang Kaiyi Ji Junyi Geng Zhongqiang Ren Taimeng Fu ... Yi Du Qihang Li Yuqing Yang Xiao Lin Zhipeng Zhao SSL 86 9 0 28 Jan 2025
On Penalty-based Bilevel Gradient Descent Method Han Shen Quan-Wu Xiao Tianyi Chen 60 51 0 08 Jan 2025
Provably Faster Algorithms for Bilevel Optimization via Without-Replacement Sampling Junyi Li Heng Huang 39 1 0 07 Nov 2024
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 38 0 0 25 Oct 2024
Optimizing importance weighting in the presence of sub-population shifts Floris Holstege Bram Wouters Noud van Giersbergen C. Diks 26 0 0 18 Oct 2024
Single-Timescale Multi-Sequence Stochastic Approximation Without Fixed Point Smoothness: Theories and Applications Yue Huang Zhaoxian Wu Shiqian Ma Qing Ling 31 1 0 17 Oct 2024
Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparator Siyuan Xu Minghui Zhu OffRL 30 1 0 13 Oct 2024
SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection Han Shen Pin-Yu Chen Payel Das Tianyi Chen ALM 26 11 0 09 Oct 2024
BiSSL: A Bilevel Optimization Framework for Enhancing the Alignment Between Self-Supervised Pre-Training and Downstream Fine-Tuning Gustav Wagner Zakarias Lars Kai Hansen Zheng-Hua Tan 32 0 0 03 Oct 2024
Adaptive Learn-then-Test: Statistically Valid and Efficient Hyperparameter Selection Matteo Zecchin Sangwoo Park Osvaldo Simeone LM&MA 74 3 0 24 Sep 2024
Online Nonconvex Bilevel Optimization with Bregman Divergences Jason Bohne David Rosenberg Gary Kazantsev Pawel Polak 27 0 0 16 Sep 2024
Enhancing Fairness through Reweighting: A Path to Attain the Sufficiency Rule Xuan Zhao Klaus Broelemann Salvatore Ruggieri Gjergji Kasneci 31 0 0 26 Aug 2024
Enhancing Sharpness-Aware Minimization by Learning Perturbation Radius Xuehao Wang Weisen Jiang Shuai Fu Yu Zhang AAML 44 0 0 15 Aug 2024
Towards Fair and Rigorous Evaluations: Hyperparameter Optimization for Top-N Recommendation Task with Implicit Feedback Hui Fang Xu Feng Lu Qin Zhu Sun 24 0 0 14 Aug 2024
A Linear Programming Enhanced Genetic Algorithm for Hyperparameter Tuning in Machine Learning Ankur Sinha Paritosh Pankaj 25 0 0 30 Jun 2024
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting Rui Pan Jipeng Zhang Xingyuan Pan Renjie Pi Xiaoyu Wang Tong Zhang 58 5 0 28 Jun 2024
Double Momentum Method for Lower-Level Constrained Bilevel Optimization Wanli Shi Yi Chang Bin Gu 33 0 0 25 Jun 2024
First-Order Methods for Linearly Constrained Bilevel Optimization Guy Kornowski Swati Padmanabhan Kai Wang Zhe Zhang S. Sra 78 5 0 18 Jun 2024
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints Liuyuan Jiang Quan-Wu Xiao Victor M. Tenorio Fernando Real-Rojas Antonio G. Marques Tianyi Chen 48 1 0 14 Jun 2024
Unraveling the Impact of Heterophilic Structures on Graph Positive-Unlabeled Learning Yuhao Wu Jiangchao Yao Bo Han Lina Yao Tongliang Liu 31 2 0 30 May 2024
Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity Yan Yang Bin Gao Ya-xiang Yuan 43 2 0 30 May 2024
Calibrated Dataset Condensation for Faster Hyperparameter Search Mucong Ding Yuancheng Xu Tahseen Rabbani Xiaoyu Liu Brian J Gravelle Teresa M. Ranadive Tai-Ching Tuan Furong Huang DD 34 0 0 27 May 2024
Derivatives of Stochastic Gradient Descent F. Iutzeler Edouard Pauwels Samuel Vaiter 42 1 0 24 May 2024
Riemannian Bilevel Optimization Sanchayan Dutta Xiang Cheng S. Sra 41 0 0 22 May 2024
Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy Risheng Liu Zhu Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 49 6 0 16 May 2024
Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization Chris Junchi Li 56 0 0 01 May 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace Bin Gao Yan Yang Ya-xiang Yuan 39 2 0 04 Apr 2024
Functional Bilevel Optimization for Machine Learning Ieva Petrulionyte Julien Mairal Michael Arbel 51 2 0 29 Mar 2024
Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates Riccardo Grazzi Massimiliano Pontil Saverio Salzo 46 1 0 18 Mar 2024
Whiteness-based bilevel learning of regularization parameters in imaging Carlo Santambrogio M. Pragliola Alessandro Lanza Marco Donatelli L. Calatroni 22 1 0 10 Mar 2024
Enhancing Hypergradients Estimation: A Study of Preconditioning and Reparameterization Zhenzhang Ye Gabriel Peyré Daniel Cremers Pierre Ablin 41 2 0 26 Feb 2024
AutoMMLab: Automatically Generating Deployable Models from Language Instructions for Computer Vision Tasks Zekang Yang Wang Zeng Sheng Jin Chao Qian Ping Luo Wentao Liu MLLM VLM 58 8 0 23 Feb 2024
Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF Han Shen Zhuoran Yang Tianyi Chen OffRL 40 14 0 10 Feb 2024
Implicit Diffusion: Efficient Optimization through Stochastic Sampling Pierre Marion Anna Korba Peter Bartlett Mathieu Blondel Valentin De Bortoli Arnaud Doucet Felipe Llinares-López Courtney Paquette Quentin Berthet 76 12 0 08 Feb 2024
Glocal Hypergradient Estimation with Koopman Operator Ryuichiro Hataya Yoshinobu Kawahara 44 2 0 05 Feb 2024
Constrained Bi-Level Optimization: Proximal Lagrangian Value function Approach and Hessian-free Algorithm Wei-Ting Yao Chengming Yu Shangzhi Zeng Jin Zhang 23 13 0 29 Jan 2024
Convex and Bilevel Optimization for Neuro-Symbolic Inference and Learning Charles Dickens Changyu Gao Connor Pryor Stephen J. Wright Lise Getoor 40 3 0 17 Jan 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 30 7 0 17 Jan 2024
Joint Unsupervised and Supervised Training for Automatic Speech Recognition via Bilevel Optimization A. F. M. Saif Xiaodong Cui Han Shen Songtao Lu Brian Kingsbury Tianyi Chen 37 3 0 13 Jan 2024
DREAM: Debugging and Repairing AutoML Pipelines Xiaoyu Zhang Juan Zhai Shiqing Ma Chao Shen 21 1 0 31 Dec 2023
Gradient-based bilevel optimization for multi-penalty Ridge regression through matrix differential calculus Gabriele Maroni Loris Cannelli Dario Piga 14 0 0 23 Nov 2023
A Single-Loop Algorithm for Decentralized Bilevel Optimization Youran Dong Shiqian Ma Junfeng Yang Chao Yin 36 7 0 15 Nov 2023
Fast Trainable Projection for Robust Fine-Tuning Junjiao Tian Yen-Cheng Liu James Seale Smith Z. Kira OOD 33 11 0 29 Oct 2023