Bilevel Programming for Hyperparameter Optimization and Meta-Learning

13 June 2018

Luca Franceschi

Papers citing "Bilevel Programming for Hyperparameter Optimization and Meta-Learning"

50 / 145 papers shown

Title
Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows Wenhao Li Bo Jin Mingyi Hong Changhong Lu Xiangfeng Wang 48 0 0 07 May 2025
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 124 0 0 04 May 2025
Scalable Meta-Learning via Mixed-Mode Differentiation Iurii Kemaev Dan A Calian Luisa M Zintgraf Gregory Farquhar H. V. Hasselt 57 0 0 01 May 2025
PR-Attack: Coordinated Prompt-RAG Attacks on Retrieval-Augmented Generation in Large Language Models via Bilevel Optimization Yang Jiao X. Wang Kai Yang AAML SILM 31 0 0 10 Apr 2025
A Smooth Analytical Formulation of Collision Detection and Rigid Body Dynamics With Contact Onur Beker Nico Gürtler Ji Shi A. R. Geist Amirreza Razmjoo Georg Martius Sylvain Calinon 60 0 0 14 Mar 2025
Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models Reza Shirkavand Peiran Yu Shangqian Gao Gowthami Somepalli Tom Goldstein Heng-Chiao Huang 113 1 0 13 Mar 2025
Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy Chen Wang Kaiyi Ji Junyi Geng Zhongqiang Ren Taimeng Fu ... Yi Du Qihang Li Y. Yang Xiao Lin Zhipeng Zhao SSL 80 9 0 28 Jan 2025
Influence functions and regularity tangents for efficient active learning Frederik Eaton TDI 89 0 0 22 Nov 2024
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 36 0 0 25 Oct 2024
Differentially Private Bilevel Optimization Guy Kornowski 129 0 0 29 Sep 2024
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 38 2 0 28 Sep 2024
Learning to Select the Best Forecasting Tasks for Clinical Outcome Prediction Yuan Xue Nan Du A. Mottram Martin G. Seneviratne Andrew M. Dai AI4TS 23 0 0 28 Jul 2024
Train-Attention: Meta-Learning Where to Focus in Continual Knowledge Learning Yeongbin Seo Dongha Lee Jinyoung Yeo CLL KELM 82 1 0 24 Jul 2024
First-Order Methods for Linearly Constrained Bilevel Optimization Guy Kornowski Swati Padmanabhan Kai Wang Zhe Zhang S. Sra 72 5 0 18 Jun 2024
Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity Yan Yang Bin Gao Ya-xiang Yuan 38 2 0 30 May 2024
Unleash Graph Neural Networks from Heavy Tuning Lequan Lin Dai Shi Andi Han Zhiyong Wang Junbin Gao AI4CE 27 2 0 21 May 2024
Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy Risheng Liu Zhu Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 43 6 0 16 May 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace Bin Gao Yan Yang Ya-xiang Yuan 36 2 0 04 Apr 2024
Generalizing Reward Modeling for Out-of-Distribution Preference Learning Chen Jia 34 2 0 22 Feb 2024
Implicit Diffusion: Efficient Optimization through Stochastic Sampling Pierre Marion Anna Korba Peter Bartlett Mathieu Blondel Valentin De Bortoli Arnaud Doucet Felipe Llinares-López Courtney Paquette Quentin Berthet 76 11 0 08 Feb 2024
Convex and Bilevel Optimization for Neuro-Symbolic Inference and Learning Charles Dickens Changyu Gao Connor Pryor Stephen J. Wright Lise Getoor 31 3 0 17 Jan 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 25 7 0 17 Jan 2024
A First-Order Multi-Gradient Algorithm for Multi-Objective Bi-Level Optimization Feiyang Ye Baijiong Lin Xiao-Qun Cao Yu Zhang Ivor Tsang 47 6 0 17 Jan 2024
Less or More From Teacher: Exploiting Trilateral Geometry For Knowledge Distillation Chengming Hu Haolun Wu Xuan Li Chen-li Ma Xi Chen Jun Yan Boyu Wang Xue Liu 27 3 0 22 Dec 2023
Transformer-Powered Surrogates Close the ICF Simulation-Experiment Gap with Extremely Limited Data M. Olson Shusen Liu Jayaraman J. Thiagarajan B. Kustowski Weng-Keen Wong Rushil Anirudh AI4CE 26 1 0 06 Dec 2023
A Single-Loop Algorithm for Decentralized Bilevel Optimization Youran Dong Shiqian Ma Junfeng Yang Chao Yin 31 7 0 15 Nov 2023
Reinforcement Learning with Model Predictive Control for Highway Ramp Metering Filippo Airaldi B. de Schutter Azita Dabiri 40 4 0 15 Nov 2023
Adaptive Mirror Descent Bilevel Optimization Feihu Huang 33 1 0 08 Nov 2023
Federated Multi-Level Optimization over Decentralized Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang AI4CE 28 0 0 10 Oct 2023
Learning How to Propagate Messages in Graph Neural Networks Teng Xiao Zhengyu Chen Donglin Wang Suhang Wang GNN 26 76 0 01 Oct 2023
Relax and penalize: a new bilevel approach to mixed-binary hyperparameter optimization M. D. Santis Jordan Frécon Francesco Rinaldi Saverio Salzo Martin Schmidt Martin Schmidt 53 0 0 21 Aug 2023
DaMSTF: Domain Adversarial Learning Enhanced Meta Self-Training for Domain Adaptation Menglong Lu Zhen Huang Yunxiang Zhao Zhiliang Tian Yang Liu Dongsheng Li 26 6 0 05 Aug 2023
Doubly Robust Instance-Reweighted Adversarial Training Daouda Sow Sen-Fon Lin Zhangyang Wang Yitao Liang AAML OOD 33 2 0 01 Aug 2023
A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond Junyu Chen Yihao Liu Shuwen Wei Zhangxing Bian Shalini Subramanian A. Carass Jerry L. Prince Yong Du OOD 39 36 0 28 Jul 2023
Automated Polynomial Filter Learning for Graph Neural Networks Wendi Yu Zhichao Hou Xiaorui Liu 18 0 0 16 Jul 2023
Advances and Challenges in Meta-Learning: A Technical Review Anna Vettoruzzo Mohamed-Rafik Bouguelia Joaquin Vanschoren Thorsteinn Rögnvaldsson K. Santosh OffRL 21 70 0 10 Jul 2023
Differentiable Instruction Optimization for Cross-Task Generalization Masaru Isonuma Junichiro Mori Ichiro Sakata 29 0 0 16 Jun 2023
Probabilistic Unrolling: Scalable, Inverse-Free Maximum Likelihood Estimation for Latent Gaussian Models Alexander Lin Bahareh Tolooshams Yves Atchadé Demba E. Ba 31 1 0 05 Jun 2023
Federated Multi-Sequence Stochastic Approximation with Local Hypergradient Estimation Davoud Ataee Tarzanagh Mingchen Li Pranay Sharma Samet Oymak 24 0 0 02 Jun 2023
Bilevel Fast Scene Adaptation for Low-Light Image Enhancement Long Ma Dian Jin Nan An Jinyuan Liu Xin-Yue Fan Risheng Liu 33 48 0 02 Jun 2023
Robust Ante-hoc Graph Explainer using Bilevel Optimization Kha-Dinh Luong Mert Kosan A. Silva Ambuj K. Singh 34 6 0 25 May 2023
DAC-MR: Data Augmentation Consistency Based Meta-Regularization for Meta-Learning Jun Shu Xiang Yuan Deyu Meng Zongben Xu 28 4 0 13 May 2023
Noisy Correspondence Learning with Meta Similarity Correction Haocheng Han Kaiyao Miao Qinghua Zheng Minnan Luo 19 28 0 13 Apr 2023
Scalable Bayesian Meta-Learning through Generalized Implicit Gradients Yilang Zhang Bingcong Li Shi-Ji Gao G. Giannakis BDL 13 9 0 31 Mar 2023
On Momentum-Based Gradient Methods for Bilevel Optimization with Nonconvex Lower-Level Feihu Huang 24 18 0 07 Mar 2023
MetaPhysiCa: OOD Robustness in Physics-informed Machine Learning S Chandra Mouli M. A. Alam Bruno Ribeiro OOD 29 4 0 06 Mar 2023
Achieving Hierarchy-Free Approximation for Bilevel Programs With Equilibrium Constraints Jiayang Li J. Yu Boyi Liu Zhaoran Wang Y. Nie 32 6 0 20 Feb 2023
Bi-level Multi-objective Evolutionary Learning: A Case Study on Multi-task Graph Neural Topology Search Chao Wang Licheng Jiao Jiaxuan Zhao Lingling Li Xu Liu F. Liu Shuyuan Yang 29 5 0 06 Feb 2023
Efficient Gradient Approximation Method for Constrained Bilevel Optimization Siyuan Xu Minghui Zhu 19 19 0 03 Feb 2023
DAG Learning on the Permutahedron Valentina Zantedeschi Luca Franceschi Jean Kaddour Matt J. Kusner Vlad Niculae 27 11 0 27 Jan 2023