Convergence Properties of Stochastic Hypergradients

13 November 2020

Papers citing "Convergence Properties of Stochastic Hypergradients"

22 / 22 papers shown

Title
Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity Yan Yang Bin Gao Ya-xiang Yuan 46 2 0 30 May 2024
Derivatives of Stochastic Gradient Descent F. Iutzeler Edouard Pauwels Samuel Vaiter 42 1 0 24 May 2024
Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates Riccardo Grazzi Massimiliano Pontil Saverio Salzo 49 1 0 18 Mar 2024
A Challenge in Reweighting Data with Bilevel Optimization Anastasia Ivanova Pierre Ablin 40 1 0 26 Oct 2023
BiSLS/SPS: Auto-tune Step Sizes for Stable Bi-level Optimization Chen Fan Gaspard Choné-Ducasse Mark W. Schmidt Christos Thrampoulidis 24 3 0 30 May 2023
Achieving Hierarchy-Free Approximation for Bilevel Programs With Equilibrium Constraints Jiayang Li Jiahao Yu Boyi Liu Zhaoran Wang Y. Nie 35 6 0 20 Feb 2023
Probabilistic Bilevel Coreset Selection Xiao Zhou Renjie Pi Weizhong Zhang Yong Lin Tong Zhang NoLa 31 27 0 24 Jan 2023
Analyzing Inexact Hypergradients for Bilevel Learning Matthias Joachim Ehrhardt Lindon Roberts 24 8 0 11 Jan 2023
On Implicit Bias in Overparameterized Bilevel Optimization Paul Vicol Jon Lorraine Fabian Pedregosa David Duvenaud Roger C. Grosse AI4CE 33 37 0 28 Dec 2022
Passage-Mask: A Learnable Regularization Strategy for Retriever-Reader Models Shujian Zhang Chengyue Gong Xingchao Liu RALM 49 6 0 02 Nov 2022
Simple and Effective Gradient-Based Tuning of Sequence-to-Sequence Models Jared Lichtarge Chris Alberti Shankar Kumar 37 4 0 10 Sep 2022
Bilevel Optimization with a Lower-level Contraction: Optimal Sample Complexity without Warm-start Riccardo Grazzi Massimiliano Pontil Saverio Salzo 28 12 0 07 Feb 2022
Amortized Implicit Differentiation for Stochastic Bilevel Optimization Michael Arbel Julien Mairal 105 58 0 29 Nov 2021
iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients Miao Zhang Steven W. Su Shirui Pan Xiaojun Chang Ehsan Abbasnejad Reza Haffari 24 68 0 21 Jun 2021
Implicit differentiation for fast hyperparameter selection in non-smooth convex learning Quentin Bertrand Quentin Klopfenstein Mathurin Massias Mathieu Blondel Samuel Vaiter Alexandre Gramfort Joseph Salmon 53 26 0 04 May 2021
Reward Optimization for Neural Machine Translation with Learned Metrics Raphael Shu Kang Min Yoo Jung-Woo Ha 32 12 0 15 Apr 2021
A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum Prashant Khanduri Siliang Zeng Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 17 129 0 15 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 59 222 0 27 Jan 2021
New Convergence Aspects of Stochastic Gradient Algorithms Lam M. Nguyen Phuong Ha Nguyen Peter Richtárik K. Scheinberg Martin Takáč Marten van Dijk 23 66 0 10 Nov 2018
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 110 717 0 13 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 365 11,700 0 09 Mar 2017
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 133 409 0 06 Mar 2017