Convergence of Meta-Learning with Task-Specific Adaptation over Partial Parameters

16 June 2020

Papers citing "Convergence of Meta-Learning with Task-Specific Adaptation over Partial Parameters"

48 / 48 papers shown

Title
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 132 0 0 04 May 2025
Towards Auto-Regressive Next-Token Prediction: In-Context Learning Emerges from Generalization Zixuan Gong Xiaolin Hu Huayi Tang Yong Liu 35 0 0 24 Feb 2025
Memory-Reduced Meta-Learning with Guaranteed Convergence Honglin Yang Ji Ma Xiao Yu 74 0 0 16 Dec 2024
Exploring the Generalization Capabilities of AID-based Bi-level Optimization C. L. Philip Chen Li Shen Zhiqiang Xu Wei Liu Zhi-Quan Luo Peilin Zhao 68 1 0 25 Nov 2024
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 38 0 0 25 Oct 2024
Differentially Private Bilevel Optimization Guy Kornowski 142 0 0 29 Sep 2024
First-Order Methods for Linearly Constrained Bilevel Optimization Guy Kornowski Swati Padmanabhan Kai Wang Zhe Zhang S. Sra 78 5 0 18 Jun 2024
Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy Risheng Liu Zhu Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 49 6 0 16 May 2024
Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization Chris Junchi Li 56 0 0 01 May 2024
Federated reinforcement learning for robot motion planning with zero-shot generalization Zhenyuan Yuan Siyuan Xu Minghui Zhu FedML 35 1 0 20 Mar 2024
A Framework for Bilevel Optimization on Riemannian Manifolds Andi Han Bamdev Mishra Pratik Jawanpuria Akiko Takeda 18 4 0 06 Feb 2024
Constrained Bi-Level Optimization: Proximal Lagrangian Value function Approach and Hessian-free Algorithm Wei-Ting Yao Chengming Yu Shangzhi Zeng Jin Zhang 23 13 0 29 Jan 2024
A Single-Loop Algorithm for Decentralized Bilevel Optimization Youran Dong Shiqian Ma Junfeng Yang Chao Yin 36 7 0 15 Nov 2023
Non-Convex Bilevel Optimization with Time-Varying Objective Functions Sen-Fon Lin Daouda Sow Kaiyi Ji Yitao Liang Ness B. Shroff 36 2 0 07 Aug 2023
Doubly Robust Instance-Reweighted Adversarial Training Daouda Sow Sen-Fon Lin Zhangyang Wang Yitao Liang AAML OOD 33 2 0 01 Aug 2023
Learning with Constraint Learning: New Perspective, Solution Strategy and Various Applications Risheng Liu Jiaxin Gao Xuan Liu Xin-Yue Fan 37 9 0 28 Jul 2023
Accelerating Inexact HyperGradient Descent for Bilevel Optimization Hai-Long Yang Luo Luo C. J. Li Michael I. Jordan 26 13 0 30 Jun 2023
Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions Xuxing Chen Tesi Xiao Krishnakumar Balasubramanian 27 24 0 21 Jun 2023
Classification Tree Pruning Under Covariate Shift Nicholas Galbraith Samory Kpotufe 30 1 0 07 May 2023
Provable Pathways: Learning Multiple Tasks over Multiple Paths Yingcong Li Samet Oymak MoE 26 4 0 08 Mar 2023
Achieving Linear Speedup in Non-IID Federated Bilevel Learning Minhui Huang Dewei Zhang Kaiyi Ji FedML 27 18 0 10 Feb 2023
Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong Convexity Risheng Liu Yaohua Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 32 24 0 07 Feb 2023
Efficient Gradient Approximation Method for Constrained Bilevel Optimization Siyuan Xu Minghui Zhu 29 20 0 03 Feb 2023
First-order penalty methods for bilevel optimization Zhaosong Lu Sanyou Mei 66 31 0 04 Jan 2023
Federated Learning and Meta Learning: Approaches, Applications, and Directions Xiaonan Liu Yansha Deng Arumugam Nallanathan M. Bennis 58 32 0 24 Oct 2022
Decentralized Stochastic Bilevel Optimization with Improved per-Iteration Complexity Xuxing Chen Minhui Huang Shiqian Ma Krishnakumar Balasubramanian 24 25 0 23 Oct 2022
Value Function Based Difference-of-Convex Algorithm for Bilevel Hyperparameter Selection Problems Lucy L. Gao J. Ye Haian Yin Shangzhi Zeng Jin Zhang 26 23 0 13 Jun 2022
Will Bilevel Optimizers Benefit from Loops Kaiyi Ji Mingrui Liu Yingbin Liang Lei Ying 39 41 0 27 May 2022
Continual Learning with Foundation Models: An Empirical Study of Latent Replay O. Ostapenko Timothée Lesort P. Rodríguez Md Rifat Arefin Arthur Douillard Irina Rish Laurent Charlin 29 51 0 30 Apr 2022
A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimization Ziyi Chen B. Kailkhura Yi Zhou 26 8 0 30 Mar 2022
A Primal-Dual Approach to Bilevel Optimization with Multiple Inner Minima Daouda Sow Kaiyi Ji Ziwei Guan Yingbin Liang 29 8 0 01 Mar 2022
Efficiently Escaping Saddle Points in Bilevel Optimization Minhui Huang Xuxing Chen Kaiyi Ji Shiqian Ma Lifeng Lai 26 20 0 08 Feb 2022
On the Convergence Theory for Hessian-Free Bilevel Algorithms Daouda Sow Kaiyi Ji Yingbin Liang 26 28 0 13 Oct 2021
Towards Gradient-based Bilevel Optimization with Non-convex Followers and Beyond Risheng Liu Yaohua Liu Shangzhi Zeng Jin Zhang 19 80 0 01 Oct 2021
Sign-MAML: Efficient Model-Agnostic Meta-Learning by SignSGD Chen Fan Parikshit Ram Sijia Liu FedML 61 16 0 15 Sep 2021
Memory-Based Optimization Methods for Model-Agnostic Meta-Learning and Personalized Federated Learning Bokun Wang Zhuoning Yuan Yiming Ying Tianbao Yang FedML 53 9 0 09 Jun 2021
Provably Faster Algorithms for Bilevel Optimization Junjie Yang Kaiyi Ji Yingbin Liang 46 132 0 08 Jun 2021
Stability and Generalization of Bilevel Programming in Hyperparameter Optimization Fan Bao Guoqiang Wu Chongxuan Li Jun Zhu Bo Zhang 30 30 0 08 Jun 2021
Signal Transformer: Complex-valued Attention and Meta-Learning for Signal Recognition Yihong Dong Ying Peng Muqiao Yang Songtao Lu Qingjiang Shi 40 9 0 05 Jun 2021
How Fine-Tuning Allows for Effective Meta-Learning Kurtland Chua Qi Lei Jason D. Lee 28 48 0 05 May 2021
Lower Bounds and Accelerated Algorithms for Bilevel Optimization Kaiyi Ji Yingbin Liang 18 57 0 07 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 53 222 0 27 Jan 2021
How Does the Task Landscape Affect MAML Performance? Liam Collins Aryan Mokhtari Sanjay Shakkottai 19 3 0 27 Oct 2020
Bilevel Optimization: Convergence Analysis and Enhanced Design Kaiyi Ji Junjie Yang Yingbin Liang 28 245 0 15 Oct 2020
How Important is the Train-Validation Split in Meta-Learning? Yu Bai Minshuo Chen Pan Zhou T. Zhao J. Lee Sham Kakade Haiquan Wang Caiming Xiong 16 53 0 12 Oct 2020
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML Aniruddh Raghu M. Raghu Samy Bengio Oriol Vinyals 180 639 0 19 Sep 2019
Probabilistic Model-Agnostic Meta-Learning Chelsea Finn Kelvin Xu Sergey Levine BDL 173 666 0 07 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 341 11,684 0 09 Mar 2017