On the Convergence of Distributed Stochastic Bilevel Optimization
Algorithms over a Network

v1v2 (latest)

On the Convergence of Distributed Stochastic Bilevel Optimization Algorithms over a Network

30 June 2022

ArXiv (abs)PDF HTML

Papers citing "On the Convergence of Distributed Stochastic Bilevel Optimization Algorithms over a Network"

18 / 18 papers shown

Title
When Decentralized Optimization Meets Federated Learning Hongchang Gao My T. Thai Jie Wu FedML 83 23 0 05 Jun 2023
Decentralized Stochastic Gradient Descent Ascent for Finite-Sum Minimax Problems Hongchang Gao 71 16 0 06 Dec 2022
Decentralized Gossip-Based Stochastic Bilevel Optimization over Communication Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang 66 45 0 22 Jun 2022
A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum Prashant Khanduri Siliang Zeng Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 72 132 0 15 Feb 2021
A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization Ran Xin U. Khan S. Kar 37 39 0 12 Feb 2021
Bilevel Optimization: Convergence Analysis and Enhanced Design Kaiyi Ji Junjie Yang Yingbin Liang 201 261 0 15 Oct 2020
PowerGossip: Practical Low-Rank Communication Compression in Decentralized Deep Learning Thijs Vogels Sai Praneeth Karimireddy Martin Jaggi FedML 54 54 0 04 Aug 2020
Improving the Sample and Communication Complexity for Decentralized Non-Convex Optimization: A Joint Gradient Estimation and Tracking Approach Haoran Sun Songtao Lu Mingyi Hong 61 37 0 13 Oct 2019
Meta-Learning with Implicit Gradients Aravind Rajeswaran Chelsea Finn Sham Kakade Sergey Levine 116 858 0 10 Sep 2019
$$\texttt{DeepSqueeze}$: Decentralization Meets Error-Compensated Compression$ $\texttt{DeepSqueeze}$ : Decentralization Meets Error-Compensated Compression Hanlin Tang Xiangru Lian Shuang Qiu Lei Yuan Ce Zhang Tong Zhang Liu 33 49 0 17 Jul 2019
Momentum-Based Variance Reduction in Non-Convex SGD Ashok Cutkosky Francesco Orabona ODL 88 410 0 24 May 2019
Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication Anastasia Koloskova Sebastian U. Stich Martin Jaggi FedML 83 511 0 01 Feb 2019
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator Cong Fang C. J. Li Zhouchen Lin Tong Zhang 95 580 0 04 Jul 2018
DARTS: Differentiable Architecture Search Hanxiao Liu Karen Simonyan Yiming Yang 204 4,366 0 24 Jun 2018
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 179 732 0 13 Jun 2018
Distributed Stochastic Gradient Tracking Methods Shi Pu A. Nedić 81 293 0 25 May 2018
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent Xiangru Lian Ce Zhang Huan Zhang Cho-Jui Hsieh Wei Zhang Ji Liu 50 1,235 0 25 May 2017
Decentralized Frank-Wolfe Algorithm for Convex and Non-convex Problems Hoi-To Wai Jean Lafond Anna Scaglione Eric Moulines 111 90 0 05 Dec 2016