Convergence Rates of Two-Time-Scale Gradient Descent-Ascent Dynamics for Solving Nonconvex Min-Max Problems

17 December 2021

Papers citing "Convergence Rates of Two-Time-Scale Gradient Descent-Ascent Dynamics for Solving Nonconvex Min-Max Problems"

35 / 35 papers shown

Title
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 267 30,123 0 01 Mar 2022
Finite-Time Complexity of Online Primal-Dual Natural Actor-Critic Algorithm for Constrained Markov Decision Processes Sihan Zeng Thinh T. Doan Justin Romberg 129 18 0 21 Oct 2021
A Two-Time-Scale Stochastic Optimization Framework with Applications in Control and Reinforcement Learning Sihan Zeng Thinh T. Doan Justin Romberg 121 25 0 29 Sep 2021
Gradient play in stochastic games: stationary points, convergence, and sample complexity Runyu Zhang Tongzheng Ren Na Li 78 43 0 01 Jun 2021
Fast Policy Extragradient Methods for Competitive Games with Entropy Regularization Shicong Cen Yuting Wei Yuejie Chi 85 78 0 31 May 2021
Finite-Time Convergence Rates of Nonlinear Two-Time-Scale Stochastic Approximation under Markovian Noise Thinh T. Doan 74 16 0 04 Apr 2021
Independent Policy Gradient Methods for Competitive Reinforcement Learning C. Daskalakis Dylan J. Foster Noah Golowich 206 161 0 11 Jan 2021
Nonlinear Two-Time-Scale Stochastic Approximation: Convergence and Finite-Time Performance Thinh T. Doan 69 46 0 03 Nov 2020
A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems Jiawei Zhang Peijun Xiao Ruoyu Sun Zhi-Quan Luo 102 99 0 29 Oct 2020
Stochastic Hamiltonian Gradient Methods for Smooth Games Nicolas Loizou Hugo Berard Alexia Jolicoeur-Martineau Pascal Vincent Simon Lacoste-Julien Ioannis Mitliagkas 45 50 0 08 Jul 2020
Improved Algorithms for Convex-Concave Minimax Optimization Yuanhao Wang Jian Li 56 64 0 11 Jun 2020
A Unified Single-loop Alternating Gradient Projection Algorithm for Nonconvex-Concave and Convex-Nonconcave Minimax Problems Zi Xu Hui-Li Zhang Yang Xu Guanghui Lan 61 100 0 03 Jun 2020
Near-Optimal Algorithms for Minimax Optimization Tianyi Lin Chi Jin Michael I. Jordan 145 254 0 05 Feb 2020
Finite Time Analysis of Linear Two-timescale Stochastic Approximation with Markovian Noise Maxim Kaledin Eric Moulines A. Naumov V. Tadic Hoi-To Wai 62 73 0 04 Feb 2020
Last Iterate is Slower than Averaged Iterate in Smooth Convex-Concave Saddle Point Problems Noah Golowich S. Pattathil C. Daskalakis Asuman Ozdaglar 42 105 0 31 Jan 2020
Finite-Time Analysis and Restarting Scheme for Linear Two-Time-Scale Stochastic Approximation Thinh T. Doan 50 36 0 23 Dec 2019
A Tale of Two-Timescale Reinforcement Learning with the Tightest Finite-Time Bound Gal Dalal Balazs Szorenyi Gugan Thoppe OffRL 57 52 0 20 Nov 2019
Constrained Reinforcement Learning Has Zero Duality Gap Santiago Paternain Luiz F. O. Chamon Miguel Calvo-Fullana Alejandro Ribeiro 54 192 0 29 Oct 2019
Finite-Time Performance Bounds and Adaptive Learning Rate Selection for Two Time-Scale Reinforcement Learning Harsh Gupta R. Srikant Lei Ying 56 86 0 14 Jul 2019
Efficient Algorithms for Smooth Minimax Optimization K. K. Thekumparampil Prateek Jain Praneeth Netrapalli Sewoong Oh 83 192 0 02 Jul 2019
On Gradient Descent Ascent for Nonconvex-Concave Minimax Problems Tianyi Lin Chi Jin Michael I. Jordan 117 507 0 02 Jun 2019
Policy Optimization Provably Converges to Nash Equilibria in Zero-Sum Linear Quadratic Games Kai Zhang Zhuoran Yang Tamer Basar 80 125 0 31 May 2019
Solving a Class of Non-Convex Min-Max Games Using Iterative First Order Methods Maher Nouiehed Maziar Sanjabi Tianjian Huang Jason D. Lee Meisam Razaviyayn 80 344 0 21 Feb 2019
Hybrid Block Successive Approximation for One-Sided Non-Convex Min-Max Problems: Algorithms and Applications Songtao Lu Ioannis C. Tsaknakis Mingyi Hong Yongxin Chen 69 170 0 21 Feb 2019
Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learning Hassan Rafique Mingrui Liu Qihang Lin Tianbao Yang 53 109 0 04 Oct 2018
An Exact Quantized Decentralized Gradient Descent Algorithm Amirhossein Reisizadeh Aryan Mokhtari Hamed Hassani Ramtin Pedarsani 51 124 0 29 Jun 2018
Robust Optimization over Multiple Domains Qi Qian Shenghuo Zhu Jiasheng Tang Rong Jin Baigui Sun Hao Li OOD 61 71 0 19 May 2018
The Mechanics of n-Player Differentiable Games David Balduzzi S. Racanière James Martens Jakob N. Foerster K. Tuyls T. Graepel MLT 79 274 0 15 Feb 2018
Constrained Policy Optimization Joshua Achiam David Held Aviv Tamar Pieter Abbeel 110 1,322 0 30 May 2017
The Numerics of GANs L. Mescheder Sebastian Nowozin Andreas Geiger GAN 87 456 0 30 May 2017
Communication-Efficient Algorithms for Decentralized and Stochastic Optimization Guanghui Lan Soomin Lee Yi Zhou 71 218 0 14 Jan 2017
Adversarial Machine Learning at Scale Alexey Kurakin Ian Goodfellow Samy Bengio AAML 469 3,140 0 04 Nov 2016
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark Schmidt 275 1,218 0 16 Aug 2016
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights Weijie Su Stephen P. Boyd Emmanuel J. Candes 157 1,166 0 04 Mar 2015
Stochastic Compositional Gradient Descent: Algorithms for Minimizing Compositions of Expected-Value Functions Mengdi Wang Ethan X. Fang Han Liu 93 264 0 14 Nov 2014