Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization

28 January 2025

Papers citing "Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization"

50 / 51 papers shown

Title
Negative Stepsizes Make Gradient-Descent-Ascent Converge Henry Shugart Jason M. Altschuler 55 0 0 02 May 2025
$O(1/k)$ Finite-Time Bound for Non-Linear Two-Time-Scale Stochastic Approximation Siddharth Chandak 66 1 0 27 Apr 2025
Non-Expansive Mappings in Two-Time-Scale Stochastic Approximation: Finite-Time Analysis Siddharth Chandak 78 1 0 18 Jan 2025
Nonsmooth Nonconvex-Nonconcave Minimax Optimization: Primal-Dual Balancing and Iteration Complexity Analysis Jiajin Li Lingling Zhu Anthony Man-Cho So 90 4 0 17 Jan 2025
Causal Invariance Learning via Efficient Optimization of a Nonconvex Objective Zhenyu Wang Yifan Hu Peter Buhlmann Zijian Guo 139 2 0 16 Dec 2024
Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax Optimization Taoli Zheng Lingling Zhu Anthony Man-Cho So Jose H. Blanchet Jiajin Li 64 13 0 26 Dec 2022
TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax Optimization Xiang Li Junchi Yang Niao He 59 9 0 31 Oct 2022
STay-ON-the-Ridge: Guaranteed Convergence to Local Minimax Equilibrium in Nonconvex-Nonconcave Games C. Daskalakis Noah Golowich Stratis Skoulakis Manolis Zampetakis 86 6 0 18 Oct 2022
On Convergence of Gradient Descent Ascent: A Tight Local Analysis Haochuan Li Farzan Farnia Subhro Das Ali Jadbabaie 72 10 0 03 Jul 2022
Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone Inclusion Yang Cai Argyris Oikonomou Weiqiang Zheng 52 19 0 10 Jun 2022
Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization Junchi Yang Xiang Li Niao He ODL 64 22 0 01 Jun 2022
Faster Single-loop Algorithms for Minimax Optimization without Strong Concavity Junchi Yang Antonio Orvieto Aurelien Lucchi Niao He 77 63 0 10 Dec 2021
Extragradient Method: $O(1/K)$ Last-Iterate Convergence for Monotone Variational Inequalities and Connections With Cocoercivity Eduard A. Gorbunov Nicolas Loizou Gauthier Gidel 54 65 0 08 Oct 2021
Nonconvex-Nonconcave Min-Max Optimization with a Small Maximization Domain Dmitrii Ostrovskii Babak Barazandeh Meisam Razaviyayn 61 11 0 08 Oct 2021
Minimax Optimization with Smooth Algorithmic Adversaries Tanner Fiez Chi Jin Praneeth Netrapalli Lillian J. Ratliff AAML 31 11 0 02 Jun 2021
Complexity Lower Bounds for Nonconvex-Strongly-Concave Min-Max Optimization Haochuan Li Yi Tian Jingzhao Zhang Ali Jadbabaie 45 40 0 18 Apr 2021
The Complexity of Nonconvex-Strongly-Concave Minimax Optimization Siqi Zhang Junchi Yang Cristóbal Guzmán Negar Kiyavash Niao He 49 61 0 29 Mar 2021
Stochastic Variance Reduction for Variational Inequality Methods Ahmet Alacaoglu Yura Malitsky 60 70 0 16 Feb 2021
Efficient Methods for Structured Nonconvex-Nonconcave Min-Max Optimization Jelena Diakonikolas C. Daskalakis Michael I. Jordan 44 143 0 31 Oct 2020
A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems Jiawei Zhang Peijun Xiao Ruoyu Sun Zhi-Quan Luo 92 98 0 29 Oct 2020
The Complexity of Constrained Min-Max Optimization C. Daskalakis Stratis Skoulakis Manolis Zampetakis 81 136 0 21 Sep 2020
Stochastic Hamiltonian Gradient Methods for Smooth Games Nicolas Loizou Hugo Berard Alexia Jolicoeur-Martineau Pascal Vincent Simon Lacoste-Julien Ioannis Mitliagkas 43 50 0 08 Jul 2020
A Unified Single-loop Alternating Gradient Projection Algorithm for Nonconvex-Concave and Convex-Nonconcave Minimax Problems Zi Xu Hui-Li Zhang Yang Xu Guanghui Lan 55 99 0 03 Jun 2020
Solving Non-Convex Non-Differentiable Min-Max Games using Proximal Gradient Method Babak Barazandeh Meisam Razaviyayn 14 24 0 18 Mar 2020
Complexity of Finding Stationary Points of Nonsmooth Nonconvex Functions J.N. Zhang Hongzhou Lin Stefanie Jegelka Ali Jadbabaie S. Sra 39 44 0 10 Feb 2020
Near-Optimal Algorithms for Minimax Optimization Tianyi Lin Chi Jin Michael I. Jordan 105 252 0 05 Feb 2020
SGD Learns One-Layer Networks in WGANs Qi Lei Jason D. Lee A. Dimakis C. Daskalakis GAN 35 35 0 15 Oct 2019
Efficient Algorithms for Smooth Minimax Optimization K. K. Thekumparampil Prateek Jain Praneeth Netrapalli Sewoong Oh 66 191 0 02 Jul 2019
On Gradient Descent Ascent for Nonconvex-Concave Minimax Problems Tianyi Lin Chi Jin Michael I. Jordan 91 505 0 02 Jun 2019
Solving a Class of Non-Convex Min-Max Games Using Iterative First Order Methods Maher Nouiehed Maziar Sanjabi Tianjian Huang Jason D. Lee Meisam Razaviyayn 76 340 0 21 Feb 2019
Hybrid Block Successive Approximation for One-Sided Non-Convex Min-Max Problems: Algorithms and Applications Songtao Lu Ioannis C. Tsaknakis Mingyi Hong Yongxin Chen 57 170 0 21 Feb 2019
A Unified Analysis of Extra-gradient and Optimistic Gradient Methods for Saddle Point Problems: Proximal Point Approach Aryan Mokhtari Asuman Ozdaglar S. Pattathil 59 325 0 24 Jan 2019
Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learning Hassan Rafique Mingrui Liu Qihang Lin Tianbao Yang 34 108 0 04 Oct 2018
Last-Iterate Convergence: Zero-Sum Games and Constrained Min-Max Optimization C. Daskalakis Ioannis Panageas 54 178 0 11 Jul 2018
The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization C. Daskalakis Ioannis Panageas 42 255 0 11 Jul 2018
Optimistic mirror descent in saddle-point problems: Going the extra (gradient) mile P. Mertikopoulos Bruno Lecouat Houssam Zenati Chuan-Sheng Foo V. Chandrasekhar Georgios Piliouras 120 294 0 07 Jul 2018
Local Saddle Point Optimization: A Curvature Exploitation Approach Leonard Adolphs Hadi Daneshmand Aurelien Lucchi Thomas Hofmann 105 107 0 15 May 2018
Stochastic model-based minimization of weakly convex functions Damek Davis Dmitriy Drusvyatskiy 68 373 0 17 Mar 2018
On the Convergence and Robustness of Training GANs with Regularized Optimal Transport Maziar Sanjabi Jimmy Ba Meisam Razaviyayn Jason D. Lee GAN 61 137 0 22 Feb 2018
Interaction Matters: A Note on Non-asymptotic Local Convergence of Generative Adversarial Networks Tengyuan Liang J. Stokes 78 211 0 16 Feb 2018
The Mechanics of n-Player Differentiable Games David Balduzzi S. Racanière James Martens Jakob N. Foerster K. Tuyls T. Graepel MLT 60 274 0 15 Feb 2018
Training GANs with Optimism C. Daskalakis Andrew Ilyas Vasilis Syrgkanis Haoyang Zeng 129 514 0 31 Oct 2017
Cycles in adversarial regularized learning P. Mertikopoulos Christos H. Papadimitriou Georgios Piliouras 47 319 0 08 Sep 2017
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 243 11,962 0 19 Jun 2017
An Online Learning Approach to Generative Adversarial Networks Paulina Grnarova Kfir Y. Levy Aurelien Lucchi Thomas Hofmann Andreas Krause GAN 45 90 0 10 Jun 2017
Sub-sampled Cubic Regularization for Non-convex Optimization Jonas Köhler Aurelien Lucchi 47 165 0 16 May 2017
Distributionally Robust Logistic Regression Soroosh Shafieezadeh-Abadeh Peyman Mohajerin Esfahani Daniel Kuhn OOD 56 304 0 30 Sep 2015
Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes Ohad Shamir Tong Zhang 143 573 0 08 Dec 2012
Making Gradient Descent Optimal for Strongly Convex Stochastic Optimization Alexander Rakhlin Ohad Shamir Karthik Sridharan 130 764 0 26 Sep 2011
Solving variational inequalities with Stochastic Mirror-Prox algorithm A. Juditsky A. Nemirovskii Claire Tauvel 119 441 0 04 Sep 2008