A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems

29 October 2020

Papers citing "A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems"

50 / 52 papers shown

Title
Stochastic Smoothed Primal-Dual Algorithms for Nonconvex Optimization with Linear Inequality Constraints Ruichuan Huang Jiawei Zhang Ahmet Alacaoglu 42 0 0 10 Apr 2025
Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization Tianyi Lin Chi Jin Michael I. Jordan 52 6 0 28 Jan 2025
Nonsmooth Nonconvex-Nonconcave Minimax Optimization: Primal-Dual Balancing and Iteration Complexity Analysis Jiajin Li Lingling Zhu Anthony Man-Cho So 54 4 0 17 Jan 2025
Gradient Norm Regularization Second-Order Algorithms for Solving Nonconvex-Strongly Concave Minimax Problems Jun-Lin Wang Zi Xu 75 1 0 24 Nov 2024
ADMM for Structured Fractional Minimization Ganzhao Yuan 31 0 0 12 Nov 2024
In-Trajectory Inverse Reinforcement Learning: Learn Incrementally Before An Ongoing Trajectory Terminates Shicheng Liu Minghui Zhu 49 1 0 21 Oct 2024
Two Completely Parameter-Free Alternating Gradient Projection Algorithms for Nonconvex-(strongly) Concave Minimax Problems Junnan Yang Huiling Zhang Zi Xu 31 1 0 31 Jul 2024
A Fully Parameter-Free Second-Order Algorithm for Convex-Concave Minimax Problems with Optimal Iteration Complexity Junlin Wang Junnan Yang Zi Xu 34 2 0 04 Jul 2024
Single-loop Stochastic Algorithms for Difference of Max-Structured Weakly Convex Functions Quanqi Hu Qi Qi Zhaosong Lu Tianbao Yang 34 1 0 28 May 2024
Continual Forgetting for Pre-trained Vision Models Hongbo Zhao Bolin Ni Haochen Wang Junsong Fan Fei Zhu Yuxi Wang Yuntao Chen Gaofeng Meng Zhaoxiang Zhang MU VLM 63 11 0 18 Mar 2024
Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization Tianqi Zheng Nicolas Loizou Pengcheng You Enrique Mallada 29 1 0 14 Mar 2024
Inverse Design of Photonic Crystal Surface Emitting Lasers is a Sequence Modeling Problem Ceyao Zhang Renjie Li Cheng Zhang Zhaoyu Zhang Feng Yin 29 0 0 08 Mar 2024
Smooth Tchebycheff Scalarization for Multi-Objective Optimization Xi Lin Xiao-Yan Zhang Zhiyuan Yang Fei Liu Zhenkun Wang Qingfu Zhang 35 16 0 29 Feb 2024
Zeroth-Order primal-dual Alternating Projection Gradient Algorithms for Nonconvex Minimax Problems with Coupled linear Constraints Hui-Li Zhang Zi Xu Yuhong Dai 16 1 0 26 Jan 2024
Fast Nonlinear Two-Time-Scale Stochastic Approximation: Achieving $O(1/k)$ Finite-Sample Complexity Thinh T. Doan 30 7 0 23 Jan 2024
Stochastic Smoothed Gradient Descent Ascent for Federated Minimax Optimization Wei Shen Minhui Huang Jiawei Zhang Cong Shen FedML 33 1 0 02 Nov 2023
Complexity of Single Loop Algorithms for Nonlinear Programming with Stochastic Objective and Constraints Ahmet Alacaoglu Stephen J. Wright 20 10 0 01 Nov 2023
An accelerated first-order regularized momentum descent ascent algorithm for stochastic nonconvex-concave minimax problems Hui-Li Zhang Zi Xu ODL 29 0 0 24 Oct 2023
On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation Jeongyeol Kwon Dohyun Kwon Steve Wright Robert D. Nowak 26 25 0 04 Sep 2023
Accelerating Inexact HyperGradient Descent for Bilevel Optimization Hai-Long Yang Luo Luo C. J. Li Michael I. Jordan 18 13 0 30 Jun 2023
Federated Compositional Deep AUC Maximization Xinwen Zhang Yihang Zhang Tianbao Yang Richard Souvenir Hongchang Gao FedML 20 7 0 20 Apr 2023
Decentralized gradient descent maximization method for composite nonconvex strongly-concave minimax problems Yangyang Xu 24 9 0 05 Apr 2023
Enhanced Adaptive Gradient Algorithms for Nonconvex-PL Minimax Optimization Feihu Huang Chunyu Xuan Xinrui Wang Siqi Zhang Songcan Chen 28 7 0 07 Mar 2023
Federated Minimax Optimization with Client Heterogeneity Pranay Sharma Rohan Panda Gauri Joshi FedML 30 9 0 08 Feb 2023
A first-order augmented Lagrangian method for constrained minimax optimization Zhaosong Lu Sanyou Mei 21 6 0 05 Jan 2023
Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax Optimization Taoli Zheng Lingling Zhu Anthony Man-Cho So Jose H. Blanchet Jiajin Li 40 13 0 26 Dec 2022
Policy Gradient in Robust MDPs with Global Convergence Guarantee Qiuhao Wang C. Ho Marek Petrik 27 24 0 20 Dec 2022
Primal Dual Alternating Proximal Gradient Algorithms for Nonsmooth Nonconvex Minimax Problems with Coupled Linear Constraints Hui-Li Zhang Junlin Wang Zi Xu Y. Dai 72 4 0 09 Dec 2022
An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization Le‐Yu Chen Haishan Ye Luo Luo 60 5 0 05 Dec 2022
Zeroth-Order Alternating Gradient Descent Ascent Algorithms for a Class of Nonconvex-Nonconcave Minimax Problems Zi Xu Ziqi Wang Junlin Wang Y. Dai 11 11 0 24 Nov 2022
Tight Analysis of Extra-gradient and Optimistic Gradient Methods For Nonconvex Minimax Problems Pouria Mahdavinia Yuyang Deng Haochuan Li M. Mahdavi 26 12 0 17 Oct 2022
Stability Analysis and Generalization Bounds of Adversarial Training Jiancong Xiao Yanbo Fan Ruoyu Sun Jue Wang Zhimin Luo AAML 24 30 0 03 Oct 2022
A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization Songtao Lu 19 18 0 12 Jul 2022
What is a Good Metric to Study Generalization of Minimax Learners? Asuman Ozdaglar S. Pattathil Jiawei Zhang K. Zhang 19 13 0 09 Jun 2022
Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization Junchi Yang Xiang Li Niao He ODL 27 22 0 01 Jun 2022
Generalization Bounds of Nonconvex-(Strongly)-Concave Stochastic Minimax Optimization Siqi Zhang Yifan Hu Liang Zhang Niao He 30 3 0 28 May 2022
Will Bilevel Optimizers Benefit from Loops Kaiyi Ji Mingrui Liu Yingbin Liang Lei Ying 37 41 0 27 May 2022
Federated Minimax Optimization: Improved Convergence Analyses and Algorithms Pranay Sharma Rohan Panda Gauri Joshi P. Varshney FedML 21 46 0 09 Mar 2022
Efficiently Escaping Saddle Points in Bilevel Optimization Minhui Huang Xuxing Chen Kaiyi Ji Shiqian Ma Lifeng Lai 26 20 0 08 Feb 2022
Convergence Rates of Two-Time-Scale Gradient Descent-Ascent Dynamics for Solving Nonconvex Min-Max Problems Thinh T. Doan 20 15 0 17 Dec 2021
Faster Single-loop Algorithms for Minimax Optimization without Strong Concavity Junchi Yang Antonio Orvieto Aurélien Lucchi Niao He 22 61 0 10 Dec 2021
Randomized Stochastic Gradient Descent Ascent Othmane Sebbouh Marco Cuturi Gabriel Peyré 124 7 0 25 Nov 2021
Low-rank Matrix Recovery With Unknown Correspondence Zhiwei Tang Tsung-Hui Chang X. Ye H. Zha 37 4 0 15 Oct 2021
Nonconvex-Nonconcave Min-Max Optimization with a Small Maximization Domain Dmitrii Ostrovskii Babak Barazandeh Meisam Razaviyayn 16 11 0 08 Oct 2021
GDA-AM: On the effectiveness of solving minimax optimization via Anderson Acceleration Huan He Shifan Zhao Yuanzhe Xi Joyce C. Ho Y. Saad 30 1 0 06 Oct 2021
Derivative-free Alternating Projection Algorithms for General Nonconvex-Concave Minimax Problems Zi Xu Ziqi Wang Jingjing Shen Yuhong Dai 16 10 0 01 Aug 2021
Local AdaGrad-Type Algorithm for Stochastic Convex-Concave Optimization Luofeng Liao Li Shen Jia Duan Mladen Kolar Dacheng Tao 19 4 0 18 Jun 2021
The Complexity of Nonconvex-Strongly-Concave Minimax Optimization Siqi Zhang Junchi Yang Cristóbal Guzmán Negar Kiyavash Niao He 31 60 0 29 Mar 2021
Towards a Better Global Loss Landscape of GANs Ruoyu Sun Tiantian Fang A. Schwing GAN 30 26 0 10 Nov 2020
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 329 11,681 0 09 Mar 2017