Faster Single-loop Algorithms for Minimax Optimization without Strong Concavity

10 December 2021

Antonio Orvieto

Papers citing "Faster Single-loop Algorithms for Minimax Optimization without Strong Concavity"

39 / 39 papers shown

Title
Continuous-Time Analysis of Heavy Ball Momentum in Min-Max Games Yi-Hu Feng Kaito Fujii Stratis Skoulakis Xiao Wang Volkan Cevher 98 0 0 26 May 2025
Convergence of Time-Averaged Mean Field Gradient Descent Dynamics for Continuous Multi-Player Zero-Sum Games Yulong Lu Pierre Monmarché MLT 53 1 0 12 May 2025
Diffusion Stochastic Learning Over Adaptive Competing Networks Yike Zhao H. Cai Ali H. Sayed DiffM 66 0 0 28 Apr 2025
A stochastic smoothing framework for nonconvex-nonconcave min-sum-max problems with applications to Wasserstein distributionally robust optimization Wei Liu Muhammad Khan Gabriel Mancino-Ball Yangyang Xu 87 1 0 24 Feb 2025
Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization Tianyi Lin Chi Jin Michael I. Jordan 152 8 0 28 Jan 2025
Nonsmooth Nonconvex-Nonconcave Minimax Optimization: Primal-Dual Balancing and Iteration Complexity Analysis Jiajin Li Lingling Zhu Anthony Man-Cho So 161 5 0 17 Jan 2025
Nonlinear Perturbation-based Non-Convex Optimization over Time-Varying Networks Mohammadreza Doostmohammadian Zulfiya R. Gabidullina Hamid R. Rabiee 66 9 0 05 Aug 2024
Accelerating Distributed Optimization: A Primal-Dual Perspective on Local Steps Junchi Yang Murat Yildirim Qiu Feng 112 0 0 02 Jul 2024
Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum H. Cai Sulaiman A. Alghunaim Ali H.Sayed 115 1 0 18 Jun 2024
Achieving Near-Optimal Convergence for Distributed Minimax Optimization with Adaptive Stepsizes Yan Huang Xiang Li Yipeng Shen Niao He Jinming Xu 102 1 0 05 Jun 2024
Single-loop Stochastic Algorithms for Difference of Max-Structured Weakly Convex Functions Quanqi Hu Qi Qi Zhaosong Lu Tianbao Yang 103 2 0 28 May 2024
Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization Tianqi Zheng Nicolas Loizou Pengcheng You Enrique Mallada 81 1 0 14 Mar 2024
Learning with Logical Constraints but without Shortcut Satisfaction Zenan Li Zehua Liu Yuan Yao Jingwei Xu Taolue Chen Xiaoxing Ma Jian Lu NAI 103 20 0 01 Mar 2024
Diffusion Stochastic Optimization for Min-Max Problems H. Cai Sulaiman A. Alghunaim Ali H. Sayed 79 2 0 26 Jan 2024
Stochastic Smoothed Gradient Descent Ascent for Federated Minimax Optimization Wei Shen Minhui Huang Jiawei Zhang Cong Shen FedML 108 2 0 02 Nov 2023
An accelerated first-order regularized momentum descent ascent algorithm for stochastic nonconvex-concave minimax problems Hui-Li Zhang Zi Xu ODL 87 0 0 24 Oct 2023
Zero-Shot Sharpness-Aware Quantization for Pre-trained Language Models Miaoxi Zhu Qihuang Zhong Li Shen Liang Ding Juhua Liu Bo Du Dacheng Tao MQ VLM 71 1 0 20 Oct 2023
Solving a Class of Non-Convex Minimax Optimization in Federated Learning Xidong Wu Jianhui Sun Zhengmian Hu Aidong Zhang Heng-Chiao Huang FedML 158 13 0 05 Oct 2023
On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation Jeongyeol Kwon Dohyun Kwon Steve Wright Robert D. Nowak 96 30 0 04 Sep 2023
Faster Stochastic Algorithms for Minimax Optimization under Polyak--Łojasiewicz Conditions Le‐Yu Chen Boyuan Yao Luo Luo 64 15 0 29 Jul 2023
Variance-reduced accelerated methods for decentralized stochastic double-regularized nonconvex strongly-concave minimax problems Gabriel Mancino-Ball Yangyang Xu 124 8 0 14 Jul 2023
Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates Siqi Zhang S. Choudhury Sebastian U. Stich Nicolas Loizou FedML 139 4 0 08 Jun 2023
Near-Optimal Decentralized Momentum Method for Nonconvex-PL Minimax Problems Feihu Huang Songcan Chen 82 5 0 21 Apr 2023
Robust Generalization against Photon-Limited Corruptions via Worst-Case Sharpness Minimization Zhuo Huang Miaoxi Zhu Xiaobo Xia Li Shen Jun Yu Chen Gong Bo Han Bo Du Tongliang Liu 83 36 0 23 Mar 2023
Enhanced Adaptive Gradient Algorithms for Nonconvex-PL Minimax Optimization Feihu Huang Chunyu Xuan Xinrui Wang Siqi Zhang Songcan Chen 122 7 0 07 Mar 2023
Federated Minimax Optimization with Client Heterogeneity Pranay Sharma Rohan Panda Gauri Joshi FedML 94 9 0 08 Feb 2023
Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax Optimization Taoli Zheng Lingling Zhu Anthony Man-Cho So Jose H. Blanchet Jiajin Li 133 15 0 26 Dec 2022
Two-Scale Gradient Descent Ascent Dynamics Finds Mixed Nash Equilibria of Continuous Games: A Mean-Field Perspective Yulong Lu MLT AI4CE 59 23 0 17 Dec 2022
Zeroth-Order Alternating Gradient Descent Ascent Algorithms for a Class of Nonconvex-Nonconcave Minimax Problems Zi Xu Ziqi Wang Junlin Wang Y. Dai 106 11 0 24 Nov 2022
TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax Optimization Xiang Li Junchi Yang Niao He 81 9 0 31 Oct 2022
Tight Analysis of Extra-gradient and Optimistic Gradient Methods For Nonconvex Minimax Problems Pouria Mahdavinia Yuyang Deng Haochuan Li M. Mahdavi 117 13 0 17 Oct 2022
SGDA with shuffling: faster convergence for nonconvex-PŁ minimax optimization Hanseul Cho Chulhee Yun 64 9 0 12 Oct 2022
What is a Good Metric to Study Generalization of Minimax Learners? Asuman Ozdaglar S. Pattathil Jiawei Zhang Kai Zhang 71 14 0 09 Jun 2022
Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization Junchi Yang Xiang Li Niao He ODL 113 22 0 01 Jun 2022
Algorithmic Foundations of Empirical X-risk Minimization Tianbao Yang 166 6 0 01 Jun 2022
Generalization Bounds of Nonconvex-(Strongly)-Concave Stochastic Minimax Optimization Siqi Zhang Yifan Hu Liang Zhang Niao He 91 4 0 28 May 2022
AUC Maximization in the Era of Big Data and AI: A Survey Tianbao Yang Yiming Ying 181 193 0 28 Mar 2022
Federated Minimax Optimization: Improved Convergence Analyses and Algorithms Pranay Sharma Rohan Panda Gauri Joshi P. Varshney FedML 114 49 0 09 Mar 2022
A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems Jiawei Zhang Peijun Xiao Ruoyu Sun Zhi-Quan Luo 128 99 0 29 Oct 2020