Enhanced Adaptive Gradient Algorithms for Nonconvex-PL Minimax Optimization

7 March 2023

Papers citing "Enhanced Adaptive Gradient Algorithms for Nonconvex-PL Minimax Optimization"

29 / 29 papers shown

Title
Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum H. Cai Sulaiman A. Alghunaim Ali H.Sayed 61 1 0 18 Jun 2024
An accelerated first-order regularized momentum descent ascent algorithm for stochastic nonconvex-concave minimax problems Hui-Li Zhang Zi Xu ODL 40 0 0 24 Oct 2023
Faster Stochastic Variance Reduction Methods for Compositional MiniMax Optimization Jin Liu Xiaokang Pan Junwen Duan Hongdong Li Youqi Li Zhe Qu 46 1 0 18 Aug 2023
Faster Stochastic Algorithms for Minimax Optimization under Polyak--Łojasiewicz Conditions Le‐Yu Chen Boyuan Yao Luo Luo 34 15 0 29 Jul 2023
Near-Optimal Decentralized Momentum Method for Nonconvex-PL Minimax Problems Feihu Huang Songcan Chen 37 5 0 21 Apr 2023
A first-order augmented Lagrangian method for constrained minimax optimization Zhaosong Lu Sanyou Mei 53 6 0 05 Jan 2023
Zeroth-Order Alternating Gradient Descent Ascent Algorithms for a Class of Nonconvex-Nonconcave Minimax Problems Zi Xu Ziqi Wang Junlin Wang Y. Dai 33 11 0 24 Nov 2022
Adaptive Federated Minimax Optimization with Lower Complexities Feihu Huang Xinrui Wang Junyi Li Songcan Chen FedML 53 5 0 14 Nov 2022
TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax Optimization Xiang Li Junchi Yang Niao He 44 9 0 31 Oct 2022
Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization Junchi Yang Xiang Li Niao He ODL 51 22 0 01 Jun 2022
A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimization Ziyi Chen B. Kailkhura Yi Zhou 45 8 0 30 Mar 2022
Faster Single-loop Algorithms for Minimax Optimization without Strong Concavity Junchi Yang Antonio Orvieto Aurelien Lucchi Niao He 56 63 0 10 Dec 2021
A Novel Convergence Analysis for Algorithms of the Adam Family Zhishuai Guo Yi Tian Xu W. Yin Rong Jin Tianbao Yang 54 49 0 07 Dec 2021
Proxy Convexity: A Unified Framework for the Analysis of Neural Networks Trained by Gradient Descent Spencer Frei Quanquan Gu 36 26 0 25 Jun 2021
SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients Feihu Huang Junyi Li Heng-Chiao Huang ODL 11 42 0 15 Jun 2021
Distributionally Robust Federated Averaging Yuyang Deng Mohammad Mahdi Kamani M. Mahdavi FedML 15 142 0 25 Feb 2021
Proximal Gradient Descent-Ascent: Variable Convergence under KŁ Geometry Ziyi Chen Yi Zhou Tengyu Xu Yingbin Liang 58 34 0 09 Feb 2021
A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems Jiawei Zhang Peijun Xiao Ruoyu Sun Zhi-Quan Luo 68 98 0 29 Oct 2020
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients Juntang Zhuang Tommy M. Tang Yifan Ding S. Tatikonda Nicha Dvornek X. Papademetris James S. Duncan ODL 42 505 0 15 Oct 2020
Communication-Efficient Distributed Stochastic AUC Maximization with Deep Neural Networks Zhishuai Guo Mingrui Liu Zhuoning Yuan Li Shen Wei Liu Tianbao Yang 38 42 0 05 May 2020
Lower Bounds for Non-Convex Stochastic Optimization Yossi Arjevani Y. Carmon John C. Duchi Dylan J. Foster Nathan Srebro Blake E. Woodworth 47 349 0 05 Dec 2019
A Hybrid Stochastic Optimization Framework for Stochastic Composite Nonconvex Optimization Quoc Tran-Dinh Nhan H. Pham T. Dzung Lam M. Nguyen 32 50 0 08 Jul 2019
On Gradient Descent Ascent for Nonconvex-Concave Minimax Problems Tianyi Lin Chi Jin Michael I. Jordan 55 505 0 02 Jun 2019
Momentum-Based Variance Reduction in Non-Convex SGD Ashok Cutkosky Francesco Orabona ODL 50 402 0 24 May 2019
Solving a Class of Non-Convex Min-Max Games Using Iterative First Order Methods Maher Nouiehed Maziar Sanjabi Tianjian Huang Jason D. Lee Meisam Razaviyayn 55 340 0 21 Feb 2019
Hybrid Block Successive Approximation for One-Sided Non-Convex Min-Max Problems: Algorithms and Applications Songtao Lu Ioannis C. Tsaknakis Mingyi Hong Yongxin Chen 41 170 0 21 Feb 2019
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 175 11,962 0 19 Jun 2017
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark Schmidt 174 1,208 0 16 Aug 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 229 149,474 0 22 Dec 2014