On the One-sided Convergence of Adam-type Algorithms in Non-convex
Non-concave Min-max Optimization

On the One-sided Convergence of Adam-type Algorithms in Non-convex Non-concave Min-max Optimization

29 September 2021

Zehao Dou

Papers citing "On the One-sided Convergence of Adam-type Algorithms in Non-convex Non-concave Min-max Optimization"

7 / 7 papers shown

Title
Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum H. Cai Sulaiman A. Alghunaim Ali H.Sayed 43 1 0 18 Jun 2024
Regularized Gradient Clipping Provably Trains Wide and Deep Neural Networks Matteo Tucat Anirbit Mukherjee Procheta Sen Mingfei Sun Omar Rivasplata MLT 31 1 0 12 Apr 2024
Similarity, Compression and Local Steps: Three Pillars of Efficient Communications for Distributed Variational Inequalities Aleksandr Beznosikov Martin Takáč Alexander Gasnikov 26 10 0 15 Feb 2023
Smooth Monotone Stochastic Variational Inequalities and Saddle Point Problems: A Survey Aleksandr Beznosikov Boris Polyak Eduard A. Gorbunov D. Kovalev Alexander Gasnikov 37 31 0 29 Aug 2022
On Scaled Methods for Saddle Point Problems Aleksandr Beznosikov Aibek Alanov D. Kovalev Martin Takáč Alexander Gasnikov 22 4 0 16 Jun 2022
Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization Junchi Yang Xiang Li Niao He ODL 27 22 0 01 Jun 2022
Decentralized Local Stochastic Extra-Gradient for Variational Inequalities Aleksandr Beznosikov Pavel Dvurechensky Anastasia Koloskova V. Samokhin Sebastian U. Stich Alexander Gasnikov 26 43 0 15 Jun 2021