Negative Momentum for Improved Game Dynamics

12 July 2018

Gauthier Gidel

Reyhane Askari Hemmat

Papers citing "Negative Momentum for Improved Game Dynamics"

35 / 35 papers shown

Title
Negative Stepsizes Make Gradient-Descent-Ascent Converge Henry Shugart Jason M. Altschuler 30 0 0 02 May 2025
Pseudo-Asynchronous Local SGD: Robust and Efficient Data-Parallel Training Hiroki Naganuma Xinzhi Zhang Man-Chung Yue Ioannis Mitliagkas Philipp A. Witte Russell J. Hewett Yin Tat Lee 65 0 0 25 Apr 2025
MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts R. Teo Tan M. Nguyen MoE 40 3 0 18 Oct 2024
One-Shot Safety Alignment for Large Language Models via Optimal Dualization Xinmeng Huang Shuo Li Yan Sun Osbert Bastani Hamed Hassani Dongsheng Ding 49 4 0 29 May 2024
Optimal Guarantees for Algorithmic Reproducibility and Gradient Complexity in Convex Optimization Liang Zhang Junchi Yang Amin Karbasi Niao He 34 2 0 26 Oct 2023
Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates Siqi Zhang S. Choudhury Sebastian U. Stich Nicolas Loizou FedML 19 3 0 08 Jun 2023
Primal Dual Alternating Proximal Gradient Algorithms for Nonsmooth Nonconvex Minimax Problems with Coupled Linear Constraints Hui-Li Zhang Junlin Wang Zi Xu Y. Dai 88 4 0 09 Dec 2022
Smooth Monotone Stochastic Variational Inequalities and Saddle Point Problems: A Survey Aleksandr Beznosikov Boris Polyak Eduard A. Gorbunov D. Kovalev Alexander Gasnikov 44 31 0 29 Aug 2022
On Scaled Methods for Saddle Point Problems Aleksandr Beznosikov Aibek Alanov D. Kovalev Martin Takáč Alexander Gasnikov 35 4 0 16 Jun 2022
GDA-AM: On the effectiveness of solving minimax optimization via Anderson Acceleration Huan He Shifan Zhao Yuanzhe Xi Joyce C. Ho Y. Saad 34 1 0 06 Oct 2021
Constants of Motion: The Antidote to Chaos in Optimization and Game Dynamics Georgios Piliouras Xiao Wang 39 0 0 08 Sep 2021
Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization Kartik Ahuja Ethan Caballero Dinghuai Zhang Jean-Christophe Gagnon-Audet Yoshua Bengio Ioannis Mitliagkas Irina Rish OOD 15 251 0 11 Jun 2021
Evolutionary Game Theory Squared: Evolving Agents in Endogenously Evolving Zero-Sum Games Stratis Skoulakis Tanner Fiez Ryan Sim Georgios Piliouras Lillian J. Ratliff 24 13 0 15 Dec 2020
Adaptive extra-gradient methods for min-max optimization and games Kimon Antonakopoulos E. V. Belmega P. Mertikopoulos 64 46 0 22 Oct 2020
Adversarial score matching and improved sampling for image generation Alexia Jolicoeur-Martineau Remi Piche-Taillefer Rémi Tachet des Combes Ioannis Mitliagkas DiffM 35 125 0 11 Sep 2020
Stochastic Hamiltonian Gradient Methods for Smooth Games Nicolas Loizou Hugo Berard Alexia Jolicoeur-Martineau Pascal Vincent Simon Lacoste-Julien Ioannis Mitliagkas 39 50 0 08 Jul 2020
A Convergent and Dimension-Independent Min-Max Optimization Algorithm Vijay Keswani Oren Mangoubi Sushant Sachdeva Nisheeth K. Vishnoi 22 1 0 22 Jun 2020
The limits of min-max optimization algorithms: convergence to spurious non-critical sets Ya-Ping Hsieh P. Mertikopoulos V. Cevher 35 81 0 16 Jun 2020
A Unified Single-loop Alternating Gradient Projection Algorithm for Nonconvex-Concave and Convex-Nonconcave Minimax Problems Zi Xu Hui-Li Zhang Yang Xu Guanghui Lan 27 99 0 03 Jun 2020
On the Convergence of Nesterov's Accelerated Gradient Method in Stochastic Settings Mahmoud Assran Michael G. Rabbat 14 59 0 27 Feb 2020
Global Convergence and Variance-Reduced Optimization for a Class of Nonconvex-Nonconcave Minimax Problems Junchi Yang Negar Kiyavash Niao He 25 83 0 22 Feb 2020
Distributed No-Regret Learning in Multi-Agent Systems Xiao Xu Qing Zhao 19 12 0 20 Feb 2020
Accelerating Smooth Games by Manipulating Spectral Shapes Waïss Azizian Damien Scieur Ioannis Mitliagkas Simon Lacoste-Julien Gauthier Gidel 33 48 0 02 Jan 2020
Towards Better Understanding of Adaptive Gradient Algorithms in Generative Adversarial Nets Mingrui Liu Youssef Mroueh Jerret Ross Wei Zhang Xiaodong Cui Payel Das Tianbao Yang ODL 46 63 0 26 Dec 2019
Poincaré Recurrence, Cycles and Spurious Equilibria in Gradient-Descent-Ascent for Non-Convex Non-Concave Zero-Sum Games Lampros Flokas Emmanouil-Vasileios Vlatakis-Gkaragkounis Georgios Piliouras MLT 22 41 0 28 Oct 2019
Demon: Improved Neural Network Training with Momentum Decay John Chen Cameron R. Wolfe Zhaoqi Li Anastasios Kyrillidis ODL 24 15 0 11 Oct 2019
Fast and Provable ADMM for Learning with Generative Priors Fabian Latorre Gómez Armin Eftekhari V. Cevher GAN 30 43 0 07 Jul 2019
Linear Lower Bounds and Conditioning of Differentiable Games Adam Ibrahim Waïss Azizian Gauthier Gidel Ioannis Mitliagkas 31 10 0 17 Jun 2019
Revisiting Stochastic Extragradient Konstantin Mishchenko D. Kovalev Egor Shulgin Peter Richtárik Yura Malitsky 14 66 0 27 May 2019
ODE Analysis of Stochastic Gradient Methods with Optimism and Anchoring for Minimax Problems Ernest K. Ryu Kun Yuan W. Yin 20 36 0 26 May 2019
Differentiable Game Mechanics Alistair Letcher David Balduzzi S. Racanière James Martens Jakob N. Foerster K. Tuyls T. Graepel 39 79 0 13 May 2019
Reducing Noise in GAN Training with Variance Reduced Extragradient Tatjana Chavdarova Gauthier Gidel François Fleuret Simon Lacoste-Julien 25 135 0 18 Apr 2019
Nonparametric Density Estimation & Convergence Rates for GANs under Besov IPM Losses Ananya Uppal Shashank Singh Barnabás Póczós 30 52 0 09 Feb 2019
Finding Mixed Nash Equilibria of Generative Adversarial Networks Ya-Ping Hsieh Chen Liu S. Chakrabartty GAN 27 91 0 23 Oct 2018
A Variational Inequality Perspective on Generative Adversarial Networks Gauthier Gidel Hugo Berard Gaëtan Vignoud Pascal Vincent Simon Lacoste-Julien GAN 28 351 0 28 Feb 2018