Poincaré Recurrence, Cycles and Spurious Equilibria in Gradient-Descent-Ascent for Non-Convex Non-Concave Zero-Sum Games

28 October 2019

Lampros Flokas

Emmanouil-Vasileios Vlatakis-Gkaragkounis

Georgios Piliouras

MLT

ArXiv PDF HTML

Papers citing "Poincaré Recurrence, Cycles and Spurious Equilibria in Gradient-Descent-Ascent for Non-Convex Non-Concave Zero-Sum Games"

33 / 33 papers shown

Title
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 277 30,109 0 01 Mar 2022
Last-iterate convergence rates for min-max optimization Jacob D. Abernethy Kevin A. Lai Andre Wibisono 81 74 0 05 Jun 2019
Fast and Furious Learning in Zero-Sum Games: Vanishing Regret with Non-Vanishing Step Sizes James P. Bailey Georgios Piliouras 31 31 0 11 May 2019
Multi-Agent Learning in Network Zero-Sum Games is a Hamiltonian System James P. Bailey Georgios Piliouras 57 40 0 05 Mar 2019
What is Local Optimality in Nonconvex-Nonconcave Minimax Optimization? Chi Jin Praneeth Netrapalli Michael I. Jordan 94 84 0 02 Feb 2019
Solving Non-Convex Non-Concave Min-Max Games Under Polyak-Łojasiewicz Condition Maziar Sanjabi Meisam Razaviyayn Jason D. Lee 46 35 0 07 Dec 2018
Gradient Descent Finds Global Minima of Deep Neural Networks S. Du Jason D. Lee Haochuan Li Liwei Wang Masayoshi Tomizuka ODL 201 1,135 0 09 Nov 2018
Negative Momentum for Improved Game Dynamics Gauthier Gidel Reyhane Askari Hemmat Mohammad Pezeshki Rémi Le Priol Gabriel Huang Simon Lacoste-Julien Ioannis Mitliagkas AI4CE 66 180 0 12 Jul 2018
Last-Iterate Convergence: Zero-Sum Games and Constrained Min-Max Optimization C. Daskalakis Ioannis Panageas 67 178 0 11 Jul 2018
The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization C. Daskalakis Ioannis Panageas 69 256 0 11 Jul 2018
Optimistic mirror descent in saddle-point problems: Going the extra (gradient) mile P. Mertikopoulos Bruno Lecouat Houssam Zenati Chuan-Sheng Foo V. Chandrasekhar Georgios Piliouras 132 295 0 07 Jul 2018
Beyond Local Nash Equilibria for Adversarial Networks F. Oliehoek Rahul Savani Jose Gallego-Posada Elise van der Pol R. Groß GAN 57 43 0 18 Jun 2018
The Unusual Effectiveness of Averaging in GAN Training Yasin Yazici Chuan-Sheng Foo Stefan Winkler Kim-Hui Yap Georgios Piliouras V. Chandrasekhar 106 175 0 12 Jun 2018
Local Saddle Point Optimization: A Curvature Exploitation Approach Leonard Adolphs Hadi Daneshmand Aurelien Lucchi Thomas Hofmann 121 107 0 15 May 2018
Fictitious GAN: Training GANs with Historical Models Hao Ge Yin Xia Xu Chen R. Berry Ying Nian Wu AI4CE GAN 94 29 0 23 Mar 2018
A Variational Inequality Perspective on Generative Adversarial Networks Gauthier Gidel Hugo Berard Gaëtan Vignoud Pascal Vincent Simon Lacoste-Julien GAN 133 353 0 28 Feb 2018
The Mechanics of n-Player Differentiable Games David Balduzzi S. Racanière James Martens Jakob N. Foerster K. Tuyls T. Graepel MLT 84 274 0 15 Feb 2018
Which Training Methods for GANs do actually Converge? L. Mescheder Andreas Geiger Sebastian Nowozin 81 1,465 0 13 Jan 2018
Training GANs with Optimism C. Daskalakis Andrew Ilyas Vasilis Syrgkanis Haoyang Zeng 173 519 0 31 Oct 2017
Cycles in adversarial regularized learning P. Mertikopoulos Christos H. Papadimitriou Georgios Piliouras 58 321 0 08 Sep 2017
Improved Training of Wasserstein GANs Ishaan Gulrajani Faruk Ahmed Martín Arjovsky Vincent Dumoulin Aaron Courville GAN 207 9,548 0 31 Mar 2017
BEGAN: Boundary Equilibrium Generative Adversarial Networks David Berthelot Tom Schumm Luke Metz GAN 100 1,154 0 31 Mar 2017
Generalization and Equilibrium in Generative Adversarial Nets (GANs) Sanjeev Arora Rong Ge Yingyu Liang Tengyu Ma Yi Zhang GAN 54 688 0 02 Mar 2017
Wasserstein GAN Martín Arjovsky Soumith Chintala Léon Bottou GAN 172 4,826 0 26 Jan 2017
AdaGAN: Boosting Generative Models Ilya O. Tolstikhin Sylvain Gelly Olivier Bousquet Carl-Johann Simon-Gabriel Bernhard Schölkopf GAN 46 226 0 09 Jan 2017
StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks Han Zhang Tao Xu Hongsheng Li Shaoting Zhang Xiaogang Wang Xiaolei Huang Dimitris N. Metaxas GAN 118 2,725 0 10 Dec 2016
Image-to-Image Translation with Conditional Adversarial Networks Phillip Isola Jun-Yan Zhu Tinghui Zhou Alexei A. Efros SSeg 323 19,651 0 21 Nov 2016
Unrolled Generative Adversarial Networks Luke Metz Ben Poole David Pfau Jascha Narain Sohl-Dickstein GAN 100 1,004 0 07 Nov 2016
Connecting Generative Adversarial Networks and Actor-Critic Methods David Pfau Oriol Vinyals OffRL AI4CE 73 186 0 06 Oct 2016
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network C. Ledig Lucas Theis Ferenc Huszár Jose Caballero Andrew Cunningham ... Andrew P. Aitken Alykhan Tejani J. Totz Zehan Wang Wenzhe Shi GAN 242 10,693 0 15 Sep 2016
Improved Techniques for Training GANs Tim Salimans Ian Goodfellow Wojciech Zaremba Vicki Cheung Alec Radford Xi Chen GAN 480 9,052 0 10 Jun 2016
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks Alec Radford Luke Metz Soumith Chintala GAN OOD 258 14,012 0 19 Nov 2015
Generative Adversarial Networks Ian Goodfellow Jean Pouget-Abadie M. Berk Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville Yoshua Bengio GAN 139 2,193 0 10 Jun 2014