Towards a Better Global Loss Landscape of GANs

10 November 2020

Papers citing "Towards a Better Global Loss Landscape of GANs"

50 / 87 papers shown

Title
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 207 30,069 0 01 Mar 2022
A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems Jiawei Zhang Peijun Xiao Ruoyu Sun Zhi-Quan Luo 92 98 0 29 Oct 2020
The Global Landscape of Neural Networks: An Overview Ruoyu Sun Dawei Li Shiyu Liang Tian Ding R. Srikant 50 86 0 02 Jul 2020
Creating High Resolution Images with a Latent Adversarial Generator David Berthelot P. Milanfar Ian Goodfellow GAN 44 18 0 04 Mar 2020
GANs May Have No Nash Equilibria Farzan Farnia Asuman Ozdaglar GAN 47 43 0 21 Feb 2020
Real or Not Real, that is the Question Yuanbo Xiangli Yubin Deng Bo Dai Chen Change Loy Dahua Lin GAN 91 47 0 12 Feb 2020
Revisiting Landscape Analysis in Deep Neural Networks: Eliminating Decreasing Paths to Infinity Shiyu Liang Ruoyu Sun R. Srikant 61 19 0 31 Dec 2019
Analyzing and Improving the Image Quality of StyleGAN Tero Karras S. Laine M. Aittala Janne Hellsten J. Lehtinen Timo Aila GAN 258 5,769 0 03 Dec 2019
Sub-Optimal Local Minima Exist for Neural Networks with Almost All Non-Linear Activations Tian Ding Dawei Li Ruoyu Sun 43 13 0 04 Nov 2019
SGD Learns One-Layer Networks in WGANs Qi Lei Jason D. Lee A. Dimakis C. Daskalakis GAN 35 35 0 15 Oct 2019
Optimal transport mapping via input convex neural networks Ashok Vardhan Makkuva Amirhossein Taghvaei Sewoong Oh Jason D. Lee OT 32 199 0 28 Aug 2019
A Tight and Unified Analysis of Gradient-Based Methods for a Whole Spectrum of Games Waïss Azizian Ioannis Mitliagkas Simon Lacoste-Julien Gauthier Gidel 107 24 0 13 Jun 2019
A Closer Look at the Optimization Landscapes of Generative Adversarial Networks Hugo Berard Gauthier Gidel Amjad Almahairi Pascal Vincent Simon Lacoste-Julien GAN 29 64 0 11 Jun 2019
On the Convergence of Adam and Beyond Sashank J. Reddi Satyen Kale Surinder Kumar 72 2,482 0 19 Apr 2019
Max-Sliced Wasserstein Distance and its use for GANs Ishani Deshpande Yuan-Ting Hu Ruoyu Sun A. Pyrros Nasir Siddiqui Oluwasanmi Koyejo Zhizhen Zhao David A. Forsyth Alex Schwing GAN 35 200 0 11 Apr 2019
Sliced Wasserstein Generative Models Jiqing Wu Zhiwu Huang Dinesh Acharya Wen Li Janine Thoma D. Paudel Luc Van Gool DiffM 113 126 0 10 Apr 2019
Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent Jaehoon Lee Lechao Xiao S. Schoenholz Yasaman Bahri Roman Novak Jascha Narain Sohl-Dickstein Jeffrey Pennington 174 1,089 0 18 Feb 2019
What is Local Optimality in Nonconvex-Nonconcave Minimax Optimization? Chi Jin Praneeth Netrapalli Michael I. Jordan 70 82 0 02 Feb 2019
Probability Functional Descent: A Unifying Perspective on GANs, Variational Inference, and Reinforcement Learning Casey Chu Jose H. Blanchet Peter Glynn GAN 36 26 0 30 Jan 2019
On Relativistic $f$ -Divergences Alexia Jolicoeur-Martineau 36 19 0 08 Jan 2019
On Finding Local Nash Equilibria (and Only Local Nash Equilibria) in Zero-Sum Games Eric V. Mazumdar Michael I. Jordan S. Shankar Sastry 77 122 0 03 Jan 2019
On the Benefit of Width for Neural Networks: Disappearance of Bad Basins Dawei Li Tian Ding Ruoyu Sun 62 38 0 28 Dec 2018
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 522 10,500 0 12 Dec 2018
Stochastic Gradient Descent Optimizes Over-parameterized Deep ReLU Networks Difan Zou Yuan Cao Dongruo Zhou Quanquan Gu ODL 152 448 0 21 Nov 2018
A Convergence Theory for Deep Learning via Over-Parameterization Zeyuan Allen-Zhu Yuanzhi Li Zhao Song AI4CE ODL 214 1,457 0 09 Nov 2018
Gradient Descent Finds Global Minima of Deep Neural Networks S. Du Jason D. Lee Haochuan Li Liwei Wang Masayoshi Tomizuka ODL 162 1,133 0 09 Nov 2018
A Convex Duality Framework for GANs Farzan Farnia David Tse GAN 56 63 0 28 Oct 2018
Large Scale GAN Training for High Fidelity Natural Image Synthesis Andrew Brock Jeff Donahue Karen Simonyan 235 5,363 0 28 Sep 2018
On the loss landscape of a class of deep neural networks with no bad local valleys Quynh N. Nguyen Mahesh Chandra Mukkamala Matthias Hein 49 87 0 27 Sep 2018
Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview Yuejie Chi Yue M. Lu Yuxin Chen 56 421 0 25 Sep 2018
The jamming transition as a paradigm to understand the loss landscape of deep neural networks Mario Geiger S. Spigler Stéphane dÁscoli Levent Sagun Marco Baity-Jesi Giulio Biroli Matthieu Wyart 51 141 0 25 Sep 2018
Implicit Maximum Likelihood Estimation Ke Li Jitendra Malik 39 96 0 24 Sep 2018
The Inductive Bias of Restricted f-GANs Shuang Liu Kamalika Chaudhuri GAN 38 18 0 12 Sep 2018
ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks Xintao Wang Ke Yu Shixiang Wu Jinjin Gu Yihao Liu Chao Dong Chen Change Loy Yu Qiao Xiaoou Tang 109 3,706 0 01 Sep 2018
Negative Momentum for Improved Game Dynamics Gauthier Gidel Reyhane Askari Hemmat Mohammad Pezeshki Rémi Le Priol Gabriel Huang Simon Lacoste-Julien Ioannis Mitliagkas AI4CE 58 180 0 12 Jul 2018
The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization C. Daskalakis Ioannis Panageas 44 255 0 11 Jul 2018
The relativistic discriminator: a key element missing from standard GAN Alexia Jolicoeur-Martineau GAN 49 971 0 02 Jul 2018
Approximability of Discriminators Implies Diversity in GANs Yu Bai Tengyu Ma Andrej Risteski 52 74 0 27 Jun 2018
Neural Tangent Kernel: Convergence and Generalization in Neural Networks Arthur Jacot Franck Gabriel Clément Hongler 215 3,160 0 20 Jun 2018
Banach Wasserstein GAN J. Adler Sebastian Lunz GAN 48 220 0 18 Jun 2018
The Unusual Effectiveness of Averaging in GAN Training Yasin Yazici Chuan-Sheng Foo Stefan Winkler Kim-Hui Yap Georgios Piliouras V. Chandrasekhar 104 173 0 12 Jun 2018
Assessing Generative Models via Precision and Recall Mehdi S. M. Sajjadi Olivier Bachem Mario Lucic Olivier Bousquet Sylvain Gelly EGVM 71 571 0 31 May 2018
Adding One Neuron Can Eliminate All Bad Local Minima Shiyu Liang Ruoyu Sun Jason D. Lee R. Srikant 66 89 0 22 May 2018
Self-Attention Generative Adversarial Networks Han Zhang Ian Goodfellow Dimitris N. Metaxas Augustus Odena GAN 124 3,710 0 21 May 2018
Sliced-Wasserstein Autoencoder: An Embarrassingly Simple Generative Model Soheil Kolouri Phillip E. Pope Charles E. Martin Gustavo K. Rohde 34 94 0 05 Apr 2018
Generative Modeling using the Sliced Wasserstein Distance Ishani Deshpande Ziyu Zhang Alex Schwing GAN 46 223 0 29 Mar 2018
A Variational Inequality Perspective on Generative Adversarial Networks Gauthier Gidel Hugo Berard Gaëtan Vignoud Pascal Vincent Simon Lacoste-Julien GAN 124 352 0 28 Feb 2018
On the Convergence and Robustness of Training GANs with Regularized Optimal Transport Maziar Sanjabi Jimmy Ba Meisam Razaviyayn Jason D. Lee GAN 61 137 0 22 Feb 2018
Understanding the Loss Surface of Neural Networks for Binary Classification Shiyu Liang Ruoyu Sun Yixuan Li R. Srikant 66 87 0 19 Feb 2018
Spurious Valleys in Two-layer Neural Network Optimization Landscapes Luca Venturi Afonso S. Bandeira Joan Bruna 60 74 0 18 Feb 2018