Combating Mode Collapse in GAN training: An Empirical Analysis using Hessian Eigenvalues

17 December 2020

Ricard Durall

Avraam Chatzimichailidis

Papers citing "Combating Mode Collapse in GAN training: An Empirical Analysis using Hessian Eigenvalues"

27 / 27 papers shown

Title
StainDiffuser: MultiTask Dual Diffusion Model for Virtual Staining Tushar Kataria Beatrice Knudsen Shireen Y. Elhabian DiffM MedIm 69 9 0 17 Mar 2024
Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributions Ricard Durall Margret Keuper J. Keuper 62 334 0 03 Mar 2020
Analyzing and Improving the Image Quality of StyleGAN Tero Karras S. Laine M. Aittala Janne Hellsten J. Lehtinen Timo Aila GAN 258 5,769 0 03 Dec 2019
GradVis: Visualization and Second Order Analysis of Optimization Surfaces during the Training of Deep Neural Networks Avraam Chatzimichailidis Franz-Josef Pfreundt N. Gauger J. Keuper 23 10 0 26 Sep 2019
Object Segmentation using Pixel-wise Adversarial Loss Ricard Durall Franz-Josef Pfreundt Ullrich Kothe J. Keuper GAN SSeg 23 2 0 23 Sep 2019
A Closer Look at the Optimization Landscapes of Generative Adversarial Networks Hugo Berard Gauthier Gidel Amjad Almahairi Pascal Vincent Simon Lacoste-Julien GAN 29 64 0 11 Jun 2019
Convergence of Learning Dynamics in Stackelberg Games Tanner Fiez Benjamin J. Chasnov Lillian J. Ratliff 43 92 0 04 Jun 2019
Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space? Rameen Abdal Yipeng Qin Peter Wonka GAN 95 1,109 0 05 Apr 2019
Negative eigenvalues of the Hessian in deep neural networks Guillaume Alain Nicolas Le Roux Pierre-Antoine Manzagol 42 42 0 06 Feb 2019
On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length Stanislaw Jastrzebski Zachary Kenton Nicolas Ballas Asja Fischer Yoshua Bengio Amos Storkey ODL 51 115 0 13 Jul 2018
Free-Form Image Inpainting with Gated Convolution Jiahui Yu Zhe Lin Jimei Yang Xiaohui Shen Xin Lu Thomas Huang DRL 49 1,707 0 10 Jun 2018
Local Saddle Point Optimization: A Curvature Exploitation Approach Leonard Adolphs Hadi Daneshmand Aurelien Lucchi Thomas Hofmann 100 107 0 15 May 2018
Averaging Weights Leads to Wider Optima and Better Generalization Pavel Izmailov Dmitrii Podoprikhin T. Garipov Dmitry Vetrov A. Wilson FedML MoMe 102 1,643 0 14 Mar 2018
Essentially No Barriers in Neural Network Energy Landscape Felix Dräxler K. Veschgini M. Salmhofer Fred Hamprecht MoMe 101 430 0 02 Mar 2018
Gradient descent GAN optimization is locally stable Vaishnavh Nagarajan J. Zico Kolter GAN 69 348 0 13 Jun 2017
SegAN: Adversarial Network with Multi-scale $L_1$ Loss for Medical Image Segmentation Yuan Xue Tao Xu Han Zhang L. R. Long Xiaolei Huang MedIm GAN 61 544 0 06 Jun 2017
The Numerics of GANs L. Mescheder Sebastian Nowozin Andreas Geiger GAN 75 456 0 30 May 2017
Improved Training of Wasserstein GANs Ishaan Gulrajani Faruk Ahmed Martín Arjovsky Vincent Dumoulin Aaron Courville GAN 152 9,509 0 31 Mar 2017
Sharp Minima Can Generalize For Deep Nets Laurent Dinh Razvan Pascanu Samy Bengio Yoshua Bengio ODL 108 766 0 15 Mar 2017
Wasserstein GAN Martín Arjovsky Soumith Chintala Léon Bottou GAN 152 4,822 0 26 Jan 2017
Eigenvalues of the Hessian in Deep Learning: Singularity and Beyond Levent Sagun Léon Bottou Yann LeCun UQCV 75 233 0 22 Nov 2016
Entropy-SGD: Biasing Gradient Descent Into Wide Valleys Pratik Chaudhari A. Choromańska Stefano Soatto Yann LeCun Carlo Baldassi C. Borgs J. Chayes Levent Sagun R. Zecchina ODL 89 769 0 06 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 375 2,922 0 15 Sep 2016
Improved Techniques for Training GANs Tim Salimans Ian Goodfellow Wojciech Zaremba Vicki Cheung Alec Radford Xi Chen GAN 432 8,999 0 10 Jun 2016
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks Alec Radford Luke Metz Soumith Chintala GAN OOD 234 13,968 0 19 Nov 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.1K 149,474 0 22 Dec 2014
Qualitatively characterizing neural network optimization problems Ian Goodfellow Oriol Vinyals Andrew M. Saxe ODL 95 519 0 19 Dec 2014