Visualizing the Loss Landscape of Neural Nets

v1v2v3 (latest)

Visualizing the Loss Landscape of Neural Nets

28 December 2017

Hao Li

Christoph Studer

ArXiv (abs)PDF HTML

Papers citing "Visualizing the Loss Landscape of Neural Nets"

18 / 1,068 papers shown

Title
How Does Batch Normalization Help Optimization? Shibani Santurkar Dimitris Tsipras Andrew Ilyas Aleksander Madry ODL 136 1,548 0 29 May 2018
Input and Weight Space Smoothing for Semi-supervised Learning Safa Cicek Stefano Soatto 47 6 0 23 May 2018
Reducing Parameter Space for Neural Network Training Tong Qin Ling Zhou D. Xiu 33 6 0 22 May 2018
SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning W. Wen Yandan Wang Feng Yan Cong Xu Chunpeng Wu Yiran Chen H. Li 79 51 0 21 May 2018
Nostalgic Adam: Weighting more of the past gradients when designing the adaptive learning rate Haiwen Huang Changzhang Wang Bin Dong ODL 45 59 0 19 May 2018
On Visual Hallmarks of Robustness to Adversarial Malware Alex Huang Abdullah Al-Dujaili Erik Hemberg Una-May O’Reilly AAML 69 7 0 09 May 2018
Stacked U-Nets: A No-Frills Approach to Natural Image Segmentation Sohil Shah P. Ghosh L. Davis Tom Goldstein SSeg 88 56 0 27 Apr 2018
DeepDIVA: A Highly-Functional Python Framework for Reproducible Experiments Michele Alberti Vinaychandran Pondenkandath Marcel Würsch Rolf Ingold Marcus Liwicki 59 27 0 23 Apr 2018
The Loss Surface of XOR Artificial Neural Networks D. Mehta Xiaojun Zhao Edgar A. Bernal D. Wales 158 19 0 06 Apr 2018
Essentially No Barriers in Neural Network Energy Landscape Felix Dräxler K. Veschgini M. Salmhofer Fred Hamprecht MoMe 136 436 0 02 Mar 2018
Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs T. Garipov Pavel Izmailov Dmitrii Podoprikhin Dmitry Vetrov A. Wilson UQCV 114 758 0 27 Feb 2018
Left ventricle segmentation By modelling uncertainty in prediction of deep convolutional neural networks and adaptive thresholding inference Alireza Norouzi Ali Emami S. M. Reza Soroushmehr N. Karimi S. Samavi Kayvan Najarian UQCV 31 1 0 23 Feb 2018
Improved Techniques For Weakly-Supervised Object Localization Junsuk Choe J. Park Hyunjung Shim WSOL 62 7 0 22 Feb 2018
Coulomb Autoencoders E. Sansone Hafiz Tiomoko Ali Jiacheng Sun DRL 45 1 0 10 Feb 2018
Critical Learning Periods in Deep Neural Networks Alessandro Achille Matteo Rovere Stefano Soatto 72 100 0 24 Nov 2017
Decoupled Weight Decay Regularization I. Loshchilov Frank Hutter OffRL 158 2,161 0 14 Nov 2017
End-to-end learning for music audio tagging at scale Jordi Pons Oriol Nieto Matthew Prockup Erik M. Schmidt Andreas F. Ehmann Xavier Serra 117 176 0 07 Nov 2017
Deep Relaxation: partial differential equations for optimizing deep neural networks Pratik Chaudhari Adam M. Oberman Stanley Osher Stefano Soatto G. Carlier 158 154 0 17 Apr 2017