Visualising Basins of Attraction for the Cross-Entropy and the Squared
Error Neural Network Loss Functions

v1v2 (latest)

Visualising Basins of Attraction for the Cross-Entropy and the Squared Error Neural Network Loss Functions

8 January 2019

Anna Sergeevna Bosman

ArXiv (abs)PDF HTML

Papers citing "Visualising Basins of Attraction for the Cross-Entropy and the Squared Error Neural Network Loss Functions"

12 / 12 papers shown

Title
The Loss Surface of XOR Artificial Neural Networks D. Mehta Xiaojun Zhao Edgar A. Bernal D. Wales 137 19 0 06 Apr 2018
Essentially No Barriers in Neural Network Energy Landscape Felix Dräxler K. Veschgini M. Salmhofer Fred Hamprecht MoMe 122 435 0 02 Mar 2018
A Walk with SGD Chen Xing Devansh Arpit Christos Tsirigotis Yoshua Bengio 94 119 0 24 Feb 2018
Empirical Analysis of the Hessian of Over-Parametrized Neural Networks Levent Sagun Utku Evci V. U. Güney Yann N. Dauphin Léon Bottou 56 419 0 14 Jun 2017
Sharp Minima Can Generalize For Deep Nets Laurent Dinh Razvan Pascanu Samy Bengio Yoshua Bengio ODL 138 774 0 15 Mar 2017
Local minima in training of neural networks G. Swirszcz Wojciech M. Czarnecki Razvan Pascanu ODL 67 73 0 19 Nov 2016
Entropy-SGD: Biasing Gradient Descent Into Wide Valleys Pratik Chaudhari A. Choromańska Stefano Soatto Yann LeCun Carlo Baldassi C. Borgs J. Chayes Levent Sagun R. Zecchina ODL 96 775 0 06 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 433 2,946 0 15 Sep 2016
Deep Learning without Poor Local Minima Kenji Kawaguchi ODL 224 927 0 23 May 2016
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 263 1,201 0 30 Nov 2014
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization Yann N. Dauphin Razvan Pascanu Çağlar Gülçehre Kyunghyun Cho Surya Ganguli Yoshua Bengio ODL 132 1,394 0 10 Jun 2014
Deep Learning in Neural Networks: An Overview Jürgen Schmidhuber HAI 248 16,378 0 30 Apr 2014