Empirical Loss Landscape Analysis of Neural Network Activation Functions

28 June 2023

Papers citing "Empirical Loss Landscape Analysis of Neural Network Activation Functions"

11 / 11 papers shown

Title
Loss Surface Modality of Feed-Forward Neural Network Architectures Anna Sergeevna Bosman A. Engelbrecht Mardé Helbig 30 9 0 24 May 2019
Visualising Basins of Attraction for the Cross-Entropy and the Squared Error Neural Network Loss Functions Anna Sergeevna Bosman A. Engelbrecht Mardé Helbig 67 77 0 08 Jan 2019
Piecewise Strong Convexity of Neural Networks Tristan Milne 49 21 0 30 Oct 2018
The Loss Surface of XOR Artificial Neural Networks D. Mehta Xiaojun Zhao Edgar A. Bernal D. Wales 145 19 0 06 Apr 2018
Understanding the Loss Surface of Neural Networks for Binary Classification Shiyu Liang Ruoyu Sun Yixuan Li R. Srikant 87 88 0 19 Feb 2018
The Multilinear Structure of ReLU Networks T. Laurent J. V. Brecht 88 51 0 29 Dec 2017
Spurious Local Minima are Common in Two-Layer ReLU Neural Networks Itay Safran Ohad Shamir 184 265 0 24 Dec 2017
Understanding Deep Neural Networks with Rectified Linear Units R. Arora A. Basu Poorya Mianjy Anirbit Mukherjee PINN 164 643 0 04 Nov 2016
Piecewise convexity of artificial neural networks Blaine Rister Daniel L Rubin AAML ODL 67 32 0 17 Jul 2016
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 307 5,536 0 23 Nov 2015
Empirical Evaluation of Rectified Activations in Convolutional Network Bing Xu Naiyan Wang Tianqi Chen Mu Li 142 2,914 0 05 May 2015