Exponentially vanishing sub-optimal local minima in multilayer neural networks

19 February 2017

Papers citing "Exponentially vanishing sub-optimal local minima in multilayer neural networks"

10 / 10 papers shown

Title
Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding Zhengqing Wu Berfin Simsek Francois Ged ODL 61 0 0 08 Feb 2024
Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach Ryo Karakida S. Akaho S. Amari FedML 106 142 0 04 Jun 2018
Theoretical insights into the optimization landscape of over-parameterized shallow neural networks Mahdi Soltanolkotabi Adel Javanmard Jason D. Lee 96 417 0 16 Jul 2017
Recovery Guarantees for One-hidden-layer Neural Networks Kai Zhong Zhao Song Prateek Jain Peter L. Bartlett Inderjit S. Dhillon MLT 96 336 0 10 Jun 2017
Train longer, generalize better: closing the generalization gap in large batch training of neural networks Elad Hoffer Itay Hubara Daniel Soudry ODL 140 798 0 24 May 2017
Depth Creates No Bad Local Minima Haihao Lu Kenji Kawaguchi ODL FAtt 57 121 0 27 Feb 2017
Exponential expressivity in deep neural networks through transient chaos Ben Poole Subhaneil Lahiri M. Raghu Jascha Narain Sohl-Dickstein Surya Ganguli 76 587 0 16 Jun 2016
Qualitatively characterizing neural network optimization problems Ian Goodfellow Oriol Vinyals Andrew M. Saxe ODL 76 519 0 19 Dec 2014
One weird trick for parallelizing convolutional neural networks A. Krizhevsky GNN 69 1,297 0 23 Apr 2014
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 107 1,830 0 20 Dec 2013