Critical Points of Neural Networks: Analytical Forms and Landscape Properties

30 October 2017

Papers citing "Critical Points of Neural Networks: Analytical Forms and Landscape Properties"

18 / 18 papers shown

Title
Characterization of Gradient Dominance and Regularity Conditions for Neural Networks Yi Zhou Yingbin Liang 62 33 0 18 Oct 2017
Porcupine Neural Networks: (Almost) All Local Optima are Global Soheil Feizi Hamid Javadi Jesse M. Zhang David Tse 68 36 0 05 Oct 2017
How regularization affects the critical points in linear networks Amirhossein Taghvaei Jin-Won Kim P. Mehta 63 13 0 27 Sep 2017
Theoretical insights into the optimization landscape of over-parameterized shallow neural networks Mahdi Soltanolkotabi Adel Javanmard Jason D. Lee 165 419 0 16 Jul 2017
Global optimality conditions for deep neural networks Chulhee Yun S. Sra Ali Jadbabaie 138 118 0 08 Jul 2017
Recovery Guarantees for One-hidden-layer Neural Networks Kai Zhong Zhao Song Prateek Jain Peter L. Bartlett Inderjit S. Dhillon MLT 167 336 0 10 Jun 2017
The loss surface of deep and wide neural networks Quynh N. Nguyen Matthias Hein ODL 154 284 0 26 Apr 2017
An Analytical Formula of Population Gradient for two-layered ReLU network and its Applications in Convergence and Critical Point Analysis Yuandong Tian MLT 183 216 0 02 Mar 2017
Depth Creates No Bad Local Minima Haihao Lu Kenji Kawaguchi ODL FAtt 71 121 0 27 Feb 2017
Exponentially vanishing sub-optimal local minima in multilayer neural networks Daniel Soudry Elad Hoffer 144 97 0 19 Feb 2017
Identity Matters in Deep Learning Moritz Hardt Tengyu Ma OOD 84 398 0 14 Nov 2016
Topology and Geometry of Half-Rectified Network Optimization C. Freeman Joan Bruna 192 235 0 04 Nov 2016
Demystifying ResNet Sihan Li Jiantao Jiao Yanjun Han Tsachy Weissman 55 38 0 03 Nov 2016
No bad local minima: Data independent training error guarantees for multilayer neural networks Daniel Soudry Y. Carmon 183 235 0 26 May 2016
Deep Learning without Poor Local Minima Kenji Kawaguchi ODL 219 923 0 23 May 2016
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 256 1,198 0 30 Nov 2014
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization Yann N. Dauphin Razvan Pascanu Çağlar Gülçehre Kyunghyun Cho Surya Ganguli Yoshua Bengio ODL 126 1,385 0 10 Jun 2014
Complex-Valued Autoencoders Pierre Baldi Zhiqin Lu 81 59 0 20 Aug 2011