Porcupine Neural Networks: (Almost) All Local Optima are Global

5 October 2017

Papers citing "Porcupine Neural Networks: (Almost) All Local Optima are Global"

10 / 10 papers shown

Title
Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II Yossi Arjevani M. Field 28 18 0 21 Jul 2021
Symmetry & critical points for a model shallow neural network Yossi Arjevani M. Field 31 13 0 23 Mar 2020
Revisiting Landscape Analysis in Deep Neural Networks: Eliminating Decreasing Paths to Infinity Shiyu Liang Ruoyu Sun R. Srikant 35 19 0 31 Dec 2019
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 16 168 0 19 Dec 2019
LGM-Net: Learning to Generate Matching Networks for Few-Shot Learning Huaiyu Li Weiming Dong Xing Mei Chongyang Ma Feiyue Huang Bao-Gang Hu OffRL 32 98 0 15 May 2019
Spurious Local Minima are Common in Two-Layer ReLU Neural Networks Itay Safran Ohad Shamir 40 261 0 24 Dec 2017
Global optimality conditions for deep neural networks Chulhee Yun S. Sra Ali Jadbabaie 128 117 0 08 Jul 2017
$Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with $ \ell^1 $ and $ \ell^0 $ Controls$ Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with $\ell^1$ and $\ell^0$ Controls Jason M. Klusowski Andrew R. Barron 130 142 0 26 Jul 2016
Benefits of depth in neural networks Matus Telgarsky 148 602 0 14 Feb 2016
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 179 1,185 0 30 Nov 2014