The Global Landscape of Neural Networks: An Overview

The Global Landscape of Neural Networks: An Overview

2 July 2020

Papers citing "The Global Landscape of Neural Networks: An Overview"

17 / 17 papers shown

Title
Geometry of Learning -- L2 Phase Transitions in Deep and Shallow Neural Networks Ibrahim Talha Ersoy Karoline Wiesner 53 0 0 10 May 2025
Fundamental Limits of Deep Learning-Based Binary Classifiers Trained with Hinge Loss T. Getu Georges Kaddoum M. Bennis 71 1 0 13 Sep 2023
Geometry and Local Recovery of Global Minima of Two-layer Neural Networks at Overparameterization Leyang Zhang Yaoyu Zhang Yaoyu Zhang 58 2 0 01 Sep 2023
Entropic gradient descent algorithms and wide flat minima Fabrizio Pittorino Carlo Lucibello Christoph Feinauer Gabriele Perugini Carlo Baldassi Elizaveta Demyanenko R. Zecchina ODL MLT 66 33 0 14 Jun 2020
Revisiting Landscape Analysis in Deep Neural Networks: Eliminating Decreasing Paths to Infinity Shiyu Liang Ruoyu Sun R. Srikant 61 19 0 31 Dec 2019
Shaping the learning landscape in neural networks around wide flat minima Carlo Baldassi Fabrizio Pittorino R. Zecchina MLT 61 83 0 20 May 2019
Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers Zeyuan Allen-Zhu Yuanzhi Li Yingyu Liang MLT 165 772 0 12 Nov 2018
On the loss landscape of a class of deep neural networks with no bad local valleys Quynh N. Nguyen Mahesh Chandra Mukkamala Matthias Hein 54 87 0 27 Sep 2018
Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview Yuejie Chi Yue M. Lu Yuxin Chen 56 424 0 25 Sep 2018
Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data Yuanzhi Li Yingyu Liang MLT 194 653 0 03 Aug 2018
Essentially No Barriers in Neural Network Energy Landscape Felix Dräxler K. Veschgini M. Salmhofer Fred Hamprecht MoMe 105 432 0 02 Mar 2018
Implicit Regularization in Deep Learning Behnam Neyshabur 50 146 0 06 Sep 2017
Depth Creates No Bad Local Minima Haihao Lu Kenji Kawaguchi ODL FAtt 71 121 0 27 Feb 2017
Topology and Geometry of Half-Rectified Network Optimization C. Freeman Joan Bruna 171 235 0 04 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 398 2,935 0 15 Sep 2016
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding Song Han Huizi Mao W. Dally 3DGS 233 8,821 0 01 Oct 2015
Qualitatively characterizing neural network optimization problems Ian Goodfellow Oriol Vinyals Andrew M. Saxe ODL 105 522 0 19 Dec 2014