The Loss Surfaces of Multilayer Networks

30 November 2014

Papers citing "The Loss Surfaces of Multilayer Networks"

21 / 21 papers shown

Title
Geometry of Learning -- L2 Phase Transitions in Deep and Shallow Neural Networks Ibrahim Talha Ersoy Karoline Wiesner 53 0 0 10 May 2025
Deep Neural Nets as Hamiltonians Mike Winer Boris Hanin 360 0 0 31 Mar 2025
Plane-Wave Decomposition and Randomised Training; a Novel Path to Generalised PINNs for SHM Rory Clements James Ellis Geoff Hassall Simon Horsley Gavin Tabor 83 0 0 31 Mar 2025
High Probability Complexity Bounds of Trust-Region Stochastic Sequential Quadratic Programming with Heavy-Tailed Noise Yuchen Fang Javad Lavaei Katya Scheinberg 66 0 0 24 Mar 2025
Gradient-Guided Annealing for Domain Generalization Aristotelis Ballas Christos Diou OOD 477 1 0 27 Feb 2025
DICTION:DynamIC robusT whIte bOx watermarkiNg scheme for deep neural networks Reda Bellafqira Gouenou Coatrieux 56 6 0 27 Oct 2022
SPLASH: Learnable Activation Functions for Improving Accuracy and Adversarial Robustness Mohammadamin Tavakoli Forest Agostinelli Pierre Baldi AAML FAtt 140 39 0 16 Jun 2020
Beyond Random Matrix Theory for Deep Networks Diego Granziol 86 16 0 13 Jun 2020
ConAML: Constrained Adversarial Machine Learning for Cyber-Physical Systems Jiangnan Li Yingyuan Yang Jinyuan Stella Sun K. Tomsovic Jin Young Lee AAML 76 53 0 12 Mar 2020
Train longer, generalize better: closing the generalization gap in large batch training of neural networks Elad Hoffer Itay Hubara Daniel Soudry ODL 150 799 0 24 May 2017
Discrete Sequential Prediction of Continuous Actions for Deep RL Luke Metz Julian Ibarz Navdeep Jaitly James Davidson BDL OffRL 65 118 0 14 May 2017
An Analytical Formula of Population Gradient for two-layered ReLU network and its Applications in Convergence and Critical Point Analysis Yuandong Tian MLT 147 216 0 02 Mar 2017
Deep Semi-Random Features for Nonlinear Function Approximation Kenji Kawaguchi Bo Xie Vikas Verma Le Song 110 15 0 28 Feb 2017
Exponentially vanishing sub-optimal local minima in multilayer neural networks Daniel Soudry Elad Hoffer 127 97 0 19 Feb 2017
A Random Matrix Approach to Neural Networks Cosme Louart Zhenyu Liao Romain Couillet 62 161 0 17 Feb 2017
Asynchronous Stochastic Gradient Descent with Delay Compensation Shuxin Zheng Qi Meng Taifeng Wang Wei Chen Nenghai Yu Zhiming Ma Tie-Yan Liu 90 314 0 27 Sep 2016
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization Yann N. Dauphin Razvan Pascanu Çağlar Gülçehre Kyunghyun Cho Surya Ganguli Yoshua Bengio ODL 116 1,380 0 10 Jun 2014
Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation Emily L. Denton Wojciech Zaremba Joan Bruna Yann LeCun Rob Fergus FAtt 147 1,682 0 02 Apr 2014
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 143 1,830 0 20 Dec 2013
Predicting Parameters in Deep Learning Misha Denil B. Shakibi Laurent Dinh MarcÁurelio Ranzato Nando de Freitas OOD 164 1,314 0 03 Jun 2013
Maxout Networks Ian Goodfellow David Warde-Farley M. Berk Mirza Aaron Courville Yoshua Bengio OOD 206 2,176 0 18 Feb 2013