Linear discriminant initialization for feed-forward neural networks

v1v2 (latest)

Linear discriminant initialization for feed-forward neural networks

24 July 2020

ArXiv (abs)PDF HTML

Papers citing "Linear discriminant initialization for feed-forward neural networks"

7 / 7 papers shown

Title
Topological Approaches to Deep Learning Gunnar Carlsson Rickard Brüel-Gabrielsson 61 68 0 02 Nov 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 240 3,473 0 09 Mar 2018
Don't Decay the Learning Rate, Increase the Batch Size Samuel L. Smith Pieter-Jan Kindermans Chris Ying Quoc V. Le ODL 101 996 0 01 Nov 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 713 131,652 0 12 Jun 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 427 2,941 0 15 Sep 2016
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 326 18,625 0 06 Feb 2015
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 178 1,849 0 20 Dec 2013