The Spectrum of Fisher Information of Deep Networks Achieving Dynamical Isometry

14 June 2020

Papers citing "The Spectrum of Fisher Information of Deep Networks Achieving Dynamical Isometry"

4 / 4 papers shown

Title
Efficient Activation Function Optimization through Surrogate Modeling G. Bingham Risto Miikkulainen 16 2 0 13 Jan 2023
Dynamical Isometry for Residual Networks Advait Gadhikar R. Burkholz ODL AI4CE 37 2 0 05 Oct 2022
Asymptotic Freeness of Layerwise Jacobians Caused by Invariance of Multilayer Perceptron: The Haar Orthogonal Case B. Collins Tomohiro Hayase 22 7 0 24 Mar 2021
Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks Lechao Xiao Yasaman Bahri Jascha Narain Sohl-Dickstein S. Schoenholz Jeffrey Pennington 220 348 0 14 Jun 2018