On the Selection of Initialization and Activation Function for Deep Neural Networks

21 May 2018

Papers citing "On the Selection of Initialization and Activation Function for Deep Neural Networks"

10 / 10 papers shown

Title
Criticality versus uniformity in deep neural networks A. Bukva Jurriaan de Gier Kevin T. Grosvenor R. Jefferson K. Schalm Eliot Schwander 34 3 0 10 Apr 2023
Frequency Disentangled Residual Network S. Singh Roshan Reddy Yedla S. Dubey R. Sanodiya Wei Chu 25 4 0 26 Sep 2021
A Deep Collocation Method for the Bending Analysis of Kirchhoff Plate Hongwei Guo X. Zhuang Timon Rabczuk AI4CE 27 433 0 04 Feb 2021
Tensor Programs III: Neural Matrix Laws Greg Yang 19 44 0 22 Sep 2020
Tensor Programs II: Neural Tangent Kernel for Any Architecture Greg Yang 58 135 0 25 Jun 2020
PCW-Net: Pyramid Combination and Warping Cost Volume for Stereo Matching Zhelun Shen Yuchao Dai Xibin Song Zhibo Rao Dingfu Zhou Liangjun Zhang 43 70 0 23 Jun 2020
Neural Tangents: Fast and Easy Infinite Neural Networks in Python Roman Novak Lechao Xiao Jiri Hron Jaehoon Lee Alexander A. Alemi Jascha Narain Sohl-Dickstein S. Schoenholz 38 225 0 05 Dec 2019
L*ReLU: Piece-wise Linear Activation Functions for Deep Fine-grained Visual Categorization Mina Basirat P. Roth 19 8 0 27 Oct 2019
Eigenvalue distribution of nonlinear models of random matrices L. Benigni Sandrine Péché 25 27 0 05 Apr 2019
Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks Lechao Xiao Yasaman Bahri Jascha Narain Sohl-Dickstein S. Schoenholz Jeffrey Pennington 244 349 0 14 Jun 2018