A Survey on Activation Functions and their relation with Xavier and He Normal Initialization

18 March 2020

Papers citing "A Survey on Activation Functions and their relation with Xavier and He Normal Initialization"

9 / 9 papers shown

Title
Improvement Graph Convolution Collaborative Filtering with Weighted addition input Tin T. Tran V. Snasel GNN 91 3 0 27 Mar 2025
Motion Control in Multi-Rotor Aerial Robots Using Deep Reinforcement Learning Gaurav Shetty M. Ramezani Hamed Habibi Holger Voos J. L. Sánchez-López 121 0 0 09 Feb 2025
Activation Functions: Comparison of trends in Practice and Research for Deep Learning S. Bodenstedt Dominik Rivoir A. Gachagan S. T. Mees 72 1,273 0 08 Nov 2018
On weight initialization in deep neural networks S. Kumar ODL 35 226 0 28 Apr 2017
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 607 36,599 0 25 Aug 2016
All you need is a good init Dmytro Mishkin Jirí Matas ODL 57 608 0 19 Nov 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.0K 76,547 0 18 May 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 151 18,534 0 06 Feb 2015
Learning Activation Functions to Improve Deep Neural Networks Forest Agostinelli Matthew Hoffman Peter Sadowski Pierre Baldi ODL 124 474 0 21 Dec 2014