Adaptive Blending Units: Trainable Activation Functions for Deep Neural
Networks

Adaptive Blending Units: Trainable Activation Functions for Deep Neural Networks

26 June 2018

Flemming Brieger

ArXiv (abs)PDF HTML

Papers citing "Adaptive Blending Units: Trainable Activation Functions for Deep Neural Networks"

15 / 15 papers shown

Title
Semiring Activation in Neural Networks B. Smets Peter D. Donker Jim W. Portegies LLMSV 63 0 0 29 May 2024
Nonlinearity Enhanced Adaptive Activation Functions David Yevick 71 1 0 29 Mar 2024
Learning Combinations of Activation Functions Franco Manessi A. Rozza AI4CE 38 55 0 29 Jan 2018
E-swish: Adjusting Activations to Different Network Depths Eric Alcaide LLMSV 39 35 0 22 Jan 2018
Understanding the Disharmony between Dropout and Batch Normalization by Variance Shift Xiang Li Shuo Chen Xiaolin Hu Jian Yang 72 309 0 16 Jan 2018
Self-Normalizing Neural Networks Günter Klambauer Thomas Unterthiner Andreas Mayr Sepp Hochreiter 466 2,519 0 08 Jun 2017
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 423 10,531 0 21 Jul 2016
A continuum among logarithmic, linear, and exponential functions, and its potential to improve generalization in neural networks Luke B. Godfrey Michael S. Gashler 34 36 0 03 Feb 2016
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 305 5,534 0 23 Nov 2015
Empirical Evaluation of Rectified Activations in Convolutional Network Bing Xu Naiyan Wang Tianqi Chen Mu Li 140 2,913 0 05 May 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 465 43,341 0 11 Feb 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 338 18,651 0 06 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.0K 150,312 0 22 Dec 2014
Learning Activation Functions to Improve Deep Neural Networks Forest Agostinelli Matthew Hoffman Peter Sadowski Pierre Baldi ODL 225 475 0 21 Dec 2014
Maxout Networks Ian Goodfellow David Warde-Farley M. Berk Mirza Aaron Courville Yoshua Bengio OOD 246 2,179 0 18 Feb 2013

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.