Activation Functions: Comparison of trends in Practice and Research for
Deep Learning

Activation Functions: Comparison of trends in Practice and Research for Deep Learning

8 November 2018

Papers citing "Activation Functions: Comparison of trends in Practice and Research for Deep Learning"

18 / 68 papers shown

Title
Review and Comparison of Commonly Used Activation Functions for Deep Neural Networks Tomasz Szandała 59 277 0 15 Oct 2020
Effects of the Nonlinearity in Activation Functions on the Performance of Deep Learning Models N. Kulathunga N. R. Ranasinghe D. Vrinceanu Zackary Kinsman Lei Huang Yunjiao Wang 6 4 0 14 Oct 2020
SMYRF: Efficient Attention using Asymmetric Clustering Giannis Daras Nikita Kitaev Augustus Odena A. Dimakis 31 44 0 11 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 34 79 0 17 Sep 2020
Bridging the Gap: Machine Learning to Resolve Improperly Modeled Dynamics Maan Qraitem D. Kularatne Eric Forgoston M. A. Hsieh AI4CE 28 10 0 23 Aug 2020
Using neural networks to predict icephobic performance Rahul Ramachandran 9 1 0 31 Jul 2020
SPLASH: Learnable Activation Functions for Improving Accuracy and Adversarial Robustness Mohammadamin Tavakoli Forest Agostinelli Pierre Baldi AAML FAtt 36 39 0 16 Jun 2020
Mass Estimation of Galaxy Clusters with Deep Learning II: CMB Cluster Lensing N. Gupta C. Reichardt 18 13 0 28 May 2020
A survey on modern trainable activation functions Andrea Apicella Francesco Donnarumma Francesco Isgrò R. Prevete 36 365 0 02 May 2020
GSA-DenseNet121-COVID-19: a Hybrid Deep Learning Architecture for the Diagnosis of COVID-19 Disease based on Gravitational Search Optimization Algorithm Dalia Ezzat A. Hassanien Hassan Aboul Ella 17 55 0 09 Apr 2020
Deep Residual Neural Networks for Image in Speech Steganography Shivam Agarwal S. Venkatraman 24 4 0 30 Mar 2020
A Survey on Activation Functions and their relation with Xavier and He Normal Initialization Leonid Datta AI4CE 20 68 0 18 Mar 2020
Automatic Hyper-Parameter Optimization Based on Mapping Discovery from Data to Hyper-Parameters Bozhou Chen Kaixin Zhang Longshen Ou Chenmin Ba Hongzhi Wang Chunnan Wang 14 2 0 03 Mar 2020
Towards Label-Free 3D Segmentation of Optical Coherence Tomography Images of the Optic Nerve Head Using Deep Learning S. Devalla T. Pham S. Panda Zhang Liang Giridhar Subramanian ... L. Schmetterer S. Perera Tin Aung Alexandre Hoang Thiery M. Girard 33 29 0 22 Feb 2020
A Neural Network Based on First Principles P. Baggenstoss 13 7 0 18 Feb 2020
Evolutionary Optimization of Deep Learning Activation Functions G. Bingham William Macke Risto Miikkulainen ODL 19 50 0 17 Feb 2020
Generating Accurate Pseudo-labels in Semi-Supervised Learning and Avoiding Overconfident Predictions via Hermite Polynomial Activations Vishnu Suresh Lokhande Songwong Tasneeyapant Abhay Venkatesh Sathya Ravi Vikas Singh 18 29 0 12 Sep 2019
A Survey of the Recent Architectures of Deep Convolutional Neural Networks Asifullah Khan A. Sohail Umme Zahoora Aqsa Saeed Qureshi OOD 59 2,268 0 17 Jan 2019