The Quest for the Golden Activation Function

2 August 2018

Papers citing "The Quest for the Golden Activation Function"

9 / 9 papers shown

Title
Bayesian optimization for sparse neural networks with trainable activation functions M. Fakhfakh Lotfi Chaari 20 2 0 10 Apr 2023
Efficient Activation Function Optimization through Surrogate Modeling G. Bingham Risto Miikkulainen 24 2 0 13 Jan 2023
Nish: A Novel Negative Stimulated Hybrid Activation Function Yildiray Anagün Ş. Işık 24 2 0 17 Oct 2022
How important are activation functions in regression and classification? A survey, performance comparison, and future directions Ameya Dilip Jagtap George Karniadakis AI4CE 37 71 0 06 Sep 2022
Neural Networks with A La Carte Selection of Activation Functions Moshe Sipper 24 7 0 24 Jun 2022
Evolution of Activation Functions for Deep Learning-Based Image Classification Raz Lapid Moshe Sipper 27 11 0 24 Jun 2022
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 41 643 0 29 Sep 2021
AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks G. Bingham Risto Miikkulainen ODL 24 4 0 18 Sep 2021
A survey on modern trainable activation functions Andrea Apicella Francesco Donnarumma Francesco Isgrò R. Prevete 36 366 0 02 May 2020