Activation Functions: Comparison of trends in Practice and Research for Deep Learning

8 November 2018

Papers citing "Activation Functions: Comparison of trends in Practice and Research for Deep Learning"

50 / 68 papers shown

Title
Mask-PINNs: Regulating Feature Distributions in Physics-Informed Neural Networks Feilong Jiang Xiaonan Hou Jianqiao Ye Min Xia OOD PINN 42 0 0 09 May 2025
LDGNet: A Lightweight Difference Guiding Network for Remote Sensing Change Detection Chenfeng Xu 34 0 0 07 Apr 2025
Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks Devon Jarvis Richard Klein Benjamin Rosman Andrew M. Saxe MLT 66 1 0 08 Mar 2025
Quadratic Gating Functions in Mixture of Experts: A Statistical Insight Pedram Akbarian Huy Le Nguyen Xing Han Nhat Ho MoE 42 0 0 15 Oct 2024
GTAGCN: Generalized Topology Adaptive Graph Convolutional Networks Sukhdeep Singh Anuj Sharma Vinod Kumar Chauhan 31 0 0 22 Mar 2024
Beyond Accuracy: An Empirical Study on Unit Testing in Open-source Deep Learning Projects Han Wang Sijia Yu Chunyang Chen Burak Turhan Xiaodong Zhu ELM MLAU 25 2 0 26 Feb 2024
Physics-informed Deep Learning to Solve Three-dimensional Terzaghi Consolidation Equation: Forward and Inverse Problems Biao Yuan Ana Heitor He Wang Xiaohui Chen AI4CE PINN 37 1 0 08 Jan 2024
Physics-Informed Solution of The Stationary Fokker-Plank Equation for a Class of Nonlinear Dynamical Systems: An Evaluation Study H. Alhussein Mohammed Khasawneh M. Daqaq 26 1 0 25 Sep 2023
Amplifying Sine Unit: An Oscillatory Activation Function for Deep Neural Networks to Recover Nonlinear Oscillations Efficiently J. Rahman Faiza Makhdoom D. Lu 27 7 0 18 Apr 2023
Situational-Aware Multi-Graph Convolutional Recurrent Network (SA-MGCRN) for Travel Demand Forecasting During Wildfires Xiaojian Zhang Xilei Zhao Yiming Xu Ruggiero Lovreglio D. Nilsson 21 4 0 13 Apr 2023
CyclicFL: A Cyclic Model Pre-Training Approach to Efficient Federated Learning Peng Zhang Yingbo Zhou Ming Hu Xin Fu Xian Wei Mingsong Chen FedML 32 1 0 28 Jan 2023
Efficient Activation Function Optimization through Surrogate Modeling G. Bingham Risto Miikkulainen 18 2 0 13 Jan 2023
Smooth Mathematical Function from Compact Neural Networks I. K. Hong 21 0 0 31 Dec 2022
Nish: A Novel Negative Stimulated Hybrid Activation Function Yildiray Anagün Ş. Işık 24 2 0 17 Oct 2022
Cross Task Neural Architecture Search for EEG Signal Classifications Yiqun Duan Zhen Wang Yi Li Jianhang Tang Yu-Kai Wang Chin-Teng Lin 21 3 0 01 Oct 2022
Biological connectomes as a representation for the architecture of artificial neural networks Samuel Schmidgall Catherine D. Schuman Maryam Parsa 23 2 0 28 Sep 2022
How important are activation functions in regression and classification? A survey, performance comparison, and future directions Ameya Dilip Jagtap George Karniadakis AI4CE 37 71 0 06 Sep 2022
Data Provenance via Differential Auditing Xin Mu Ming Pang Feida Zhu 13 1 0 04 Sep 2022
Concept-Based Techniques for "Musicologist-friendly" Explanations in a Deep Music Classifier Francesco Foscarin Katharina Hoedt Verena Praher A. Flexer Gerhard Widmer 21 11 0 26 Aug 2022
Verification of Sigmoidal Artificial Neural Networks using iSAT Dominik Grundt Sorin Liviu Jurj Willem Hagemann P. Kröger M. Fränzle 35 2 0 14 Jul 2022
Trusted Multi-Scale Classification Framework for Whole Slide Image Ming Feng Kele Xu Na Wu Weiquan Huang Yan Bai Changjian Wang Huaimin Wang 39 5 0 12 Jul 2022
Neural Networks with A La Carte Selection of Activation Functions Moshe Sipper 24 7 0 24 Jun 2022
Evolution of Activation Functions for Deep Learning-Based Image Classification Raz Lapid Moshe Sipper 27 11 0 24 Jun 2022
Deep radiomic signature with immune cell markers predicts the survival of glioma patients A. Chaddad Mingli Zhang Saima Rathore P. Sargos Christian Desrosiers T. Niazi 14 22 0 09 Jun 2022
Benchmarking of Deep Learning models on 2D Laminar Flow behind Cylinder Mritunjay Musale Vaibhav Vasani AI4CE 21 0 0 26 May 2022
Residual-Concatenate Neural Network with Deep Regularization Layers for Binary Classification Abhishek Gupta Sruthi Nair Raunak Joshi V. Chitre 26 5 0 25 May 2022
CapillaryX: A Software Design Pattern for Analyzing Medical Images in Real-time using Deep Learning Maged Abdalla Helmy Abdou Paulo Ferreira E. Jul T. Truong 24 1 0 13 Apr 2022
Functional mimicry of Ruffini receptors with Fiber Bragg Gratings and Deep Neural Networks enables a bio-inspired large-area tactile sensitive skin Luca Massari Giulia Fransvea Jessica DÁbbraccio M. Filosa Giuseppe Terruso ... Martina Zaltieri E. Schena E. Palermo E. Sinibaldi C. Oddo 15 105 0 23 Mar 2022
Combining Varied Learners for Binary Classification using Stacked Generalization Sruthi Nair Abhishek Gupta Raunak Joshi V. Chitre 31 8 0 17 Feb 2022
Universal Spam Detection using Transfer Learning of BERT Model Vijay Srinivas Tida Sonya Hsu 20 47 0 07 Feb 2022
Convergence of a robust deep FBSDE method for stochastic control Kristoffer Andersson Adam Andersson C. Oosterlee 34 19 0 18 Jan 2022
On Training Targets and Activation Functions for Deep Representation Learning in Text-Dependent Speaker Verification A. Sarkar Zheng-Hua Tan 16 2 0 17 Jan 2022
Multiagent Model-based Credit Assignment for Continuous Control Dongge Han Chris Xiaoxuan Lu Tomasz P. Michalak Michael Wooldridge 27 5 0 27 Dec 2021
DPFM: Deep Partial Functional Maps Souhaib Attaiki Gautam Pai M. Ovsjanikov 30 57 0 19 Oct 2021
Minimal Multi-Layer Modifications of Deep Neural Networks Idan Refaeli Guy Katz KELM AAML 35 15 0 18 Oct 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 41 643 0 29 Sep 2021
AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks G. Bingham Risto Miikkulainen ODL 24 4 0 18 Sep 2021
A survey on deep learning approaches for breast cancer diagnosis Timothy C. H. Kwong S. Mazaheri MedIm 27 4 0 18 Sep 2021
Software Vulnerability Detection via Deep Learning over Disaggregated Code Graph Representation Yufan Zhuang Sahil Suneja Veronika Thost Giacomo Domeniconi Alessandro Morari Jim Laredo GNN 27 15 0 07 Sep 2021
Effect of the output activation function on the probabilities and errors in medical image segmentation Lars Nieradzik G. Scheuermann D. Saur Christina Gillmann SSeg MedIm UQCV 35 6 0 02 Sep 2021
Medical Image Segmentation with 3D Convolutional Neural Networks: A Survey S. Niyas S. Pawan Anand Kumar Jeny Rajan MedIm 44 83 0 19 Aug 2021
Machine Learning Detection Algorithm for Large Barkhausen Jumps in Cluttered Environment R. Alimi Amir Ivry Elad Fisher E. Weiss 11 1 0 27 Jun 2021
E(n) Equivariant Normalizing Flows Victor Garcia Satorras Emiel Hoogeboom F. Fuchs Ingmar Posner Max Welling BDL 37 168 0 19 May 2021
Privacy and Trust Redefined in Federated Machine Learning Pavlos Papadopoulos Will Abramson A. Hall Nikolaos Pitropakis William J. Buchanan 33 42 0 29 Mar 2021
Deep Learning Based Classification of Unsegmented Phonocardiogram Spectrograms Leveraging Transfer Learning Kaleem Nawaz Khan Faiq Ahmad Khan A. Abid T. Ölmez Z. Dokur Amith Khandakar M. Chowdhury Muhammad Salman Khan 21 37 0 15 Dec 2020
Detection of False-Reading Attacks in the AMI Net-Metering System Mahmoud M. Badr Mohamed I. Ibrahem Mohamed Mahmoud M. Fouda Waleed S. Alasmary 36 3 0 02 Dec 2020
Deep learning insights into cosmological structure formation Luisa Lucie-Smith H. Peiris A. Pontzen Brian D. Nord Jeyan Thiyagalingam 24 6 0 20 Nov 2020
Privacy-Preserving and Efficient Data Collection Scheme for AMI Networks Using Deep Learning Mohamed I. Ibrahem Mohamed Mahmoud M. Fouda F. Alsolami Waleed S. Alasmary Xuemin Shen Shen 23 28 0 07 Nov 2020
Augmenting Organizational Decision-Making with Deep Learning Algorithms: Principles, Promises, and Challenges Yash Raj Shrestha Vaibhav Krishna G. Krogh 37 165 0 02 Nov 2020
A Generative Model based Adversarial Security of Deep Learning and Linear Classifier Models Ferhat Ozgur Catak Samed Sivaslioglu Kevser Sahinbas AAML 23 7 0 17 Oct 2020