Non-linear Neurons with Human-like Apical Dendrite Activations

2 February 2020

Mariana-Iuliana Georgescu

Radu Tudor Ionescu

Nicolae-Cătălin Ristea

N. Sebe

ArXiv PDF HTML

Papers citing "Non-linear Neurons with Human-like Apical Dendrite Activations"

30 / 30 papers shown

Title
Personalized Speech Emotion Recognition in Human-Robot Interaction using Vision Transformers Ruchik Mishra Andrew Frye M. M. Rayguru Dan O. Popa 101 1 0 16 Sep 2024
Towards NeuroAI: Introducing Neuronal Diversity into Artificial Neural Networks Fenglei Fan Yingxin Li Hanchuan Peng T. Zeng Fei Wang 38 5 0 23 Jan 2023
SepTr: Separable Transformer for Audio Spectrogram Processing Nicolae-Cătălin Ristea Radu Tudor Ionescu Fahad Shahbaz Khan ViT 36 30 0 17 Mar 2022
Teacher-Student Training and Triplet Loss to Reduce the Effect of Drastic Face Occlusion Mariana-Iuliana Georgescu Georgian-Emilian Duta Radu Tudor Ionescu 3DH CVBM 41 19 0 20 Nov 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 57 652 0 29 Sep 2021
Self-paced ensemble learning for speech and audio classification Nicolae-Cătălin Ristea Radu Tudor Ionescu 118 23 0 22 Mar 2021
Adaptive Rational Activations to Boost Deep Reinforcement Learning Quentin Delfosse P. Schramowski Martin Mundt Alejandro Molina Kristian Kersting 56 15 0 18 Feb 2021
A survey on modern trainable activation functions Andrea Apicella Francesco Donnarumma Francesco Isgrò R. Prevete 47 373 0 02 May 2020
Visually Guided Self Supervised Learning of Speech Representations Abhinav Shukla Konstantinos Vougioukas Pingchuan Ma Stavros Petridis Maja Pantic SSL 37 25 0 13 Jan 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 242 42,038 0 03 Dec 2019
On the Impact of the Activation Function on Deep Neural Networks Training Soufiane Hayou Arnaud Doucet Judith Rousseau ODL 42 197 0 19 Feb 2019
MOROCO: The Moldavian and Romanian Dialectal Corpus Andrei M. Butnaru Radu Tudor Ionescu 33 42 0 19 Jan 2019
A Survey of the Recent Architectures of Deep Convolutional Neural Networks Asifullah Khan A. Sohail Umme Zahoora Aqsa Saeed Qureshi OOD 87 2,286 0 17 Jan 2019
Training Multi-layer Spiking Neural Networks using NormAD based Spatio-Temporal Error Backpropagation Navin Anwani Bipin Rajendran 13 18 0 23 Oct 2018
Deep Learning in Spiking Neural Networks A. Tavanaei M. Ghodrati Saeed Reza Kheradpisheh T. Masquelier Anthony Maida 44 1,064 0 22 Apr 2018
Squeeze-and-Excitation Networks Jie Hu Li Shen Samuel Albanie Gang Sun Enhua Wu 334 26,241 0 05 Sep 2017
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 162 8,807 0 25 Aug 2017
Age Progression/Regression by Conditional Adversarial Autoencoder Zhifei Zhang Yang Song Hairong Qi GAN CVBM 31 1,109 0 27 Feb 2017
TensorFlow: A system for large-scale machine learning Martín Abadi P. Barham Jianmin Chen Zhiwen Chen Andy Davis ... Vijay Vasudevan Pete Warden Martin Wicke Yuan Yu Xiaoqiang Zhang GNN AI4CE 331 18,300 0 27 May 2016
Noisy Activation Functions Çağlar Gülçehre Marcin Moczulski Misha Denil Yoshua Bengio 23 283 0 01 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.4K 192,638 0 10 Dec 2015
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 205 5,502 0 23 Nov 2015
Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortex J. Hawkins Subutai Ahmad 22 403 0 31 Oct 2015
Character-level Convolutional Networks for Text Classification Xiang Zhang Jiaqi Zhao Yann LeCun 182 6,077 0 04 Sep 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 168 18,534 0 06 Feb 2015
Difference Target Propagation Dong-Hyun Lee Saizheng Zhang Asja Fischer Yoshua Bengio AAML 46 346 0 23 Dec 2014
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 806 149,474 0 22 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 920 99,991 0 04 Sep 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.1K 39,383 0 01 Sep 2014
Maxout Networks Ian Goodfellow David Warde-Farley M. Berk Mirza Aaron Courville Yoshua Bengio OOD 187 2,177 0 18 Feb 2013