v1v2v3v4v5 (latest)

Discovering Parametric Activation Functions

5 June 2020

Papers citing "Discovering Parametric Activation Functions"

31 / 31 papers shown

Title
Cauchy activation function and XNet Xin Li Zhihong Xia Hongkun Zhang 177 6 0 28 Sep 2024
KAN: Kolmogorov-Arnold Networks Ziming Liu Yixuan Wang Sachin Vaidya Fabian Ruehle James Halverson Marin Soljacic Thomas Y. Hou Max Tegmark 253 565 0 30 Apr 2024
Effective Regularization Through Loss-Function Metalearning Santiago Gonzalez Xin Qiu Risto Miikkulainen 118 5 0 02 Oct 2020
Smooth Adversarial Training Cihang Xie Mingxing Tan Boqing Gong Alan Yuille Quoc V. Le OOD 80 154 0 25 Jun 2020
SPLASH: Learnable Activation Functions for Improving Accuracy and Adversarial Robustness Mohammadamin Tavakoli Forest Agostinelli Pierre Baldi AAML FAtt 179 39 0 16 Jun 2020
Evolving Normalization-Activation Layers Hanxiao Liu Andrew Brock Karen Simonyan Quoc V. Le 100 80 0 06 Apr 2020
Evolutionary Optimization of Deep Learning Activation Functions G. Bingham William Macke Risto Miikkulainen ODL 48 50 0 17 Feb 2020
Optimizing Loss Functions Through Multivariate Taylor Polynomial Parameterization Santiago Gonzalez Risto Miikkulainen 47 9 0 31 Jan 2020
Mish: A Self Regularized Non-Monotonic Activation Function Diganta Misra 80 679 0 23 Aug 2019
Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks Alejandro Molina P. Schramowski Kristian Kersting ODL 42 82 0 15 Jul 2019
Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks Yuanzhi Li Colin Wei Tengyu Ma 58 299 0 10 Jul 2019
Learning Activation Functions: A new paradigm for understanding Neural Networks Mohit Goyal R. Goyal Brejesh Lall 65 66 0 23 Jun 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 153 18,179 0 28 May 2019
Improved Training Speed, Accuracy, and Data Utilization Through Loss Function Optimization Santiago Gonzalez Risto Miikkulainen 71 76 0 27 May 2019
A Survey on Neural Architecture Search Martin Wistuba Ambrish Rawat Tejaswini Pedapati AI4CE 65 259 0 04 May 2019
Activation Functions: Comparison of trends in Practice and Research for Deep Learning S. Bodenstedt Dominik Rivoir A. Gachagan S. T. Mees 98 1,279 0 08 Nov 2018
The Quest for the Golden Activation Function Mina Basirat P. Roth 67 53 0 02 Aug 2018
Regularized Evolution for Image Classifier Architecture Search Esteban Real A. Aggarwal Yanping Huang Quoc V. Le 177 3,036 0 05 Feb 2018
Self-Normalizing Neural Networks Günter Klambauer Thomas Unterthiner Andreas Mayr Sepp Hochreiter 470 2,519 0 08 Jun 2017
Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning Stefan Elfwing E. Uchibe Kenji Doya 136 1,739 0 10 Feb 2017
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 174 5,042 0 27 Jun 2016
TensorFlow: A system for large-scale machine learning Martín Abadi P. Barham Jianmin Chen Zhiwen Chen Andy Davis ... Vijay Vasudevan Pete Warden Martin Wicke Yuan Yu Xiaoqiang Zhang GNN AI4CE 433 18,361 0 27 May 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 353 8,000 0 23 May 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 354 10,196 0 16 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,426 0 10 Dec 2015
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 305 5,534 0 23 Nov 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 465 43,341 0 11 Feb 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 338 18,651 0 06 Feb 2015
Learning Activation Functions to Improve Deep Neural Networks Forest Agostinelli Matthew Hoffman Peter Sadowski Pierre Baldi ODL 230 475 0 21 Dec 2014
Striving for Simplicity: The All Convolutional Net Jost Tobias Springenberg Alexey Dosovitskiy Thomas Brox Martin Riedmiller FAtt 251 4,681 0 21 Dec 2014
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 460 7,667 0 03 Jul 2012