A Method on Searching Better Activation Functions

19 May 2024

Zibin Dong

Yongzhe Chang

Papers citing "A Method on Searching Better Activation Functions"

3 / 3 papers shown

Title
Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU Matias Roodschild Jorge Gotay-Sardiñas V. Jimenez A. Will 27 0 0 28 Sep 2024
Activation function optimization method: Learnable series linear units (LSLUs) Chuan Feng Xi Lin Shiping Zhu Hongkang Shi Maojie Tang Hua Huang 40 0 0 28 Aug 2024
Why Rectified Power Unit Networks Fail and How to Improve It: An Effective Theory Perspective Taeyoung Kim Myungjoo Kang 35 0 0 04 Aug 2024