Efficient Activation Function Optimization through Surrogate Modeling

13 January 2023

Papers citing "Efficient Activation Function Optimization through Surrogate Modeling"

4 / 4 papers shown

Title
Efficient Search for Customized Activation Functions with Gradient Descent Lukas Strack Mahmoud Safari Frank Hutter 55 1 0 13 Aug 2024
AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks G. Bingham Risto Miikkulainen ODL 24 4 0 18 Sep 2021
Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization Stanislaw Jastrzebski Devansh Arpit Oliver Åstrand Giancarlo Kerg Huan Wang Caiming Xiong R. Socher Kyunghyun Cho Krzysztof J. Geras AI4CE 184 65 0 28 Dec 2020
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,327 0 05 Nov 2016