Stable behaviour of infinitely wide deep neural networks

Stable behaviour of infinitely wide deep neural networks

1 March 2020

Stefano Peluchetti

Papers citing "Stable behaviour of infinitely wide deep neural networks"

11 / 11 papers shown

Title
Slow Transition to Low-Dimensional Chaos in Heavy-Tailed Recurrent Neural Networks Yi Xie Stefan Mihalas Łukasz Kuśmierz 23 0 0 14 May 2025
Nonlinear Stochastic Gradient Descent and Heavy-tailed Noise: A Unified Framework and High-probability Guarantees Aleksandar Armacki Shuhua Yu Pranay Sharma Gauri Joshi Dragana Bajović D. Jakovetić S. Kar 57 2 0 17 Oct 2024
Deep Kernel Posterior Learning under Infinite Variance Prior Weights Jorge Loría A. Bhadra BDL UQCV 66 0 0 02 Oct 2024
Infinitely wide limits for deep Stable neural networks: sub-linear, linear and super-linear activation functions Alberto Bordino Stefano Favaro S. Fortini 32 7 0 08 Apr 2023
Over-parameterised Shallow Neural Networks with Asymmetrical Node Scaling: Global Convergence Guarantees and Feature Learning François Caron Fadhel Ayed Paul Jung Hoileong Lee Juho Lee Hongseok Yang 67 2 0 02 Feb 2023
Large-width asymptotics for ReLU neural networks with $α$ -Stable initializations Stefano Favaro S. Fortini Stefano Peluchetti 20 2 0 16 Jun 2022
Gaussian Pre-Activations in Neural Networks: Myth or Reality? Pierre Wolinski Julyan Arbel AI4CE 76 8 0 24 May 2022
Deep neural networks with dependent weights: Gaussian Process mixture limit, heavy tails, sparsity and compressibility Hoileong Lee Fadhel Ayed Paul Jung Juho Lee Hongseok Yang François Caron 46 10 0 17 May 2022
Bayesian neural network unit priors and generalized Weibull-tail property M. Vladimirova Julyan Arbel Stéphane Girard BDL 54 9 0 06 Oct 2021
Priors in Bayesian Deep Learning: A Review Vincent Fortuin UQCV BDL 31 124 0 14 May 2021
Hausdorff Dimension, Heavy Tails, and Generalization in Neural Networks Umut Simsekli Ozan Sener George Deligiannidis Murat A. Erdogdu 44 55 0 16 Jun 2020