Mean-field Analysis of Piecewise Linear Solutions for Wide ReLU Networks

Mean-field Analysis of Piecewise Linear Solutions for Wide ReLU Networks

3 November 2021

Vyacheslav Kungurtsev

Papers citing "Mean-field Analysis of Piecewise Linear Solutions for Wide ReLU Networks"

7 / 7 papers shown

Title
Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime Francesco Camilli D. Tieplova Eleonora Bergamin Jean Barbier 117 0 0 06 May 2025
Equidistribution-based training of Free Knot Splines and ReLU Neural Networks Simone Appella S. Arridge Chris Budd Teo Deveney L. Kreusser 38 0 0 02 Jul 2024
Penalising the biases in norm regularisation enforces sparsity Etienne Boursier Nicolas Flammarion 37 14 0 02 Mar 2023
$Intrinsic dimensionality and generalization properties of the $\mathcal{R}$-norm inductive bias$ Intrinsic dimensionality and generalization properties of the $\mathcal{R}$ -norm inductive bias Navid Ardeshir Daniel J. Hsu Clayton Sanford CML AI4CE 18 6 0 10 Jun 2022
Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs Etienne Boursier Loucas Pillaud-Vivien Nicolas Flammarion ODL 24 58 0 02 Jun 2022
Sharp asymptotics on the compression of two-layer neural networks Mohammad Hossein Amani Simone Bombari Marco Mondelli Rattana Pukdee Stefano Rini MLT 24 0 0 17 May 2022
Convex Analysis of the Mean Field Langevin Dynamics Atsushi Nitanda Denny Wu Taiji Suzuki MLT 68 64 0 25 Jan 2022