Optimization and Generalization of Shallow Neural Networks with
Quadratic Activation Functions

Optimization and Generalization of Shallow Neural Networks with Quadratic Activation Functions

27 June 2020

Stefano Sarao Mannelli

Eric Vanden-Eijnden

Lenka Zdeborová

Papers citing "Optimization and Generalization of Shallow Neural Networks with Quadratic Activation Functions"

13 / 13 papers shown

Title
Information-Theoretic Guarantees for Recovering Low-Rank Tensors from Symmetric Rank-One Measurements Eren C. Kızıldağ 63 0 0 07 Feb 2025
Geometry and Optimization of Shallow Polynomial Networks Yossi Arjevani Joan Bruna Joe Kileel Elzbieta Polak Matthew Trager 36 1 0 10 Jan 2025
Grokking as a First Order Phase Transition in Two Layer Networks Noa Rubin Inbar Seroussi Zohar Ringel 37 16 0 05 Oct 2023
Embeddings between Barron spaces with higher order activation functions T. J. Heeringa L. Spek Felix L. Schwenninger C. Brune 42 3 0 25 May 2023
Neural Networks Efficiently Learn Low-Dimensional Representations with SGD Alireza Mousavi-Hosseini Sejun Park M. Girotti Ioannis Mitliagkas Murat A. Erdogdu MLT 324 48 0 29 Sep 2022
On Feature Learning in Neural Networks with Global Convergence Guarantees Zhengdao Chen Eric Vanden-Eijnden Joan Bruna MLT 36 13 0 22 Apr 2022
The Spectral Bias of Polynomial Neural Networks Moulik Choraria L. Dadi Grigorios G. Chrysos Julien Mairal V. Cevher 29 18 0 27 Feb 2022
Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs Inbar Seroussi Gadi Naveh Zohar Ringel 37 51 0 31 Dec 2021
Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II Yossi Arjevani M. Field 28 18 0 21 Jul 2021
The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion D. Kunin Javier Sagastuy-Breña Lauren Gillespie Eshed Margalit Hidenori Tanaka Surya Ganguli Daniel L. K. Yamins 36 16 0 19 Jul 2021
A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs Gadi Naveh Zohar Ringel SSL MLT 36 31 0 08 Jun 2021
Landscape analysis for shallow neural networks: complete classification of critical points for affine target functions Patrick Cheridito Arnulf Jentzen Florian Rossmannek 29 10 0 19 Mar 2021
Towards a Mathematical Understanding of Neural Network-Based Machine Learning: what we know and what we don't E. Weinan Chao Ma Stephan Wojtowytsch Lei Wu AI4CE 29 133 0 22 Sep 2020