Escaping mediocrity: how two-layer networks learn hard generalized
linear models with SGD

v1v2 (latest)

Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD

29 May 2023

Florent Krzakala

Ludovic Stephan

ArXiv (abs)PDF HTML

Papers citing "Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD"

19 / 19 papers shown

Title
Learning time-scales in two-layers neural networks Raphael Berthier Andrea Montanari Kangjie Zhou 174 38 0 28 Feb 2023
On the symmetries in the dynamics of wide two-layer neural networks Karl Hajjar Lénaïc Chizat 51 11 0 16 Nov 2022
Learning Single-Index Models with Shallow Neural Networks A. Bietti Joan Bruna Clayton Sanford M. Song 218 71 0 27 Oct 2022
High-dimensional limit theorems for SGD: Effective dynamics and critical scaling Gerard Ben Arous Reza Gheissari Aukosh Jagannath 127 59 0 08 Jun 2022
Gradient Descent on Infinitely Wide Neural Networks: Global Convergence and Generalization Francis R. Bach Lénaïc Chizat MLT 62 24 0 15 Oct 2021
Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration Song Mei Theodor Misiakiewicz Andrea Montanari 94 112 0 26 Jan 2021
Phase retrieval in high dimensions: Statistical and computational phase transitions Antoine Maillard Bruno Loureiro Florent Krzakala Lenka Zdeborová 73 61 0 09 Jun 2020
Exact asymptotics for phase retrieval and compressed sensing with random generative priors Benjamin Aubin Bruno Loureiro Antoine Baker Florent Krzakala Lenka Zdeborová 67 36 0 04 Dec 2019
Online Stochastic Gradient Descent with Arbitrary Initialization Solves Non-smooth, Non-convex Phase Retrieval Yan Shuo Tan Roman Vershynin 76 35 0 28 Oct 2019
Limitations of Lazy Training of Two-layers Neural Networks Behrooz Ghorbani Song Mei Theodor Misiakiewicz Andrea Montanari MLT 60 143 0 21 Jun 2019
Mean Field Analysis of Neural Networks: A Central Limit Theorem Justin A. Sirignano K. Spiliopoulos MLT 89 194 0 28 Aug 2018
Trainability and Accuracy of Neural Networks: An Interacting Particle System Approach Grant M. Rotskoff Eric Vanden-Eijnden 134 123 0 02 May 2018
A Mean Field View of the Landscape of Two-Layers Neural Networks Song Mei Andrea Montanari Phan-Minh Nguyen MLT 109 863 0 18 Apr 2018
Fundamental Limits of Weak Recovery with Applications to Phase Retrieval Marco Mondelli Andrea Montanari 87 122 0 20 Aug 2017
Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Models Jean Barbier Florent Krzakala N. Macris Léo Miolane Lenka Zdeborová 94 268 0 10 Aug 2017
Bridging the Gap between Constant Step Size Stochastic Gradient Descent and Markov Chains Aymeric Dieuleveut Alain Durmus Francis R. Bach 75 156 0 20 Jul 2017
Phase Retrieval via Randomized Kaczmarz: Theoretical Guarantees Yan Shuo Tan Roman Vershynin 78 102 0 30 Jun 2017
A Geometric Analysis of Phase Retrieval Ju Sun Qing Qu John N. Wright 137 526 0 22 Feb 2016
Phase Retrieval via Wirtinger Flow: Theory and Algorithms Emmanuel Candes Xiaodong Li Mahdi Soltanolkotabi 199 1,291 0 03 Jul 2014

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.