Escaping mediocrity: how two-layer networks learn hard generalized
linear models with SGD

v1v2 (latest)

Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD

29 May 2023

Florent Krzakala

Ludovic Stephan

ArXiv (abs)PDF HTML

Papers citing "Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD"

19 / 19 papers shown

Title
Learning time-scales in two-layers neural networks Raphael Berthier Andrea Montanari Kangjie Zhou 174 38 0 28 Feb 2023
On the symmetries in the dynamics of wide two-layer neural networks Karl Hajjar Lénaïc Chizat 51 11 0 16 Nov 2022
Learning Single-Index Models with Shallow Neural Networks A. Bietti Joan Bruna Clayton Sanford M. Song 218 71 0 27 Oct 2022
High-dimensional limit theorems for SGD: Effective dynamics and critical scaling Gerard Ben Arous Reza Gheissari Aukosh Jagannath 127 59 0 08 Jun 2022
Gradient Descent on Infinitely Wide Neural Networks: Global Convergence and Generalization Francis R. Bach Lénaïc Chizat MLT 62 24 0 15 Oct 2021
Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration Song Mei Theodor Misiakiewicz Andrea Montanari 94 112 0 26 Jan 2021
Phase retrieval in high dimensions: Statistical and computational phase transitions Antoine Maillard Bruno Loureiro Florent Krzakala Lenka Zdeborová 73 61 0 09 Jun 2020
Exact asymptotics for phase retrieval and compressed sensing with random generative priors Benjamin Aubin Bruno Loureiro Antoine Baker Florent Krzakala Lenka Zdeborová 67 36 0 04 Dec 2019
Online Stochastic Gradient Descent with Arbitrary Initialization Solves Non-smooth, Non-convex Phase Retrieval Yan Shuo Tan Roman Vershynin 76 35 0 28 Oct 2019
Limitations of Lazy Training of Two-layers Neural Networks Behrooz Ghorbani Song Mei Theodor Misiakiewicz Andrea Montanari MLT 60 143 0 21 Jun 2019
Mean Field Analysis of Neural Networks: A Central Limit Theorem Justin A. Sirignano K. Spiliopoulos MLT 89 194 0 28 Aug 2018
Trainability and Accuracy of Neural Networks: An Interacting Particle System Approach Grant M. Rotskoff Eric Vanden-Eijnden 134 123 0 02 May 2018
A Mean Field View of the Landscape of Two-Layers Neural Networks Song Mei Andrea Montanari Phan-Minh Nguyen MLT 109 863 0 18 Apr 2018
Fundamental Limits of Weak Recovery with Applications to Phase Retrieval Marco Mondelli Andrea Montanari 87 122 0 20 Aug 2017
Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Models Jean Barbier Florent Krzakala N. Macris Léo Miolane Lenka Zdeborová 94 268 0 10 Aug 2017
Bridging the Gap between Constant Step Size Stochastic Gradient Descent and Markov Chains Aymeric Dieuleveut Alain Durmus Francis R. Bach 75 156 0 20 Jul 2017
Phase Retrieval via Randomized Kaczmarz: Theoretical Guarantees Yan Shuo Tan Roman Vershynin 78 102 0 30 Jun 2017
A Geometric Analysis of Phase Retrieval Ju Sun Qing Qu John N. Wright 137 526 0 22 Feb 2016
Phase Retrieval via Wirtinger Flow: Theory and Algorithms Emmanuel Candes Xiaodong Li Mahdi Soltanolkotabi 201 1,291 0 03 Jul 2014