Complex energy landscapes in spiked-tensor and simple glassy models:
ruggedness, arrangements of local minima and phase transitions

Complex energy landscapes in spiked-tensor and simple glassy models: ruggedness, arrangements of local minima and phase transitions

8 April 2018

Gerard Ben Arous

Papers citing "Complex energy landscapes in spiked-tensor and simple glassy models: ruggedness, arrangements of local minima and phase transitions"

13 / 13 papers shown

Title
Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models Alexandru Damian Eshaan Nichani Rong Ge Jason D. Lee MLT 44 33 0 18 May 2023
Learning Single-Index Models with Shallow Neural Networks A. Bietti Joan Bruna Clayton Sanford M. Song 170 68 0 27 Oct 2022
Large-N dynamics of the spiked tensor model with random initial conditions V. Sazonov 14 0 0 26 Aug 2022
Universal characteristics of deep neural network loss surfaces from random matrix theory Nicholas P. Baskerville J. Keating F. Mezzadri J. Najnudel Diego Granziol 32 4 0 17 May 2022
Optimal learning rate schedules in high-dimensional non-convex optimization problems Stéphane dÁscoli Maria Refinetti Giulio Biroli 23 7 0 09 Feb 2022
Selective Multiple Power Iteration: from Tensor PCA to gradient-based exploration of landscapes M. Ouerfelli M. Tamaazousti V. Rivasseau 39 7 0 23 Dec 2021
Symmetry Breaking in Symmetric Tensor Decomposition Yossi Arjevani Joan Bruna M. Field Joe Kileel Matthew Trager Francis Williams 32 8 0 10 Mar 2021
Appearance of Random Matrix Theory in Deep Learning Nicholas P. Baskerville Diego Granziol J. Keating 18 11 0 12 Feb 2021
A spin-glass model for the loss surfaces of generative adversarial networks Nicholas P. Baskerville J. Keating F. Mezzadri J. Najnudel GAN 35 12 0 07 Jan 2021
Reducibility and Statistical-Computational Gaps from Secret Leakage Matthew Brennan Guy Bresler 35 86 0 16 May 2020
Iterative Averaging in the Quest for Best Test Error Diego Granziol Xingchen Wan Samuel Albanie Stephen J. Roberts 15 3 0 02 Mar 2020
Thresholds of descending algorithms in inference problems Stefano Sarao Mannelli Lenka Zdeborova AI4CE 24 4 0 02 Jan 2020
How to iron out rough landscapes and get optimal performances: Averaged Gradient Descent and its application to tensor PCA Giulio Biroli C. Cammarota F. Ricci-Tersenghi 39 27 0 29 May 2019