Spectral alignment of stochastic gradient descent for high-dimensional classification tasks

4 October 2023

Papers citing "Spectral alignment of stochastic gradient descent for high-dimensional classification tasks"

9 / 9 papers shown

Title
Subspace Langevin Monte Carlo Tyler Maunu Jiayi Yao 103 0 0 18 Dec 2024
A theoretical perspective on mode collapse in variational inference Roman Soletskyi Marylou Gabrié Bruno Loureiro DRL 34 2 0 17 Oct 2024
A spring-block theory of feature learning in deep neural networks Chengzhi Shi Liming Pan Ivan Dokmanić AI4CE 40 1 0 28 Jul 2024
Linguistic Collapse: Neural Collapse in (Large) Language Models Robert Wu Vardan Papyan 48 12 0 28 May 2024
Does SGD really happen in tiny subspaces? Minhak Song Kwangjun Ahn Chulhee Yun 71 5 1 25 May 2024
Unifying Low Dimensional Observations in Deep Learning Through the Deep Linear Unconstrained Feature Model Connall Garrod Jonathan P. Keating 41 8 0 09 Apr 2024
Feature learning as alignment: a structural property of gradient descent in non-linear neural networks Daniel Beaglehole Ioannis Mitliagkas Atish Agarwala MLT 39 2 0 07 Feb 2024
Deconstructing the Goldilocks Zone of Neural Network Initialization Artem Vysogorets Anna Dawid Julia Kempe 38 1 0 05 Feb 2024
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 183 1,185 0 30 Nov 2014