Imitating Deep Learning Dynamics via Locally Elastic Stochastic
Differential Equations

Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations

11 October 2021

Weijie J. Su

Papers citing "Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations"

7 / 7 papers shown

Title
When Representations Align: Universality in Representation Learning Dynamics Loek van Rossem Andrew M. Saxe AI4CE 48 4 0 14 Feb 2024
Neural (Tangent Kernel) Collapse Mariia Seleznova Dana Weitzner Raja Giryes Gitta Kutyniok H. Chou 21 6 0 25 May 2023
Deep Neural Collapse Is Provably Optimal for the Deep Unconstrained Features Model Peter Súkeník Marco Mondelli Christoph H. Lampert 26 21 0 22 May 2023
TiDAL: Learning Training Dynamics for Active Learning Seong Min Kye Kwanghee Choi Hyeongmin Byun Buru Chang 26 13 0 13 Oct 2022
Neural Collapse: A Review on Modelling Principles and Generalization Vignesh Kothapalli 21 71 0 08 Jun 2022
Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training Cong Fang Hangfeng He Qi Long Weijie J. Su FAtt 122 165 0 29 Jan 2021
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,888 0 15 Sep 2016