Phase Diagram of Initial Condensation for Two-layer Neural Networks

12 March 2023

Papers citing "Phase Diagram of Initial Condensation for Two-layer Neural Networks"

7 / 7 papers shown

Title
An overview of condensation phenomenon in deep learning Zhi-Qin John Xu Yaoyu Zhang Zhangchen Zhou AI4CE 29 0 0 13 Apr 2025
$$\text{Memory}^3$: Language Modeling with Explicit Memory$ $\text{Memory}^3$ : Language Modeling with Explicit Memory Hongkang Yang Zehao Lin Wenjin Wang Hao Wu Zhiyu Li ... Yu Yu Kai Chen Feiyu Xiong Linpeng Tang Weinan E 48 11 0 01 Jul 2024
On the dynamics of three-layer neural networks: initial condensation Zheng-an Chen Tao Luo MLT AI4CE 17 3 0 25 Feb 2024
Directional Convergence Near Small Initializations and Saddles in Two-Homogeneous Neural Networks Akshay Kumar Jarvis D. Haupt ODL 30 7 0 14 Feb 2024
Anchor function: a type of benchmark functions for studying language models Zhongwang Zhang Zhiwei Wang Junjie Yao Zhangchen Zhou Xiaolong Li E. Weinan Z. Xu 34 5 0 16 Jan 2024
Loss Spike in Training Neural Networks Zhongwang Zhang Z. Xu 28 4 0 20 May 2023
Understanding the Initial Condensation of Convolutional Neural Networks Zhangchen Zhou Hanxu Zhou Yuqing Li Zhi-Qin John Xu MLT AI4CE 23 5 0 17 May 2023