Two failure modes of deep transformers and how to avoid them: a unified theory of signal propagation at initialisation

Two failure modes of deep transformers and how to avoid them: a unified theory of signal propagation at initialisation

30 May 2025

Alessio Giorlandino

Sebastian Goldt

ArXiv (abs)PDF HTML

Papers citing "Two failure modes of deep transformers and how to avoid them: a unified theory of signal propagation at initialisation"

Title
No papers