Depth Dependence of $μ$P Learning Rates in ReLU MLPs

Depth Dependence of μμP Learning Rates in ReLU MLPs

Papers citing "Depth Dependence of $μ$P Learning Rates in ReLU MLPs"

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.