Depth Dependence of $μ$P Learning Rates in ReLU MLPs

Re-assign community