Why Warmup the Learning Rate? Underlying Mechanisms and Improvements

13 June 2024

Papers citing "Why Warmup the Learning Rate? Underlying Mechanisms and Improvements"

3 / 3 papers shown

Title
A Privacy-Preserving Domain Adversarial Federated learning for multi-site brain functional connectivity analysis Wenjie Qu Likai Wang Kuan-Jui Su Aiying Zhang Hao Zhu Xiaowen Liu Hui Shen Vince D. Calhoun Yuping Wang H. Deng 63 0 0 03 Feb 2025
Simulating Dynamic Tumor Contrast Enhancement in Breast MRI using Conditional Generative Adversarial Networks Richard Osuala Smriti Joshi Apostolia Tsirikoglou Lidia Garrucho Walter H. L. Pinaya Daniel M. Lang J. Schnabel Oliver Díaz Karim Lekadir MedIm 38 0 0 27 Sep 2024
The large learning rate phase of deep learning: the catapult mechanism Aitor Lewkowycz Yasaman Bahri Ethan Dyer Jascha Narain Sohl-Dickstein Guy Gur-Ari ODL 159 234 0 04 Mar 2020