Exponential weight averaging as damped harmonic motion

20 October 2023

Papers citing "Exponential weight averaging as damped harmonic motion"

9 / 9 papers shown

Title
Elucidating the Design Space of Diffusion-Based Generative Models Tero Karras M. Aittala Timo Aila S. Laine DiffM 198 1,981 0 01 Jun 2022
Score-Based Generative Modeling through Stochastic Differential Equations Yang Song Jascha Narain Sohl-Dickstein Diederik P. Kingma Abhishek Kumar Stefano Ermon Ben Poole DiffM SyDa 339 6,480 0 26 Nov 2020
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients Juntang Zhuang Tommy M. Tang Yifan Ding S. Tatikonda Nicha Dvornek X. Papademetris James S. Duncan ODL 162 514 0 15 Oct 2020
Improved Techniques for Training Score-Based Generative Models Yang Song Stefano Ermon DiffM 256 1,151 0 16 Jun 2020
Sliced Score Matching: A Scalable Approach to Density and Score Estimation Yang Song Sahaj Garg Jiaxin Shi Stefano Ermon 110 417 0 17 May 2019
Generating Long Sequences with Sparse Transformers R. Child Scott Gray Alec Radford Ilya Sutskever 125 1,899 0 23 Apr 2019
WNGrad: Learn the Learning Rate in Gradient Descent Xiaoxia Wu Rachel A. Ward Léon Bottou 46 87 0 07 Mar 2018
Improved Techniques for Training GANs Tim Salimans Ian Goodfellow Wojciech Zaremba Vicki Cheung Alec Radford Xi Chen GAN 483 9,052 0 10 Jun 2016
ADADELTA: An Adaptive Learning Rate Method Matthew D. Zeiler ODL 155 6,625 0 22 Dec 2012