Tractable structured natural gradient descent using local parameterizations

15 February 2021

Papers citing "Tractable structured natural gradient descent using local parameterizations"

9 / 9 papers shown

Title
Spectral-factorized Positive-definite Curvature Learning for NN Training Wu Lin Felix Dangel Runa Eschenhagen Juhan Bae Richard E. Turner Roger B. Grosse 47 0 0 10 Feb 2025
Structured Inverse-Free Natural Gradient: Memory-Efficient & Numerically-Stable KFAC Wu Lin Felix Dangel Runa Eschenhagen Kirill Neklyudov Agustinus Kristiadi Richard Turner Alireza Makhzani 22 3 0 09 Dec 2023
Variational Bayes Made Easy Mohammad Emtiyaz Khan BDL 24 1 0 27 Apr 2023
The Lie-Group Bayesian Learning Rule E. M. Kıral Thomas Möllenhoff Mohammad Emtiyaz Khan BDL 17 2 0 08 Mar 2023
The Geometry of Neural Nets' Parameter Spaces Under Reparametrization Agustinus Kristiadi Felix Dangel Philipp Hennig 32 11 0 14 Feb 2023
A Unified Perspective on Natural Gradient Variational Inference with Gaussian Mixture Models O. Arenz Philipp Dahlinger Zihan Ye Michael Volpp Gerhard Neumann 39 15 0 23 Sep 2022
Nys-Newton: Nyström-Approximated Curvature for Stochastic Optimization Dinesh Singh Hardik Tankaria M. Yamada ODL 42 2 0 16 Oct 2021
The Bayesian Learning Rule Mohammad Emtiyaz Khan Håvard Rue BDL 60 73 0 09 Jul 2021
Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam Mohammad Emtiyaz Khan Didrik Nielsen Voot Tangkaratt Wu Lin Y. Gal Akash Srivastava ODL 74 266 0 13 Jun 2018