The Natural Gradient by Analogy to Signal Whitening, and Recipes and Tricks for its Use

8 May 2012

Papers citing "The Natural Gradient by Analogy to Signal Whitening, and Recipes and Tricks for its Use"

7 / 7 papers shown

Title
Unnatural Algorithms in Machine Learning Christian Goodbrake 8 0 0 07 Dec 2023
A Novel Structured Natural Gradient Descent for Deep Learning Weihua Liu Xiabi Liu ODL 11 0 0 21 Sep 2021
Whitening and second order optimization both make information in the dataset unusable during training, and can reduce or prevent generalization Neha S. Wadia Daniel Duckworth S. Schoenholz Ethan Dyer Jascha Narain Sohl-Dickstein 19 13 0 17 Aug 2020
Natural Neural Networks Guillaume Desjardins Karen Simonyan Razvan Pascanu Koray Kavukcuoglu 12 176 0 01 Jul 2015
Fast large-scale optimization by unifying stochastic gradient and quasi-Newton methods Jascha Narain Sohl-Dickstein Ben Poole Surya Ganguli ODL 45 125 0 09 Nov 2013
Revisiting Natural Gradient for Deep Networks Razvan Pascanu Yoshua Bengio ODL 29 385 0 16 Jan 2013
Efficient Methods for Unsupervised Learning of Probabilistic Models Jascha Narain Sohl-Dickstein TPM 31 0 0 19 May 2012