Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens

23 October 2023

José Miguel Hernández-Lobato

Papers citing "Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens"

3 / 3 papers shown

Title
AutoLRS: Automatic Learning-Rate Schedule by Bayesian Optimization on the Fly Yuchen Jin Tianyi Zhou Liangyu Zhao Yibo Zhu Chuanxiong Guo Marco Canini Arvind Krishnamurthy 37 18 0 22 May 2021
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 127 406 0 06 Mar 2017
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 285 9,136 0 06 Jun 2015