21
0

Fuzzy hyperparameters update in a second order optimization

Abstract

This research will present a hybrid approach to accelerate convergence in a second order optimization. An online finite difference approximation of the diagonal Hessian matrix will be introduced, along with fuzzy inferencing of several hyperparameters. Competitive results have been achieved

View on arXiv
Comments on this paper