Kalman Gradient Descent: Adaptive Variance Reduction in Stochastic Optimization

29 October 2018

Papers citing "Kalman Gradient Descent: Adaptive Variance Reduction in Stochastic Optimization"

7 / 7 papers shown

Title
Protocol Models: Scaling Decentralized Training with Communication-Efficient Model Parallelism Sameera Ramasinghe Thalaiyasingam Ajanthan Gil Avraham Yan Zuo Alexander Long GNN 90 0 0 02 Jun 2025
DiSK: Differentially Private Optimizer with Simplified Kalman Filter for Noise Reduction Xinwei Zhang Zhiqi Bu Borja Balle Mingyi Hong Meisam Razaviyayn Vahab Mirrokni 141 2 0 04 Oct 2024
Variational Stochastic Gradient Descent for Deep Neural Networks Haotian Chen Anna Kuzina Babak Esmaeili Jakub M. Tomczak 109 0 0 09 Apr 2024
KOALA: A Kalman Optimization Algorithm with Loss Adaptivity A. Davtyan Sepehr Sameni L. Cerkezi Givi Meishvili Adam Bielski Paolo Favaro ODL 172 3 0 07 Jul 2021
Self-Tuning Stochastic Optimization with Curvature-Aware Gradient Filtering Ricky T. Q. Chen Dami Choi Lukas Balles David Duvenaud Philipp Hennig ODL 84 6 0 09 Nov 2020
Kalman meets Bellman: Improving Policy Evaluation through Value Tracking Shirli Di-Castro Shashua Shie Mannor OffRL 50 12 0 17 Feb 2020
Trust Region Value Optimization using Kalman Filtering Shirli Di-Castro Shashua Shie Mannor 61 8 0 23 Jan 2019