Improved High-Probability Bounds for the Temporal Difference Learning
Algorithm via Exponential Stability

v1v2 (latest)

Improved High-Probability Bounds for the Temporal Difference Learning Algorithm via Exponential Stability

22 October 2023

ArXiv (abs)PDF HTML

Papers citing "Improved High-Probability Bounds for the Temporal Difference Learning Algorithm via Exponential Stability"

6 / 6 papers shown

Title
Gaussian Approximation and Multiplier Bootstrap for Polyak-Ruppert Averaged Linear Stochastic Approximation with Applications to TD Learning S. Samsonov Eric Moulines Qi-Man Shao Zhuo-Song Zhang Alexey Naumov 81 5 0 26 May 2024
Bias and Extrapolation in Markovian Linear Stochastic Approximation with Constant Stepsizes D. Huo Yudong Chen Qiaomin Xie 58 17 0 03 Oct 2022
Finite-time High-probability Bounds for Polyak-Ruppert Averaged Iterates of Linear Stochastic Approximation Alain Durmus Eric Moulines A. Naumov S. Samsonov 89 25 0 10 Jul 2022
Accelerated and instance-optimal policy evaluation with linear function approximation Tianjiao Li Guanghui Lan A. Pananjady OffRL 67 13 0 24 Dec 2021
On the Stability of Random Matrix Product with Markovian Noise: Application to Linear Stochastic Approximation and TD Learning Alain Durmus Eric Moulines A. Naumov S. Samsonov Hoi-To Wai 83 19 0 30 Jan 2021
Finite-Time Error Bounds For Linear Stochastic Approximation and TD Learning R. Srikant Lei Ying 65 252 0 03 Feb 2019

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.