PER-ETD: A Polynomially Efficient Emphatic Temporal Difference Learning Method

13 October 2021

Papers citing "PER-ETD: A Polynomially Efficient Emphatic Temporal Difference Learning Method"

19 / 19 papers shown

Title
Truncated Emphatic Temporal Difference Methods for Prediction and Control Shangtong Zhang Shimon Whiteson OffRL 40 12 0 11 Aug 2021
Learning Expected Emphatic Traces for Deep RL Ray Jiang Shangtong Zhang Veronica Chelu Adam White Hado van Hasselt OffRL 45 12 0 12 Jul 2021
Simple and optimal methods for stochastic variational inequalities, II: Markovian noise and policy evaluation in reinforcement learning Georgios Kotsalis Guanghui Lan Tianjiao Li OffRL 22 31 0 15 Nov 2020
Sample Complexity Bounds for Two Timescale Value-based Reinforcement Learning Algorithms Tengyu Xu Yingbin Liang 49 26 0 10 Nov 2020
GenDICE: Generalized Offline Estimation of Stationary Values Ruiyi Zhang Bo Dai Lihong Li Dale Schuurmans OffRL 136 173 0 21 Feb 2020
Finite Time Analysis of Linear Two-timescale Stochastic Approximation with Markovian Noise Maxim Kaledin Eric Moulines A. Naumov V. Tadic Hoi-To Wai 41 73 0 04 Feb 2020
Two Time-scale Off-Policy TD Learning: Non-asymptotic Analysis over Markovian Samples Tengyu Xu Shaofeng Zou Yingbin Liang 49 73 0 26 Sep 2019
Finite-Time Performance Bounds and Adaptive Learning Rate Selection for Two Time-Scale Reinforcement Learning Harsh Gupta R. Srikant Lei Ying 41 85 0 14 Jul 2019
Characterizing the Exact Behaviors of Temporal Difference Learning Algorithms Using Markov Jump Linear System Theory Bin Hu U. Syed 56 58 0 16 Jun 2019
Finite-Time Error Bounds For Linear Stochastic Approximation and TD Learning R. Srikant Lei Ying 58 249 0 03 Feb 2019
Deep Reinforcement Learning and the Deadly Triad H. V. Hasselt Yotam Doron Florian Strub Matteo Hessel Nicolas Sonnerat Joseph Modayil OffRL 66 226 0 06 Dec 2018
An Off-policy Policy Gradient Theorem Using Emphatic Weightings Ehsan Imani Eric Graves Martha White OffRL 49 71 0 22 Nov 2018
Finite Sample Analysis of the GTD Policy Evaluation Algorithms in Markov Setting Yue Wang Wei-neng Chen Yuting Liu Zhi-Ming Ma Tie-Yan Liu OffRL 31 39 0 21 Sep 2018
A Finite Time Analysis of Temporal Difference Learning With Linear Function Approximation Jalaj Bhandari Daniel Russo Raghav Singal 99 336 0 06 Jun 2018
A First Empirical Study of Emphatic Temporal Difference Learning Sina Ghiassian Banafsheh Rafiee R. Sutton OffRL 20 14 0 11 May 2017
Generalized Emphatic Temporal Difference Learning: Bias-Variance Analysis Assaf Hallak Aviv Tamar Rémi Munos Shie Mannor OffRL 70 56 0 17 Sep 2015
Emphatic Temporal-Difference Learning A. R. Mahmood Huizhen Yu Martha White R. Sutton 112 33 0 06 Jul 2015
On Convergence of Emphatic Temporal-Difference Learning Huizhen Yu OffRL 38 73 0 08 Jun 2015
An Emphatic Approach to the Problem of Off-policy Temporal-Difference Learning R. Sutton A. R. Mahmood Martha White 62 269 0 14 Mar 2015