Does the Markov Decision Process Fit the Data: Testing for the Markov
Property in Sequential Decision Making

Does the Markov Decision Process Fit the Data: Testing for the Markov Property in Sequential Decision Making

5 February 2020

Papers citing "Does the Markov Decision Process Fit the Data: Testing for the Markov Property in Sequential Decision Making"

11 / 11 papers shown

Title
Statistical Inference in Reinforcement Learning: A Selective Survey Chengchun Shi OffRL 69 0 0 22 Feb 2025
Counterfactually Fair Reinforcement Learning via Sequential Data Preprocessing Jitao Wang C. Shi John D. Piette Joshua R. Loftus Donglin Zeng Zhenke Wu OffRL 64 0 0 10 Jan 2025
A Graphical Approach to State Variable Selection in Off-policy Learning Joakim Blach Andersen Qingyuan Zhao CML OffRL 33 0 0 03 Jan 2025
Spatially Randomized Designs Can Enhance Policy Evaluation Ying Yang Chengchun Shi Fang Yao Shouyang Wang Hongtu Zhu OffRL 41 0 0 18 Mar 2024
Testing for the Markov Property in Time Series via Deep Conditional Generative Learning Yunzhe Zhou C. Shi Lexin Li Q. Yao AI4TS 38 8 0 30 May 2023
Doubly Inhomogeneous Reinforcement Learning Liyuan Hu Mengbing Li C. Shi Zhanghua Wu Piotr Fryzlewicz OffRL 31 2 0 08 Nov 2022
Testing Stationarity and Change Point Detection in Reinforcement Learning Mengbing Li C. Shi Zhanghua Wu Piotr Fryzlewicz OffRL 42 9 0 03 Mar 2022
Off-Policy Confidence Interval Estimation with Confounded Markov Decision Process C. Shi Jin Zhu Ye Shen Shuang Luo Hong Zhu R. Song OffRL 28 30 0 22 Feb 2022
Learning Visual Feedback Control for Dynamic Cloth Folding Julius Hietala David Blanco Mulero G. Alcan Ville Kyrki 37 27 0 10 Sep 2021
Deeply-Debiased Off-Policy Interval Estimation C. Shi Runzhe Wan Victor Chernozhukov R. Song OffRL 14 35 0 10 May 2021
Dynamic Causal Effects Evaluation in A/B Testing with a Reinforcement Learning Framework C. Shi Xiaoyu Wang Shuang Luo Hongtu Zhu Jieping Ye R. Song CML OffRL 30 33 0 05 Feb 2020