Breaking the Curse of Horizon: Infinite-Horizon Off-Policy Estimation

29 October 2018

Papers citing "Breaking the Curse of Horizon: Infinite-Horizon Off-Policy Estimation"

50 / 252 papers shown

Title
A new Gradient TD Algorithm with only One Step-size: Convergence Rate Analysis using $L$ - $λ$ Smoothness Hengshuai Yao 48 2 0 29 Jul 2023
The Optimal Approximation Factors in Misspecified Off-Policy Value Function Estimation Philip Amortila Nan Jiang Csaba Szepesvári OffRL 55 3 0 25 Jul 2023
Hindsight-DICE: Stable Credit Assignment for Deep Reinforcement Learning Akash Velu Skanda Vaidyanath Dilip Arumugam OffRL 54 1 0 21 Jul 2023
Offline Diversity Maximization Under Imitation Constraints Marin Vlastelica Jin Cheng Georg Martius Pavel Kolev OffRL 109 0 0 21 Jul 2023
Reward-Directed Conditional Diffusion: Provable Distribution Estimation and Reward Improvement Hui Yuan Kaixuan Huang Chengzhuo Ni Minshuo Chen Mengdi Wang DiffM 94 37 0 13 Jul 2023
A Meta-Learning Method for Estimation of Causal Excursion Effects to Assess Time-Varying Moderation Jieru Shi Walter Dempsey CML 40 4 0 28 Jun 2023
Correcting discount-factor mismatch in on-policy policy gradient methods Fengdi Che Gautham Vasan A. R. Mahmood OffRL 60 9 0 23 Jun 2023
$$\pi2\text{vec}$: Policy Representations with Successor Features$ $\pi2\text{vec}$ : Policy Representations with Successor Features Gianluca Scarpellini Ksenia Konyushkova Claudio Fantacci T. Paine Yutian Chen Misha Denil OffRL 55 0 0 16 Jun 2023
Off-policy Evaluation in Doubly Inhomogeneous Environments Zeyu Bian C. Shi Zhengling Qi Lan Wang OffRL 107 7 0 14 Jun 2023
State Regularized Policy Optimization on Data with Dynamics Shift Zhenghai Xue Qingpeng Cai Shuchang Liu Dong Zheng Peng Jiang Kun Gai Bo An OffRL 55 18 0 06 Jun 2023
Offline Reinforcement Learning with Additional Covering Distributions Chenjie Mao OffRL 113 0 0 22 May 2023
Evaluating Dynamic Conditional Quantile Treatment Effects with Applications in Ridesharing Ting Li C. Shi Zhaohua Lu Yi Li Hongtu Zhu 84 5 0 17 May 2023
Off-Policy Evaluation for Large Action Spaces via Conjunct Effect Modeling Yuta Saito Qingyang Ren Thorsten Joachims CML OffRL 67 26 0 14 May 2023
Correcting for Interference in Experiments: A Case Study at Douyin Vivek F. Farias Hao Li Tianyi Peng Xinyuyang Ren B. Hassibi A. Zheng 58 13 0 04 May 2023
A Coupled Flow Approach to Imitation Learning G. Freund Elad Sarafian Sarit Kraus OOD 67 13 0 29 Apr 2023
Conformal Off-Policy Evaluation in Markov Decision Processes Daniele Foffano Alessio Russo Alexandre Proutiere OffRL 161 7 0 05 Apr 2023
On the Sample Complexity of Vanilla Model-Based Offline Reinforcement Learning with Dependent Samples Mustafa O. Karabag Ufuk Topcu OffRL 92 5 0 07 Mar 2023
Asymptotically Unbiased Off-Policy Policy Evaluation when Reusing Old Data in Nonstationary Environments Vincent Liu Yash Chandak Philip S. Thomas Martha White OffRL 46 0 0 23 Feb 2023
HOPE: Human-Centric Off-Policy Evaluation for E-Learning and Healthcare Ge Gao Song Ju Markel Sanz Ausin Min Chi OffRL 79 8 0 18 Feb 2023
A Strong Baseline for Batch Imitation Learning Matthew Smith Lucas Maystre Zhenwen Dai K. Ciosek OffRL 80 5 0 06 Feb 2023
Offline Learning of Closed-Loop Deep Brain Stimulation Controllers for Parkinson Disease Treatment Qitong Gao Stephen L. Schimdt Afsana Chowdhury Guangyu Feng Jennifer J. Peters Katherine Genty W. Grill Dennis A. Turner Miroslav Pajic OffRL 73 11 0 05 Feb 2023
Reinforcement Learning in Low-Rank MDPs with Density Features Audrey Huang Jinglin Chen Nan Jiang OffRL 84 14 0 04 Feb 2023
Robust Fitted-Q-Evaluation and Iteration under Sequentially Exogenous Unobserved Confounders David Bruns-Smith Angela Zhou OffRL 54 10 0 01 Feb 2023
Efficient Policy Evaluation with Offline Data Informed Behavior Policy Design Shuze Liu Shangtong Zhang OffRL 99 5 0 31 Jan 2023
A Reinforcement Learning Framework for Dynamic Mediation Analysis Linjuan Ge Jitao Wang C. Shi Zhanghua Wu Rui Song 62 6 0 31 Jan 2023
Asymptotic Inference for Multi-Stage Stationary Treatment Policy with Variable Selection Daiqi Gao Yufeng Liu D. Zeng OffRL 57 0 0 29 Jan 2023
Model-based Offline Reinforcement Learning with Local Misspecification Kefan Dong Yannis Flet-Berliac Allen Nie Emma Brunskill OffRL 66 4 0 26 Jan 2023
Off-Policy Evaluation for Action-Dependent Non-Stationary Environments Yash Chandak Shiv Shankar Nathaniel D. Bastian Bruno Castro da Silva Emma Brunskil Philip S. Thomas OffRL 89 6 0 24 Jan 2023
Minimax Weight Learning for Absorbing MDPs Fengyin Li Yuqiang Li Xianyi Wu OffRL 17 1 0 09 Jan 2023
Value Enhancement of Reinforcement Learning via Efficient and Robust Trust Region Optimization C. Shi Zhengling Qi Jianing Wang Fan Zhou OffRL 51 6 0 05 Jan 2023
An Instrumental Variable Approach to Confounded Off-Policy Evaluation Yang Xu Jin Zhu C. Shi Shuang Luo R. Song OffRL 98 18 0 29 Dec 2022
Offline Policy Optimization in RL with Variance Regularizaton Riashat Islam Samarth Sinha Homanga Bharadhwaj Samin Yeasar Arnob Zhuoran Yang Animesh Garg Zhaoran Wang Lihong Li Doina Precup OffRL 58 0 0 29 Dec 2022
Policy learning "without" overlap: Pessimism and generalized empirical Bernstein's inequality Ying Jin Zhimei Ren Zhuoran Yang Zhaoran Wang OffRL 125 26 0 19 Dec 2022
Scaling Marginalized Importance Sampling to High-Dimensional State-Spaces via State Abstraction Brahma S. Pavse Josiah P. Hanna OffRL 62 7 0 14 Dec 2022
A Review of Off-Policy Evaluation in Reinforcement Learning Masatoshi Uehara C. Shi Nathan Kallus OffRL 99 76 0 13 Dec 2022
Low Variance Off-policy Evaluation with State-based Importance Sampling David M. Bossens Philip S. Thomas OffRL 51 2 0 07 Dec 2022
Causal Deep Reinforcement Learning Using Observational Data Wenxuan Zhu Chao Yu Qiaosheng Zhang CML OffRL 59 5 0 28 Nov 2022
When is Realizability Sufficient for Off-Policy Reinforcement Learning? Andrea Zanette OffRL 65 15 0 10 Nov 2022
Optimal Conservative Offline RL with General Function Approximation via Augmented Lagrangian Paria Rashidinejad Hanlin Zhu Kunhe Yang Stuart J. Russell Jiantao Jiao OffRL 178 31 0 01 Nov 2022
Beyond the Return: Off-policy Function Estimation under User-specified Error-measuring Distributions Audrey Huang Nan Jiang OffRL 116 9 0 27 Oct 2022
A Reinforcement Learning Approach to Estimating Long-term Treatment Effects Ziyang Tang Yiheng Duan Stephanie S. Zhang Lihong Li OffRL 56 5 0 14 Oct 2022
A Unified Framework for Alternating Offline Model Training and Policy Learning Shentao Yang Shujian Zhang Yihao Feng Mi Zhou OffRL 118 17 0 12 Oct 2022
Off-Policy Risk Assessment in Markov Decision Processes Audrey Huang Liu Leqi Zachary Chase Lipton Kamyar Azizzadenesheli OffRL 129 8 0 21 Sep 2022
On the Reuse Bias in Off-Policy Reinforcement Learning Chengyang Ying Zhongkai Hao Xinning Zhou Hang Su Dong Yan Jun Zhu OffRL 68 3 0 15 Sep 2022
Data-Driven Influence Functions for Optimization-Based Causal Inference Michael I. Jordan Yixin Wang Angela Zhou 69 3 0 29 Aug 2022
Future-Dependent Value-Based Off-Policy Evaluation in POMDPs Masatoshi Uehara Haruka Kiyohara Andrew Bennett Victor Chernozhukov Nan Jiang Nathan Kallus C. Shi Wen Sun OffRL 81 20 0 26 Jul 2022
Regularizing a Model-based Policy Stationary Distribution to Stabilize Offline Reinforcement Learning Shentao Yang Yihao Feng Shujian Zhang Mi Zhou OffRL 88 12 0 14 Jun 2022
Conformal Off-policy Prediction Yingying Zhang C. Shi Shuang Luo OffRL 79 11 0 14 Jun 2022
Adversarial Counterfactual Environment Model Learning Xiong-Hui Chen Yang Yu Zhenghong Zhu Zhihua Yu Zhen-Yu Chen ... Yinan Wu Hongqiu Wu Rongjun Qin Rui Ding Fangsheng Huang CML OffRL 91 12 0 10 Jun 2022
Markovian Interference in Experiments Vivek F. Farias Andrew A. Li Tianyi Peng Andrew Zheng OffRL 74 33 0 06 Jun 2022