Distributionally Robust Model-Based Offline Reinforcement Learning with Near-Optimal Sample Complexity

11 August 2022

Papers citing "Distributionally Robust Model-Based Offline Reinforcement Learning with Near-Optimal Sample Complexity"

49 / 49 papers shown

Title
Policy-Driven World Model Adaptation for Robust Offline Model-based Reinforcement Learning Jiayu Chen Aravind Venugopal Jeff Schneider OffRL 2 0 0 19 May 2025
A Finite-Sample Analysis of Distributionally Robust Average-Reward Reinforcement Learning Zachary Roch Chi Zhang George Atia Yue Wang 7 0 0 18 May 2025
Trajectory Entropy Reinforcement Learning for Predictable and Robust Control Bang You Chenxu Wang Huaping Liu 26 0 0 07 May 2025
DR-PETS: Learning-Based Control With Planning in Adversarial Environments Hozefa Jesawada Antonio Acernese G. Russo C. D. Vecchio 69 0 0 26 Mar 2025
State-Aware Perturbation Optimization for Robust Deep Reinforcement Learning Zongyuan Zhang Tianyang Duan Zheng Lin Dong Huang Zihan Fang Zekai Sun Ling Xiong Hongbin Liang Heming Cui Yong Cui AAML 90 1 0 26 Mar 2025
Robust Deep Reinforcement Learning in Robotics via Adaptive Gradient-Masked Adversarial Attacks Zongyuan Zhang Tianyang Duan Zheng Lin Dong Huang Zihan Fang ... Ling Xiong Hongbin Liang Heming Cui Yong Cui Yue Gao AAML 55 2 0 26 Mar 2025
Towards Optimal Offline Reinforcement Learning Mengmeng Li Daniel Kuhn Tobias Sutter OffRL 60 0 0 15 Mar 2025
Near-Optimal Sample Complexity for Iterated CVaR Reinforcement Learning with a Generative Model Zilong Deng Simon Khan Shaofeng Zou 59 0 0 11 Mar 2025
Upper and Lower Bounds for Distributionally Robust Off-Dynamics Reinforcement Learning Zhishuai Liu Weixin Wang Pan Xu 33 1 0 30 Sep 2024
Constrained Behavior Cloning for Robotic Learning Wensheng Liang Jun Xie Zhicheng Wang Jianwei Tan Xiaoguang Ma AI4CE 36 1 0 20 Aug 2024
BECAUSE: Bilinear Causal Representation for Generalizable Offline Model-based Reinforcement Learning Hao-ming Lin Wenhao Ding Jian Chen Laixi Shi Jiacheng Zhu Bo-wen Li Ding Zhao OffRL CML 54 0 0 15 Jul 2024
Model-Free Robust Reinforcement Learning with Sample Complexity Analysis Yudan Wang Shaofeng Zou Yue Wang OOD 25 2 0 24 Jun 2024
Distributionally Robust Constrained Reinforcement Learning under Strong Duality Zhengfei Zhang Kishan Panaganti Laixi Shi Yanan Sui Adam Wierman Yisong Yue OOD 39 3 0 22 Jun 2024
Tractable Equilibrium Computation in Markov Games through Risk Aversion Eric Mazumdar Kishan Panaganti Laixi Shi 39 1 0 20 Jun 2024
Statistical Learning of Distributionally Robust Stochastic Control in Continuous State Spaces Shengbo Wang Nian Si Jose H. Blanchet Zhengyuan Zhou 24 0 0 17 Jun 2024
Roping in Uncertainty: Robustness and Regularization in Markov Games Jeremy McMahan Giovanni Artiglio Qiaomin Xie 45 2 0 13 Jun 2024
Bootstrapping Expectiles in Reinforcement Learning Pierre Clavier Emmanuel Rachelson E. L. Pennec Matthieu Geist OffRL 46 0 0 06 Jun 2024
Provably Mitigating Overoptimization in RLHF: Your SFT Loss is Implicitly an Adversarial Regularizer Zhihan Liu Miao Lu Shenao Zhang Boyi Liu Hongyi Guo Yingxiang Yang Jose H. Blanchet Zhaoran Wang 48 43 0 26 May 2024
Constrained Reinforcement Learning Under Model Mismatch Zhongchang Sun Sihong He Fei Miao Shaofeng Zou 46 4 0 02 May 2024
Distributionally Robust Reinforcement Learning with Interactive Data Collection: Fundamental Hardness and Near-Optimal Algorithm Miao Lu Han Zhong Tong Zhang Jose H. Blanchet OffRL OOD 79 6 0 04 Apr 2024
Sample Complexity of Offline Distributionally Robust Linear Markov Decision Processes He Wang Laixi Shi Yuejie Chi OffRL 36 7 0 19 Mar 2024
Distributionally Robust Off-Dynamics Reinforcement Learning: Provable Efficiency with Linear Function Approximation Zhishuai Liu Pan Xu OOD OffRL 42 8 0 23 Feb 2024
Federated Offline Reinforcement Learning: Collaborative Single-Policy Coverage Suffices Jiin Woo Laixi Shi Gauri Joshi Yuejie Chi OffRL 34 3 0 08 Feb 2024
On the Foundation of Distributionally Robust Reinforcement Learning Shengbo Wang Nian Si Jose H. Blanchet Zhengyuan Zhou OffRL 29 18 0 15 Nov 2023
Bridging Distributionally Robust Learning and Offline RL: An Approach to Mitigate Distribution Shift and Partial Data Coverage Kishan Panaganti Zaiyan Xu D. Kalathil Mohammad Ghavamzadeh OOD OffRL 34 6 0 27 Oct 2023
Towards Robust Offline Reinforcement Learning under Diverse Data Corruption Rui Yang Han Zhong Jiawei Xu Amy Zhang Chong Zhang Lei Han Tong Zhang OffRL OnRL 41 15 0 19 Oct 2023
Distributionally Safe Reinforcement Learning under Model Uncertainty: A Single-Level Approach by Differentiable Convex Programming A. Chriat Chuangchuang Sun 30 1 0 03 Oct 2023
Distributionally Robust Model-based Reinforcement Learning with Large State Spaces Shyam Sundhar Ramesh Pier Giuseppe Sessa Yifan Hu Andreas Krause Ilija Bogunovic OOD 42 10 0 05 Sep 2023
Natural Actor-Critic for Robust Reinforcement Learning with Function Approximation Ruida Zhou Tao-Wen Liu Min Cheng D. Kalathil P. R. Kumar Chao Tian 43 19 0 17 Jul 2023
Seeing is not Believing: Robust Reinforcement Learning against Spurious Correlation Wenhao Ding Laixi Shi Yuejie Chi Ding Zhao OOD 32 18 0 15 Jul 2023
Efficient Action Robust Reinforcement Learning with Probabilistic Policy Execution Uncertainty Guanin Liu Zhihan Zhou Han Liu Lifeng Lai 36 1 0 15 Jul 2023
Soft Robust MDPs and Risk-Sensitive MDPs: Equivalence, Policy Gradient, and Sample Complexity Runyu Zhang Yang Hu Na Li 41 5 0 20 Jun 2023
Provably Efficient Offline Reinforcement Learning with Perturbed Data Sources Chengshuai Shi Wei Xiong Cong Shen Jing Yang OffRL 30 3 0 14 Jun 2023
Bring Your Own (Non-Robust) Algorithm to Solve Robust MDPs by Estimating The Worst Kernel Kaixin Wang Uri Gadot Navdeep Kumar Kfir Y. Levy Shie Mannor 34 3 0 09 Jun 2023
Survival Instinct in Offline Reinforcement Learning Anqi Li Dipendra Kumar Misra Andrey Kolobov Ching-An Cheng OffRL 32 16 0 05 Jun 2023
Sample Complexity of Variance-reduced Distributionally Robust Q-learning Shengbo Wang Nian Si Jose H. Blanchet Zhengyuan Zhou OOD 26 13 0 28 May 2023
The Curious Price of Distributional Robustness in Reinforcement Learning with a Generative Model Laixi Shi Gen Li Yuting Wei Yuxin Chen M. Geist Yuejie Chi OOD 42 32 0 26 May 2023
Reward-agnostic Fine-tuning: Provable Statistical Benefits of Hybrid Reinforcement Learning Gen Li Wenhao Zhan Jason D. Lee Yuejie Chi Yuxin Chen OffRL OnRL 73 13 0 17 May 2023
Double Pessimism is Provably Efficient for Distributionally Robust Offline Reinforcement Learning: Generic Algorithm and Robust Partial Coverage Jose H. Blanchet Miao Lu Tong Zhang Han Zhong OffRL 45 30 0 16 May 2023
Improved Sample Complexity Bounds for Distributionally Robust Reinforcement Learning Zaiyan Xu Kishan Panaganti D. Kalathil OOD OffRL 29 31 0 05 Mar 2023
A Finite Sample Complexity Bound for Distributionally Robust Q-learning Shengbo Wang Nian Si Jose H. Blanchet Zhengyuan Zhou OOD OffRL 40 24 0 26 Feb 2023
Towards Minimax Optimality of Model-based Robust Reinforcement Learning Pierre Clavier E. L. Pennec M. Geist 38 12 0 10 Feb 2023
Robust Markov Decision Processes without Model Estimation Wenhao Yang Hanfengzhai Wang Tadashi Kozuno S. Jordan Zhihua Zhang 24 2 0 02 Feb 2023
Importance Weighted Actor-Critic for Optimal Conservative Offline Reinforcement Learning Hanlin Zhu Paria Rashidinejad Jiantao Jiao OffRL 38 15 0 30 Jan 2023
Single-Trajectory Distributionally Robust Reinforcement Learning Zhipeng Liang Xiaoteng Ma Jose H. Blanchet Jiheng Zhang Zhengyuan Zhou OOD OffRL 37 11 0 27 Jan 2023
Optimal Conservative Offline RL with General Function Approximation via Augmented Lagrangian Paria Rashidinejad Hanlin Zhu Kunhe Yang Stuart J. Russell Jiantao Jiao OffRL 45 26 0 01 Nov 2022
Distributionally Robust Offline Reinforcement Learning with Linear Function Approximation Xiaoteng Ma Zhipeng Liang Jose H. Blanchet MingWen Liu Li Xia Jiheng Zhang Qianchuan Zhao Zhengyuan Zhou OOD OffRL 41 22 0 14 Sep 2022
Online Robust Reinforcement Learning with Model Uncertainty Yue Wang Shaofeng Zou OOD OffRL 76 97 0 29 Sep 2021
Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems Sergey Levine Aviral Kumar George Tucker Justin Fu OffRL GP 340 1,963 0 04 May 2020