Online Robust Reinforcement Learning with Model Uncertainty

29 September 2021

Papers citing "Online Robust Reinforcement Learning with Model Uncertainty"

50 / 61 papers shown

Title
Qualitative Analysis of $ω$ -Regular Objectives on Robust MDPs Ali Asadi Krishnendu Chatterjee Ehsan Kafshdar Goharshady Mehrdad Karrabi Ali Shafiee 39 0 0 07 May 2025
Moderate Actor-Critic Methods: Controlling Overestimation Bias via Expectile Loss Ukjo Hwang Songnam Hong OffRL 36 0 0 14 Apr 2025
Uncertainty in Action: Confidence Elicitation in Embodied Agents Tianjiao Yu Vedant Shah Muntasir Wahed Kiet A. Nguyen Adheesh Sunil Juvekar Tal August Ismini Lourentzou 40 0 0 13 Mar 2025
Guaranteeing Out-Of-Distribution Detection in Deep RL via Transition Estimation Mohit Prashant Arvind Easwaran Suman Das Michael Yuhas OffRL 59 1 0 07 Mar 2025
Dual Formulation for Non-Rectangular Lp Robust Markov Decision Processes Navdeep Kumar Adarsh Gupta Maxence Mohamed Elfatihi Giorgia Ramponi Kfir Y. Levy Shie Mannor 55 0 0 13 Feb 2025
Session-Level Dynamic Ad Load Optimization using Offline Robust Reinforcement Learning Tao Liu Qi Xu Wei Shi Zhigang Hua Shuang Yang OffRL 38 0 0 09 Jan 2025
Microservice Deployment in Space Computing Power Networks via Robust Reinforcement Learning Zhiyong Yu Yuning Jiang Xin Liu Yuanming Shi Chunxiao Jiang Linling Kuang 36 0 0 08 Jan 2025
Coverage Analysis of Multi-Environment Q-Learning Algorithms for Wireless Network Optimization Talha Bozkus Urbashi Mitra 33 2 0 29 Aug 2024
Near-Optimal Policy Identification in Robust Constrained Markov Decision Processes via Epigraph Form Toshinori Kitamura Tadashi Kozuno Wataru Kumagai Kenta Hoshino Y. Hosoe Kazumi Kasaura Masashi Hamaya Paavo Parmas Yutaka Matsuo 70 0 0 29 Aug 2024
Model-Free Robust Reinforcement Learning with Sample Complexity Analysis Yudan Wang Shaofeng Zou Yue Wang OOD 25 1 0 24 Jun 2024
Distributionally Robust Constrained Reinforcement Learning under Strong Duality Zhengfei Zhang Kishan Panaganti Laixi Shi Yanan Sui Adam Wierman Yisong Yue OOD 37 3 0 22 Jun 2024
Robust Model-Based Reinforcement Learning with an Adversarial Auxiliary Model Siemen Herremans Ali Anwar Siegfried Mercelis 40 2 0 14 Jun 2024
Roping in Uncertainty: Robustness and Regularization in Markov Games Jeremy McMahan Giovanni Artiglio Qiaomin Xie 37 2 0 13 Jun 2024
vMFER: Von Mises-Fisher Experience Resampling Based on Uncertainty of Gradient Directions for Policy Improvement Yiwen Zhu Jinyi Liu Wenya Wei Qianyi Fu Yujing Hu Zhou Fang Bo An Jianye Hao Tangjie Lv Changjie Fan 26 3 0 14 May 2024
Robust Risk-Sensitive Reinforcement Learning with Conditional Value-at-Risk Xinyi Ni Lifeng Lai 36 0 0 02 May 2024
Constrained Reinforcement Learning Under Model Mismatch Zhongchang Sun Sihong He Fei Miao Shaofeng Zou 40 4 0 02 May 2024
Distributionally Robust Reinforcement Learning with Interactive Data Collection: Fundamental Hardness and Near-Optimal Algorithm Miao Lu Han Zhong Tong Zhang Jose H. Blanchet OffRL OOD 71 4 0 04 Apr 2024
Efficient and Sharp Off-Policy Evaluation in Robust Markov Decision Processes Andrew Bennett Nathan Kallus M. Oprescu Wen Sun Kaiwen Wang AAML OffRL 42 1 0 29 Mar 2024
Sample Complexity of Offline Distributionally Robust Linear Markov Decision Processes He Wang Laixi Shi Yuejie Chi OffRL 34 6 0 19 Mar 2024
Towards Robust Model-Based Reinforcement Learning Against Adversarial Corruption Chen Ye Jiafan He Quanquan Gu Tong Zhang 35 5 0 14 Feb 2024
Solving Long-run Average Reward Robust MDPs via Stochastic Games Krishnendu Chatterjee Ehsan Kafshdar Goharshady Mehrdad Karrabi Petr Novotný Dorde Zikelic 18 4 0 21 Dec 2023
MICRO: Model-Based Offline Reinforcement Learning with a Conservative Bellman Operator Xiao-Yin Liu Xiao-Hu Zhou Guo-Tao Li Hao Li Mei-Jiang Gui Tian-Yu Xiang De-Xing Huang Zeng-Guang Hou OffRL 34 4 0 07 Dec 2023
Bridging Distributionally Robust Learning and Offline RL: An Approach to Mitigate Distribution Shift and Partial Data Coverage Kishan Panaganti Zaiyan Xu D. Kalathil Mohammad Ghavamzadeh OOD OffRL 31 6 0 27 Oct 2023
Adjustable Robust Reinforcement Learning for Online 3D Bin Packing Yuxin Pan Yize Chen Fangzhen Lin OffRL 35 9 0 06 Oct 2023
Distributionally Robust Model-based Reinforcement Learning with Large State Spaces Shyam Sundhar Ramesh Pier Giuseppe Sessa Yifan Hu Andreas Krause Ilija Bogunovic OOD 36 10 0 05 Sep 2023
Robust Multi-Agent Reinforcement Learning with State Uncertainty Sihong He Songyang Han Sanbao Su Shuo Han Shaofeng Zou Fei Miao OOD 26 42 0 30 Jul 2023
Natural Actor-Critic for Robust Reinforcement Learning with Function Approximation Ruida Zhou Tao-Wen Liu Min Cheng D. Kalathil P. R. Kumar Chao Tian 35 19 0 17 Jul 2023
Seeing is not Believing: Robust Reinforcement Learning against Spurious Correlation Wenhao Ding Laixi Shi Yuejie Chi Ding Zhao OOD 27 18 0 15 Jul 2023
Efficient Action Robust Reinforcement Learning with Probabilistic Policy Execution Uncertainty Guanin Liu Zhihan Zhou Han Liu Lifeng Lai 28 1 0 15 Jul 2023
Soft Robust MDPs and Risk-Sensitive MDPs: Equivalence, Policy Gradient, and Sample Complexity Runyu Zhang Yang Hu Na Li 33 5 0 20 Jun 2023
Theoretical Hardness and Tractability of POMDPs in RL with Partial Online State Information Ming Shi Yingbin Liang Ness B. Shroff 29 2 0 14 Jun 2023
Bring Your Own (Non-Robust) Algorithm to Solve Robust MDPs by Estimating The Worst Kernel Kaixin Wang Uri Gadot Navdeep Kumar Kfir Y. Levy Shie Mannor 31 2 0 09 Jun 2023
Calibrating Multimodal Learning Huanrong Zhang Changqing Zhang Bing Wu H. Fu Joey Tianyi Zhou Q. Hu 54 16 0 02 Jun 2023
Solving Robust MDPs through No-Regret Dynamics E. Guha 20 0 0 30 May 2023
The Curious Price of Distributional Robustness in Reinforcement Learning with a Generative Model Laixi Shi Gen Li Yuting Wei Yuxin Chen M. Geist Yuejie Chi OOD 25 30 0 26 May 2023
Model-Free Robust Average-Reward Reinforcement Learning Yue Wang Alvaro Velasquez George K. Atia Ashley Prater-Bennette Shaofeng Zou 26 9 0 17 May 2023
Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challenges Ziyuan Zhou Guanjun Liu Ying-Si Tang 33 14 0 17 May 2023
Double Pessimism is Provably Efficient for Distributionally Robust Offline Reinforcement Learning: Generic Algorithm and Robust Partial Coverage Jose H. Blanchet Miao Lu Tong Zhang Han Zhong OffRL 37 29 0 16 May 2023
On Practical Robust Reinforcement Learning: Practical Uncertainty Set and Double-Agent Algorithm Ukjo Hwang Songnam Hong 17 0 0 11 May 2023
Improved Sample Complexity Bounds for Distributionally Robust Reinforcement Learning Zaiyan Xu Kishan Panaganti D. Kalathil OOD OffRL 26 30 0 05 Mar 2023
An Efficient Solution to s-Rectangular Robust Markov Decision Processes Navdeep Kumar Kfir Y. Levy Kaixin Wang Shie Mannor 23 1 0 31 Jan 2023
Single-Trajectory Distributionally Robust Reinforcement Learning Zhipeng Liang Xiaoteng Ma Jose H. Blanchet Jiheng Zhang Zhengyuan Zhou OOD OffRL 26 10 0 27 Jan 2023
Risk-Averse MDPs under Reward Ambiguity Haolin Ruan Zhi Chen C. Ho 25 2 0 03 Jan 2023
Robust Average-Reward Markov Decision Processes Yue Wang Alvaro Velasquez George K. Atia Ashley Prater-Bennette Shaofeng Zou 31 11 0 02 Jan 2023
Policy Gradient in Robust MDPs with Global Convergence Guarantee Qiuhao Wang C. Ho Marek Petrik 19 24 0 20 Dec 2022
Smoothing Policy Iteration for Zero-sum Markov Games Yangang Ren Yao Lyu Wenxuan Wang Sheng Li Zeyang Li Jingliang Duan 23 1 0 03 Dec 2022
Online Policy Optimization for Robust MDP Jing Dong Jingwei Li Baoxiang Wang J. Zhang OffRL 26 12 0 28 Sep 2022
Quantification before Selection: Active Dynamics Preference for Robust Reinforcement Learning Kang Xu Yan Ma Wei Li 32 0 0 23 Sep 2022
First-order Policy Optimization for Robust Markov Decision Process Yan Li Guanghui Lan Tuo Zhao 75 23 0 21 Sep 2022
Robust Constrained Reinforcement Learning Yue Wang Fei Miao Shaofeng Zou 29 12 0 14 Sep 2022