A Policy Gradient Primal-Dual Algorithm for Constrained MDPs with
Uniform PAC Guarantees

v1v2v3 (latest)

A Policy Gradient Primal-Dual Algorithm for Constrained MDPs with Uniform PAC Guarantees

31 January 2024

Toshinori Kitamura

Soichiro Nishimori

Akiyoshi Sannai

ArXiv (abs)PDF HTML

Papers citing "A Policy Gradient Primal-Dual Algorithm for Constrained MDPs with Uniform PAC Guarantees"

18 / 18 papers shown

Title
Near-Optimal Policy Identification in Robust Constrained Markov Decision Processes via Epigraph Form Toshinori Kitamura Tadashi Kozuno Wataru Kumagai Kenta Hoshino Y. Hosoe Kazumi Kasaura Masashi Hamaya Paavo Parmas Yutaka Matsuo 113 2 0 29 Aug 2024
Last-Iterate Convergent Policy Gradient Primal-Dual Methods for Constrained MDPs Dongsheng Ding Chen-Yu Wei Kai Zhang Alejandro Ribeiro 96 22 0 20 Jun 2023
Nearly Minimax Optimal Reinforcement Learning for Linear Markov Decision Processes Jiafan He Heyang Zhao Dongruo Zhou Quanquan Gu OffRL 118 55 0 12 Dec 2022
Nearly Minimax Optimal Reinforcement Learning with Linear Function Approximation Pihe Hu Yu Chen Longbo Huang 64 35 0 23 Jun 2022
Near-Optimal Sample Complexity Bounds for Constrained MDPs Sharan Vaswani Lin F. Yang Csaba Szepesvári 78 36 0 13 Jun 2022
A Dual Approach to Constrained Markov Decision Processes with Entropy Regularization Donghao Ying Yuhao Ding Javad Lavaei 48 34 0 17 Oct 2021
Learning Policies with Zero or Bounded Constraint Violation for Constrained MDPs Tao-Wen Liu Ruida Zhou D. Kalathil P. R. Kumar Chao Tian 73 84 0 04 Jun 2021
Bilinear Classes: A Structural Framework for Provable Generalization in RL S. Du Sham Kakade Jason D. Lee Shachar Lovett G. Mahajan Wen Sun Ruosong Wang OffRL 180 191 0 19 Mar 2021
Impossible Tuning Made Possible: A New Expert Algorithm and Its Applications Liyu Chen Haipeng Luo Chen-Yu Wei 104 45 0 01 Feb 2021
Nearly Minimax Optimal Reinforcement Learning for Linear Mixture Markov Decision Processes Dongruo Zhou Quanquan Gu Csaba Szepesvári 76 209 0 15 Dec 2020
Robust Constrained-MDPs: Soft-Constrained Robust Policy Optimization under Model Uncertainty R. Russel M. Benosman J. Baar 66 22 0 10 Oct 2020
Learning with Safety Constraints: Sample Complexity of Reinforcement Learning for Constrained MDPs Aria HasanzadeZonuzy Archana Bura D. Kalathil S. Shakkottai 52 40 0 01 Aug 2020
Model-Based Reinforcement Learning with Value-Targeted Regression Alex Ayoub Zeyu Jia Csaba Szepesvári Mengdi Wang Lin F. Yang OffRL 96 305 0 01 Jun 2020
Provably Efficient Safe Exploration via Primal-Dual Policy Optimization Dongsheng Ding Xiaohan Wei Zhuoran Yang Zhaoran Wang M. Jovanović 87 165 0 01 Mar 2020
Constrained Reinforcement Learning Has Zero Duality Gap Santiago Paternain Luiz F. O. Chamon Miguel Calvo-Fullana Alejandro Ribeiro 59 193 0 29 Oct 2019
Reward Constrained Policy Optimization Chen Tessler D. Mankowitz Shie Mannor 86 544 0 28 May 2018
Constrained Policy Optimization Joshua Achiam David Held Aviv Tamar Pieter Abbeel 132 1,335 0 30 May 2017
Unifying PAC and Regret: Uniform PAC Bounds for Episodic Reinforcement Learning Christoph Dann Tor Lattimore Emma Brunskill 83 311 0 22 Mar 2017

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.