A Lyapunov-based Approach to Safe Reinforcement Learning

20 May 2018

Yinlam Chow

Ofir Nachum

Edgar A. Duénez-Guzmán

Mohammad Ghavamzadeh

ArXiv PDF HTML

Papers citing "A Lyapunov-based Approach to Safe Reinforcement Learning"

50 / 286 papers shown

Title
Scalable Learning of Safety Guarantees for Autonomous Systems using Hamilton-Jacobi Reachability Sylvia Herbert Jason J. Choi Suvansh Qazi Marsalis T. Gibson Koushil Sreenath Claire Tomlin 16 37 0 15 Jan 2021
Context-Aware Safe Reinforcement Learning for Non-Stationary Environments Baiming Chen Zuxin Liu Jiacheng Zhu Mengdi Xu Wenhao Ding Ding Zhao 25 35 0 02 Jan 2021
C-Learning: Horizon-Aware Cumulative Accessibility Estimation Panteha Naderian Gabriel Loaiza-Ganem H. Braviner Anthony L. Caterini Jesse C. Cresswell Tong Li Animesh Garg 41 1 0 24 Nov 2020
Primal-dual Learning for the Model-free Risk-constrained Linear Quadratic Regulator Feiran Zhao Keyou You 29 20 0 22 Nov 2020
Inverse Constrained Reinforcement Learning Usman Anwar Shehryar Malik Alireza Aghasi Ali Ahmed 18 58 0 19 Nov 2020
Reinforcement Learning Control of Constrained Dynamic Systems with Uniformly Ultimate Boundedness Stability Guarantee Minghao Han Yuan Tian Lixian Zhang Jun Wang Wei Pan 16 46 0 13 Nov 2020
CRPO: A New Approach for Safe Reinforcement Learning with Convergence Guarantee Tengyu Xu Yingbin Liang Guanghui Lan 52 122 0 11 Nov 2020
Recovery RL: Safe Reinforcement Learning with Learned Recovery Zones Brijen Thananjeyan Ashwin Balakrishna Suraj Nair Michael Luo K. Srinivasan M. Hwang Joseph E. Gonzalez Julian Ibarz Chelsea Finn Ken Goldberg OffRL 16 221 0 29 Oct 2020
Learning to be Safe: Deep RL with a Safety Critic K. Srinivasan Benjamin Eysenbach Sehoon Ha Jie Tan Chelsea Finn OffRL 38 143 0 27 Oct 2020
Towards Safe Policy Improvement for Non-Stationary MDPs Yash Chandak Scott M. Jordan Georgios Theocharous Martha White Philip S. Thomas OffRL 71 33 0 23 Oct 2020
Reinforcement Learning with Combinatorial Actions: An Application to Vehicle Routing A. Delarue Ross Anderson Christian Tjandraatmadja 35 94 0 22 Oct 2020
Detecting Rewards Deterioration in Episodic Reinforcement Learning Ido Greenberg Shie Mannor OffRL 22 13 0 22 Oct 2020
Learning a Low-dimensional Representation of a Safe Region for Safe Reinforcement Learning on Dynamical Systems Zhehua Zhou Ozgur S. Oguz M. Leibold M. Buss 42 14 0 19 Oct 2020
Constrained Model-based Reinforcement Learning with Robust Cross-Entropy Method Zuxin Liu Hongyi Zhou Baiming Chen Sicheng Zhong M. Hebert Ding Zhao 14 11 0 15 Oct 2020
Balancing Constraints and Rewards with Meta-Gradient D4PG D. A. Calian D. Mankowitz Tom Zahavy Zhongwen Xu Junhyuk Oh Nir Levine Timothy A. Mann 39 25 0 13 Oct 2020
Variable impedance control and learning -- A review Fares J. Abu-Dakka Matteo Saveriano AI4CE 39 148 0 13 Oct 2020
Safe Reinforcement Learning with Natural Language Constraints Tsung-Yen Yang Michael Y. Hu Yinlam Chow Peter J. Ramadge Karthik Narasimhan 25 29 0 11 Oct 2020
Online Optimal Control with Affine Constraints Yingying Li Subhro Das Na Li 23 40 0 10 Oct 2020
Neural Identification for Control Priyabrata Saha M. Egerstedt Saibal Mukhopadhyay 8 4 0 24 Sep 2020
Lyapunov-Based Reinforcement Learning for Decentralized Multi-Agent Control Qingrui Zhang Hao Dong Wei Pan 29 6 0 20 Sep 2020
$Contraction $\mathcal{L}_1$-Adaptive Control using Gaussian Processes$ Contraction $\mathcal{L}_1$ -Adaptive Control using Gaussian Processes Aditya Gahlawat Arun Lakshmanan Lin Song Andrew Patterson Zhuohuan Wu N. Hovakimyan Evangelos Theodorou AI4CE 11 1 0 08 Sep 2020
On the model-based stochastic value gradient for continuous reinforcement learning Brandon Amos Samuel Stanton Denis Yarats A. Wilson 24 71 0 28 Aug 2020
Constrained Markov Decision Processes via Backward Value Functions Harsh Satija Philip Amortila Joelle Pineau 43 51 0 26 Aug 2020
Runtime-Safety-Guided Policy Repair Weichao Zhou Ruihan Gao Baekgyu Kim Eunsuk Kang Wenchao Li 12 13 0 17 Aug 2020
Safety design concepts for statistical machine learning components toward accordance with functional safety standards Akihisa Morikawa Yamato Matsubara 20 3 0 04 Aug 2020
Learning with Safety Constraints: Sample Complexity of Reinforcement Learning for Constrained MDPs Aria HasanzadeZonuzy Archana Bura D. Kalathil S. Shakkottai 32 38 0 01 Aug 2020
Lagrangian Duality in Reinforcement Learning Pranay Pasula OffRL 12 0 0 20 Jul 2020
Responsive Safety in Reinforcement Learning by PID Lagrangian Methods Adam Stooke Joshua Achiam Pieter Abbeel 31 287 0 08 Jul 2020
Safe Reinforcement Learning via Curriculum Induction M. Turchetta Andrey Kolobov S. Shah Andreas Krause Alekh Agarwal 23 91 0 22 Jun 2020
Accelerating Safe Reinforcement Learning with Constraint-mismatched Policies Tsung-Yen Yang Justinian P. Rosca Karthik Narasimhan Peter J. Ramadge 29 18 0 20 Jun 2020
FISAR: Forward Invariant Safe Reinforcement Learning with a Deep Neural Network-Based Optimize Chuangchuang Sun Dong-Ki Kim Jonathan P. How 27 7 0 19 Jun 2020
ShieldNN: A Provably Safe NN Filter for Unsafe NN Controllers James Ferlez Mahmoud M. Elnaggar Yasser Shoukry C. Fleming AAML 62 33 0 16 Jun 2020
Neural Certificates for Safe Control Policies Wanxin Jin Zhaoran Wang Zhuoran Yang Shaoshuai Mou 6 82 0 15 Jun 2020
Safety-guaranteed Reinforcement Learning based on Multi-class Support Vector Machine Kwangyeon Kim Akshita Gupta Hong Choi Inseok Hwang 16 0 0 12 Jun 2020
SAMBA: Safe Model-Based & Active Reinforcement Learning Alexander I. Cowen-Rivers Daniel Palenicek Vincent Moens Mohammed Abdullah Aivar Sootla Jun Wang Haitham Bou-Ammar 23 44 0 12 Jun 2020
Avoiding Side Effects in Complex Environments Alexander Matt Turner Neale Ratzlaff Prasad Tadepalli 30 34 0 11 Jun 2020
Model-Free Algorithm and Regret Analysis for MDPs with Long-Term Constraints Qinbo Bai Vaneet Aggarwal Ather Gattami 13 1 0 10 Jun 2020
Stable Reinforcement Learning with Unbounded State Space Devavrat Shah Qiaomin Xie Zhi Xu OffRL 8 13 0 08 Jun 2020
Deployment-Efficient Reinforcement Learning via Model-Based Offline Optimization T. Matsushima Hiroki Furuta Y. Matsuo Ofir Nachum S. Gu OffRL 25 147 0 05 Jun 2020
Novel Policy Seeking with Constrained Optimization Hao Sun Zhenghao Peng Bo Dai Jian Guo Dahua Lin Bolei Zhou 24 13 0 21 May 2020
A Distributional View on Multi-Objective Policy Optimization A. Abdolmaleki Sandy H. Huang Leonard Hasenclever Michael Neunert H. F. Song Martina Zambelli M. Martins N. Heess R. Hadsell Martin Riedmiller 26 74 0 15 May 2020
Synthesizing Safe Policies under Probabilistic Constraints with Reinforcement Learning and Bayesian Model Checking Lenz Belzner M. Wirsing 22 4 0 08 May 2020
Neural Lyapunov Control Ya-Chien Chang Nima Roohi Sicun Gao 15 301 0 01 May 2020
Actor-Critic Reinforcement Learning for Control with Stability Guarantee Minghao Han Lixian Zhang Jun Wang Wei Pan 16 106 0 29 Apr 2020
Stochastic Flows and Geometric Optimization on the Orthogonal Group K. Choromanski David Cheikhi Jared Davis Valerii Likhosherstov Achille Nazaret ... Yuan Gao Aldo Pacchiano Tamás Sarlós Adrian Weller Vikas Sindhwani AI4CE 25 7 0 30 Mar 2020
An empirical investigation of the challenges of real-world reinforcement learning Gabriel Dulac-Arnold Nir Levine D. Mankowitz Jerry Li Cosmin Paduraru Sven Gowal Todd Hester OffRL 34 121 0 24 Mar 2020
Exploration-Exploitation in Constrained MDPs Yonathan Efroni Shie Mannor Matteo Pirotta 33 171 0 04 Mar 2020
Provably Efficient Safe Exploration via Primal-Dual Policy Optimization Dongsheng Ding Xiaohan Wei Zhuoran Yang Zhaoran Wang M. Jovanović 27 159 0 01 Mar 2020
Cautious Reinforcement Learning via Distributional Risk in the Dual Domain Junyu Zhang Amrit Singh Bedi Mengdi Wang Alec Koppel 11 28 0 27 Feb 2020
Cautious Reinforcement Learning with Logical Constraints Mohammadhosein Hasanbeig Alessandro Abate Daniel Kroening 13 75 0 26 Feb 2020