Control Synthesis from Linear Temporal Logic Specifications using Model-Free Reinforcement Learning

16 September 2019

Papers citing "Control Synthesis from Linear Temporal Logic Specifications using Model-Free Reinforcement Learning"

50 / 67 papers shown

Title
Learning Probabilistic Temporal Logic Specifications for Stochastic Systems Rajarshi Roy Yash Pote David Parker Marta Kwiatkowska 16 0 0 17 May 2025
Temporal Logic Specification-Conditioned Decision Transformer for Offline Safe Reinforcement Learning Zijian Guo Weichao Zhou Wenchao Li OffRL 105 2 0 28 Jan 2025
Adaptive Reward Design for Reinforcement Learning Minjae Kwon Ingy Elsayed-Aly Lu Feng 75 2 0 14 Dec 2024
Learning Hidden Subgoals under Temporal Ordering Constraints in Reinforcement Learning Duo Xu Faramarz Fekri OffRL 41 0 0 03 Nov 2024
Compositional Automata Embeddings for Goal-Conditioned Reinforcement Learning Beyazit Yalcinkaya Niklas Lauffer Marcell Vazquez-Chanlatte S. Seshia AI4CE 59 5 0 31 Oct 2024
Reinforcement Learning with LTL and $ω$ -Regular Objectives via Optimality-Preserving Translation to Average Rewards Xuan-Bach Le Dominik Wagner Leon Witzman Alexander Rabinovich Luke Ong 21 2 0 16 Oct 2024
Sample-Efficient Reinforcement Learning with Temporal Logic Objectives: Leveraging the Task Specification to Guide Exploration Y. Kantaros Jun Wang 42 5 0 16 Oct 2024
DeepLTL: Learning to Efficiently Satisfy Complex LTL Specifications for Multi-Task RL Mathias Jackermeier Alessandro Abate OffRL 51 1 0 06 Oct 2024
Directed Exploration in Reinforcement Learning from Linear Temporal Logic Marco Bagatella Andreas Krause Georg Martius OffRL 33 1 0 18 Aug 2024
Convergence Guarantee of Dynamic Programming for LTL Surrogate Reward Zetong Xuan Yu Wang 26 0 0 10 Aug 2024
LTL-Constrained Policy Optimization with Cycle Experience Replay Ameesh Shah Cameron Voloshin Chenxi Yang Abhinav Verma Swarat Chaudhuri S. Seshia 31 1 0 17 Apr 2024
On the Uniqueness of Solution for the Bellman Equation of LTL Objectives Zetong Xuan A. Bozkurt Miroslav Pajic Yu Wang 30 4 0 07 Apr 2024
Formal Synthesis of Controllers for Safety-Critical Autonomous Systems: Developments and Challenges Xiang Yin Bingzhao Gao Xiao Yu 41 18 0 20 Feb 2024
Logical Specifications-guided Dynamic Task Sampling for Reinforcement Learning Agents Yash Shukla Wenchang Gao Vasanth Sarathy Robert Wright Alvaro Velasquez Jivko Sinapov 23 0 0 06 Feb 2024
Sample Efficient Reinforcement Learning by Automatically Learning to Compose Subtasks Shuai Han Mehdi Dastani Shihan Wang OffRL 60 1 0 25 Jan 2024
Omega-Regular Decision Processes E. M. Hahn Mateo Perez S. Schewe Fabio Somenzi Ashutosh Trivedi D. Wojtczak 24 0 0 14 Dec 2023
Compositional Policy Learning in Stochastic Control Systems with Formal Guarantees Dorde Zikelic Mathias Lechner Abhinav Verma K. Chatterjee T. Henzinger 40 10 0 03 Dec 2023
Mission-driven Exploration for Accelerated Deep Reinforcement Learning with Temporal Logic Task Specifications Jun Wang Hosein Hasanbeig Kaiyuan Tan Zihe Sun Y. Kantaros 35 3 0 28 Nov 2023
Verified Compositional Neuro-Symbolic Control for Stochastic Systems with Temporal Logic Tasks Jun Wang Haojun Chen Zihe Sun Y. Kantaros 38 0 0 17 Nov 2023
A PAC Learning Algorithm for LTL and Omega-regular Objectives in MDPs Mateo Perez Fabio Somenzi Ashutosh Trivedi 24 6 0 18 Oct 2023
Using Experience Classification for Training Non-Markovian Tasks Ruixuan Miao Xu Lu Cong Tian Bin Yu Zhenhua Duan OffRL 28 0 0 18 Oct 2023
LgTS: Dynamic Task Sampling using LLM-generated sub-goals for Reinforcement Learning Agents Yash Shukla Wenchang Gao Vasanth Sarathy Alvaro Velasquez Robert Wright Jivko Sinapov 29 9 0 14 Oct 2023
Searching for Optimal Runtime Assurance via Reachability and Reinforcement Learning Kristina Miller Christopher K. Zeitler William Shen Kerianne L. Hobbs Sayan Mitra John Schierman Mahesh Viswanathan 22 0 0 06 Oct 2023
Omega-Regular Reward Machines E. M. Hahn Mateo Perez S. Schewe Fabio Somenzi Ashutosh Trivedi D. Wojtczak OffRL 19 2 0 14 Aug 2023
Policy Synthesis and Reinforcement Learning for Discounted LTL Rajeev Alur Osbert Bastani Kishor Jothimurugan Mateo Perez Fabio Somenzi Ashutosh Trivedi OffRL 22 11 0 26 May 2023
Optimal Control of Logically Constrained Partially Observable and Multi-Agent Markov Decision Processes K. C. Kalagarla D. Kartik Dongming Shen R. Jain A. Nayyar Pierluigi Nuzzo AI4CE 25 1 0 24 May 2023
Sample Efficient Model-free Reinforcement Learning from LTL Specifications with Optimality Guarantees Daqian Shao Marta Kwiatkowska OffRL 29 7 0 02 May 2023
Model-free Motion Planning of Autonomous Agents for Complex Tasks in Partially Observable Environments Junchao Li Mingyu Cai Z. Kan Shaoping Xiao 31 1 0 30 Apr 2023
Reinforcement Learning with Knowledge Representation and Reasoning: A Brief Survey Chao Yu Xuejing Zheng H. Zhuo OffRL LRM 55 7 0 24 Apr 2023
Model-based Dynamic Shielding for Safe and Efficient Multi-Agent Reinforcement Learning Wenli Xiao Yiwei Lyu John M. Dolan 22 7 0 13 Apr 2023
Reinforcement Learning for Omega-Regular Specifications on Continuous-Time MDP A. Falah Shibashis Guha Ashutosh Trivedi 14 0 0 16 Mar 2023
Eventual Discounting Temporal Logic Counterfactual Experience Replay Cameron Voloshin Abhinav Verma Yisong Yue OffRL 26 11 0 03 Mar 2023
Co-learning Planning and Control Policies Constrained by Differentiable Logic Specifications Zikang Xiong Daniel Lawson Joe Eappen A. H. Qureshi Suresh Jagannathan 13 0 0 02 Mar 2023
Hierarchical Motion Planning under Probabilistic Temporal Tasks and Safe-Return Constraints Meng Guo T. Liao Junjie Wang Zhongkui Li 43 6 0 10 Feb 2023
Reinforcement Causal Structure Learning on Order Graph Dezhi Yang Guoxian Yu Jun Wang Zhe Wu Maozu Guo BDL CML 37 16 0 22 Nov 2022
SAFER: Safe Collision Avoidance using Focused and Efficient Trajectory Search with Reinforcement Learning Mario Srouji Hugues Thomas Yao-Hung Tsai Ali Farhadi Jian Zhang 48 5 0 23 Sep 2022
LCRL: Certified Policy Synthesis via Logically-Constrained Reinforcement Learning Mohammadhosein Hasanbeig Daniel Kroening Alessandro Abate 34 15 0 21 Sep 2022
Verified Compositions of Neural Network Controllers for Temporal Logic Control Objectives Jun Wang Samarth Kalluraya Y. Kantaros 29 8 0 13 Sep 2022
Logic-based Reward Shaping for Multi-Agent Reinforcement Learning Ingy Elsayed-Aly Lu Feng 15 1 0 17 Jun 2022
Synthesis from Satisficing and Temporal Goals Suguman Bansal Lydia E. Kavraki Moshe Y. Vardi Andrew M. Wells 28 3 0 20 May 2022
Accelerated Reinforcement Learning for Temporal Logic Control Objectives Y. Kantaros 18 11 0 09 May 2022
Joint Learning of Reward Machines and Policies in Environments with Partially Known Semantics Christos K. Verginis Cevahir Köprülü Sandeep Chinchali Ufuk Topcu 33 10 0 20 Apr 2022
Temporal Logic Guided Motion Primitives for Complex Manipulation Tasks with User Preferences Hao Wang Haoyuan He Weiwei Shang Z. Kan 14 4 0 09 Feb 2022
Learning Spatio-Temporal Specifications for Dynamical Systems Suhail Alsalehi Erfan Aasi Ron Weiss C. Belta 39 2 0 20 Dec 2021
On the (In)Tractability of Reinforcement Learning for LTL Objectives Cambridge Yang Michael Littman Michael Carbin 16 18 0 24 Nov 2021
Lifelong Reinforcement Learning with Temporal Logic Formulas and Reward Machines Xuejing Zheng Chao Yu Chong Chen Jianye Hao H. Zhuo CLL OffRL 25 9 0 18 Nov 2021
Safety-Critical Learning of Robot Control with Temporal Logic Specifications Mingyu Cai C. Vasile 35 4 0 07 Sep 2021
Mungojerrie: Reinforcement Learning of Linear-Time Objectives E. M. Hahn Mateo Perez S. Schewe Fabio Somenzi Ashutosh Trivedi D. Wojtczak 25 10 0 16 Jun 2021
Safe RAN control: A Symbolic Reinforcement Learning Approach Alexandros Nikou A. Mujumdar Vaishnavi Sundararajan Marin Orlic Aneta Vulgarakis Feljan 31 3 0 03 Jun 2021
Reinforcement Learning with Temporal Logic Constraints for Partially-Observable Markov Decision Processes Yu Wang A. Bozkurt Miroslav Pajic AI4CE 27 3 0 04 Apr 2021