A Survey of Algorithms for Black-Box Safety Validation of Cyber-Physical Systems

6 May 2020

Mykel J. Kochenderfer

ArXiv PDF HTML

Papers citing "A Survey of Algorithms for Black-Box Safety Validation of Cyber-Physical Systems"

50 / 73 papers shown

Title
Scalable Importance Sampling in High Dimensions with Low-Rank Mixture Proposals Liam A. Kruse Marc R. Schlichting Mykel J. Kochenderfer 9 0 0 19 May 2025
Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictions Albert Zhao Stefano Soatto DiffM 48 0 0 18 May 2025
Rare event modeling with self-regularized normalizing flows: what can we learn from a single failure? Charles Dawson Van Tran Max Z. Li Chuchu Fan 47 0 0 28 Feb 2025
Rate-Informed Discovery via Bayesian Adaptive Multifidelity Sampling Aman Sinha Payam Nikdel Supratik Paul Shimon Whiteson 81 0 0 26 Nov 2024
LLM-Assisted Red Teaming of Diffusion Models through "Failures Are Fated, But Can Be Faded" Som Sagar Aditya Taparia Ransalu Senanayake 20 0 0 22 Oct 2024
Learning test generators for cyber-physical systems J. Peltomäki Ivan Porres 26 0 0 04 Oct 2024
Realistic Extreme Behavior Generation for Improved AV Testing Robert Dyro Matthew Foutter Ruolin Li L. D. Lillo Edward Schmerling Xilin Zhou Marco Pavone AAML 43 1 0 16 Sep 2024
Formal Verification and Control with Conformal Prediction Lars Lindemann Yiqi Zhao Xinyi Yu George J. Pappas Jyotirmoy Deshmukh 80 15 0 31 Aug 2024
Tolerance of Reinforcement Learning Controllers against Deviations in Cyber Physical Systems Changjian Zhang Parv Kapoor Eunsuk Kang Romulo Meira-Goes David Garlan Akila Ganlath Shatadal Mishra N. Ammar 49 0 0 24 Jun 2024
Diffusion-Based Failure Sampling for Evaluating Safety-Critical Autonomous Systems Harrison Delecki Marc R. Schlichting Mansur Arief Anthony Corso Marcell Vazquez-Chanlatte Mykel J. Kochenderfer DiffM 47 0 0 20 Jun 2024
Failures Are Fated, But Can Be Faded: Characterizing and Mitigating Unwanted Behaviors in Large-Scale Vision and Language Models Som Sagar Aditya Taparia Ransalu Senanayake 50 10 0 11 Jun 2024
How Generalizable Is My Behavior Cloning Policy? A Statistical Approach to Trustworthy Performance Evaluation Joseph A. Vincent Haruki Nishimura Masha Itkina Paarth Shah Mac Schwager Thomas Kollar OffRL 44 9 0 08 May 2024
Flow-Based Synthesis of Reactive Tests for Discrete Decision-Making Systems with Temporal Logic Specifications Josefine B. Graebener Apurva Badithela Denizalp Goktas Wyatt Ubellacker Eric V. Mazumdar Aaron D. Ames Richard M. Murray 40 2 0 15 Apr 2024
RADIUM: Predicting and Repairing End-to-End Robot Failures using Gradient-Accelerated Sampling Charles Dawson Anjali Parashar Chuchu Fan 53 0 0 04 Apr 2024
Adaptive Splitting of Reusable Temporal Monitors for Rare Traffic Violations Craig Innes S. Ramamoorthy 48 0 0 13 Mar 2024
Constraint-Generation Policy Optimization (CGPO): Nonlinear Programming for Policy Optimization in Mixed Discrete-Continuous MDPs Michael Gimelfarb Ayal Taitler Scott Sanner 33 0 0 20 Jan 2024
STEAM & MoSAFE: SOTIF Error-and-Failure Model & Analysis for AI-Enabled Driving Automation Krzysztof Czarnecki Hiroshi Kuwajima 36 0 0 15 Dec 2023
Attacking Motion Planners Using Adversarial Perception Errors Jonathan Sadeghi Nicholas A. Lord John Redford Romain Mueller AAML 42 2 0 21 Nov 2023
Reinforcement Learning for Safety Testing: Lessons from A Mobile Robot Case Study Tom P. Huck Martin Kaiser Constantin Cronrath Bengt Lennartson Torsten Kröger Tamim Asfour 11 1 0 06 Nov 2023
Requirement falsification for cyber-physical systems using generative models J. Peltomäki Ivan Porres 34 6 0 31 Oct 2023
Evolution of Natural Language Processing Technology: Not Just Language Processing Towards General Purpose AI Masahiro Yamamoto 19 1 0 10 Oct 2023
Formal and Practical Elements for the Certification of Machine Learning Systems Jean-Guillaume Durand Arthur Dubois Robert J. Moss 32 4 0 05 Oct 2023
SAVME: Efficient Safety Validation for Autonomous Systems Using Meta-Learning Marc R. Schlichting Nina V. Board Anthony Corso Mykel J. Kochenderfer 17 0 0 21 Sep 2023
A Bayesian approach to breaking things: efficiently predicting and repairing failure modes via sampling Charles Dawson Chuchu Fan 13 0 0 14 Sep 2023
Distributionally Robust Statistical Verification with Imprecise Neural Networks Souradeep Dutta Michele Caprio Vivian Lin Matthew Cleaveland Kuk Jin Jang I. Ruchkin O. Sokolsky Insup Lee OOD AAML 54 8 0 28 Aug 2023
Reflections from the Workshop on AI-Assisted Decision Making for Conservation Lily Xu Esther Rolf Sara Beery J. Bennett T. Berger-Wolf ... P. Moorcroft Jonathan Palmer Andrew Perrault D. Thau Milind Tambe 55 3 0 17 Jul 2023
The Waymo Open Sim Agents Challenge Nico Montali John Lambert Paul Mougin Alex Kuefler Nick Rhinehart ... Tristan Emrich Zoey Yang Shimon Whiteson Brandyn White Drago Anguelov LLMAG 48 46 0 19 May 2023
Model-based Validation as Probabilistic Inference Harrison Delecki Anthony Corso Mykel J. Kochenderfer 26 8 0 17 May 2023
Bayesian Safety Validation for Failure Probability Estimation of Black-Box Systems Robert J. Moss Mykel J. Kochenderfer Maxime Gariel Arthur Dubois 29 3 0 03 May 2023
Ensuring Reliable Robot Task Performance through Probabilistic Rare-Event Verification and Synthesis Guy Scher Sadra Sadraddini Ariel Yadin H. Kress-Gazit 35 1 0 28 Apr 2023
Vectorized Scenario Description and Motion Prediction for Scenario-Based Testing Max Winkelmann Constantin Vasconi Steffen Müller 41 2 0 02 Feb 2023
Falsification of Learning-Based Controllers through Multi-Fidelity Bayesian Optimization Zahra Shahrooei Mykel J. Kochenderfer Ali Baheri 48 6 0 28 Dec 2022
Safe Reinforcement Learning with Probabilistic Guarantees Satisfying Temporal Logic Specifications in Continuous Action Spaces Hanna Krasowski Prithvi Akella Aaron D. Ames Matthias Althoff 36 2 0 12 Dec 2022
A Deep Reinforcement Learning Approach to Rare Event Estimation Anthony Corso Kyu-Young Kim Shubh Gupta Grace Gao Mykel J. Kochenderfer 17 0 0 22 Nov 2022
Synthesizing Reactive Test Environments for Autonomous Systems: Testing Reach-Avoid Specifications with Multi-Commodity Flows Apurva Badithela Josefine B. Graebener Wyatt Ubellacker Eric V. Mazumdar Aaron D. Ames R. Murray 32 3 0 19 Oct 2022
Hazard Analysis of Collaborative Automation Systems: A Two-layer Approach based on Supervisory Control and Simulation Tom P. Huck Yuvaraj Selvaraj Constantin Cronrath C. Ledermann Martin Fabian Bengt Lennartson Torsten Kröger 14 1 0 26 Sep 2022
On the Adversarial Scenario-based Safety Testing of Robots: the Comparability and Optimal Aggressiveness Bowen Weng Guillermo A. Castillo Wei Zhang Ayonga Hereid AAML 30 8 0 20 Sep 2022
Fairness and Bias in Robot Learning Laura Londoño Juana Valeria Hurtado Nora Hertz P. Kellmeyer S. Voeneky Abhinav Valada FaML 23 9 0 07 Jul 2022
Formalizing and Evaluating Requirements of Perception Systems for Automated Vehicles using Spatio-Temporal Perception Logic Mohammad Hekmatnejad Bardh Hoxha Jyotirmoy V. Deshmukh Yezhou Yang Georgios Fainekos 33 6 0 29 Jun 2022
A Real-time Critical-scenario-generation Framework for Testing Autonomous Driving System Yi Xie Kunpeng Dai Yong Zhang 11 2 0 02 Jun 2022
Evaluating Automated Driving Planner Robustness against Adversarial Influence Andres Molina-Markham Silvia G. Ionescu Erin Lanus Derek Ng Sam Sommerer J. Rushanan AAML 34 0 0 29 May 2022
Wasserstein Generative Adversarial Networks for Online Test Generation for Cyber Physical Systems J. Peltomäki Frankie Spencer Ivan Porres GAN 34 8 0 23 May 2022
Falsification of Multiple Requirements for Cyber-Physical Systems Using Online Generative Adversarial Networks and Multi-Armed Bandits J. Peltomäki Ivan Porres AAML 23 7 0 23 May 2022
Sample-Based Bounds for Coherent Risk Measures: Applications to Policy Synthesis and Verification Prithvi Akella Anushri Dixit M. Ahmadi J. W. Burdick Aaron D. Ames 40 21 0 21 Apr 2022
Test Against High-Dimensional Uncertainties: Accelerated Evaluation of Autonomous Vehicles with Deep Importance Sampling Mansur Arief Zhepeng Cen Zhen-Yan Liu Zhiyuan Huang Henry Lam Yue Liu Ding Zhao UQCV 29 2 0 04 Apr 2022
How Do We Fail? Stress Testing Perception in Autonomous Vehicles Harrison Delecki Masha Itkina Bernard Lange Ransalu Senanayake Mykel J. Kochenderfer 27 23 0 26 Mar 2022
Verifying Inverse Model Neural Networks Chelsea Sidrane Sydney M. Katz Anthony Corso Mykel J. Kochenderfer 24 2 0 04 Feb 2022
Test and Evaluation of Quadrupedal Walking Gaits through Sim2Real Gap Quantification Prithvi Akella Wyatt Ubellacker Aaron D. Ames 30 4 0 04 Jan 2022
Vehicle trajectory prediction works, but not everywhere Mohammadhossein Bahari Saeed Saadatnejad Ahmad Rahimi Mohammad Shaverdikondori M. Shahidzadeh Seyed-Mohsen Moosavi-Dezfooli Alexandre Alahi OffRL 28 52 0 07 Dec 2021
A Survey on Scenario-Based Testing for Automated Driving Systems in High-Fidelity Simulation Ziyuan Zhong Yun Tang Yuan Zhou V. Neves Yang Liu Baishakhi Ray 50 61 0 02 Dec 2021