Unifying Evaluation of Machine Learning Safety Monitors

Unifying Evaluation of Machine Learning Safety Monitors

31 August 2022

Raul Sena Ferreira

Jérémie Guiochet

ArXiv (abs)PDF HTML

Papers citing "Unifying Evaluation of Machine Learning Safety Monitors"

17 / 17 papers shown

Title
Evaluation of Runtime Monitoring for UAV Emergency Landing Joris Guérin Kevin Delmas Jérémie Guiochet 58 13 0 07 Feb 2022
ReAct: Out-of-distribution Detection With Rectified Activations Yiyou Sun Chuan Guo Yixuan Li OODD 113 478 0 24 Nov 2021
Fault-Tolerant Perception for Automated Driving A Lightweight Monitoring Approach Cornelius Buerkle Florian Geissler Michael Paulitsch Kay-Ulrich Scholl 42 9 0 24 Nov 2021
Benchmarking Safety Monitors for Image Classifiers with Machine Learning Raul Sena Ferreira J. Arlat Jérémie Guiochet H. Waeselynck 75 26 0 04 Oct 2021
Certifying Emergency Landing for Safe Urban UAV Joris Guérin Kevin Delmas Jérémie Guiochet 39 8 0 30 Apr 2021
Run-Time Monitoring of Machine Learning for Robotic Perception: A Survey of Emerging Trends Q. Rahman Peter Corke Feras Dayoub OOD 106 55 0 05 Jan 2021
Into the Unknown: Active Monitoring of Neural Networks Anna Lukina Christian Schilling T. Henzinger AAML 61 27 0 14 Sep 2020
Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Data Yen-Chang Hsu Yilin Shen Hongxia Jin Z. Kira OODD 98 573 0 26 Feb 2020
Practical Solutions for Machine Learning Safety in Autonomous Vehicles Sina Mohseni Mandar Pitale Vasu Singh Zhangyang Wang 58 68 0 20 Dec 2019
SelectiveNet: A Deep Neural Network with an Integrated Reject Option Yonatan Geifman Ran El-Yaniv CVBM OOD 126 311 0 26 Jan 2019
Adversarial Sample Detection for Deep Neural Network through Model Mutation Testing Jingyi Wang Guoliang Dong Jun Sun Xinyu Wang Peixin Zhang AAML 46 191 0 14 Dec 2018
Albumentations: fast and flexible image augmentations A. Buslaev Alex Parinov Eugene Khvedchenya V. Iglovikov Alexandr A Kalinin 149 1,974 0 18 Sep 2018
Runtime Monitoring Neuron Activation Patterns Chih-Hong Cheng Georg Nührenberg Hirotoshi Yasuoka 57 75 0 18 Sep 2018
CARLA: An Open Urban Driving Simulator Alexey Dosovitskiy G. Ros Felipe Codevilla Antonio M. López V. Koltun VLM 137 5,173 0 10 Nov 2017
Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks Shiyu Liang Yixuan Li R. Srikant UQCV OODD 168 2,072 0 08 Jun 2017
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks Dan Hendrycks Kevin Gimpel UQCV 164 3,454 0 07 Oct 2016
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 413 43,667 0 01 May 2014