Towards Structured Evaluation of Deep Neural Network Supervisors

Towards Structured Evaluation of Deep Neural Network Supervisors

4 March 2019

Jens Henriksson

Cristofer Englund

S. Sathyamoorthy

Papers citing "Towards Structured Evaluation of Deep Neural Network Supervisors"

13 / 13 papers shown

Title
System Safety Monitoring of Learned Components Using Temporal Metric Forecasting Sepehr Sharifi Andrea Stocco Lionel C. Briand AI4TS 53 1 0 21 May 2024
Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification Ruben Grewal Paolo Tonella Andrea Stocco 50 12 0 29 Apr 2024
Uncertainty Quantification for Deep Neural Networks: An Empirical Comparison and Usage Guidelines Michael Weiss Paolo Tonella BDL UQCV 32 11 0 14 Dec 2022
CheapET-3: Cost-Efficient Use of Remote DNN Models Michael Weiss 38 1 0 24 Aug 2022
Generating and Detecting True Ambiguity: A Forgotten Danger in DNN Supervision Testing Michael Weiss A. Gómez Paolo Tonella AAML 20 6 0 21 Jul 2022
AEON: A Method for Automatic Evaluation of NLP Test Cases Jen-tse Huang Jianping Zhang Wenxuan Wang Pinjia He Yuxin Su Michael R. Lyu 45 23 0 13 May 2022
Ergo, SMIRK is Safe: A Safety Case for a Machine Learning Component in a Pedestrian Automatic Emergency Brake System Markus Borg Jens Henriksson Kasper Socha Olof Lennartsson Elias Sonnsjo Lonegren T. Bui Piotr Tomaszewski S. Sathyamoorthy Sebastian Brink M. H. Moghadam 35 23 0 16 Apr 2022
Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communications Qunying Song Markus Borg Emelie Engström H. Ardö Sergio Rico 14 10 0 30 Mar 2022
Evaluation of Runtime Monitoring for UAV Emergency Landing Joris Guérin Kevin Delmas Jérémie Guiochet 41 13 0 07 Feb 2022
Benchmarking Safety Monitors for Image Classifiers with Machine Learning Raul Sena Ferreira J. Arlat Jérémie Guiochet H. Waeselynck 48 26 0 04 Oct 2021
How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review Florian Tambon Gabriel Laberge Le An Amin Nikanjam Paulina Stevia Nouwou Mindom Y. Pequignot Foutse Khomh G. Antoniol E. Merlo François Laviolette 37 66 0 26 Jul 2021
Performance Analysis of Out-of-Distribution Detection on Various Trained Neural Networks Jens Henriksson C. Berger Markus Borg Lars Tornberg S. Sathyamoorthy Cristofer Englund OODD 22 17 0 29 Mar 2021
Structure-Invariant Testing for Machine Translation Pinjia He Clara Meister Z. Su 27 104 0 19 Jul 2019