Machine Learning Testing: Survey, Landscapes and Horizons

19 June 2019

Yang Liu

Papers citing "Machine Learning Testing: Survey, Landscapes and Horizons"

50 / 224 papers shown

Title
Enhanced Fairness Testing via Generating Effective Initial Individual Discriminatory Instances Minghua Ma Zhao Tian Max Hort Federica Sarro Hongyu Zhang Qingwei Lin Dongmei Zhang 15 5 0 17 Sep 2022
Quality issues in Machine Learning Software Systems Pierre-Olivier Coté Amin Nikanjam Rached Bouchoucha Foutse Khomh 17 6 0 18 Aug 2022
Development and Validation of ML-DQA -- a Machine Learning Data Quality Assurance Framework for Healthcare M. Sendak Gaurav Sirdeshmukh Timothy N. Ochoa Hayley Premo Linda Tang ... M. Nichols Bradley Heintze William S Knechtle W. Ratliff S. Balu 11 6 0 04 Aug 2022
Differential testing for machine learning: an analysis for classification algorithms beyond deep learning Steffen Herbold Steffen Tunkel 31 4 0 25 Jul 2022
Aries: Efficient Testing of Deep Neural Networks via Labeling-Free Accuracy Estimation Qiang Hu Yuejun Guo Xiaofei Xie Maxime Cordy Lei Ma Mike Papadakis Yves Le Traon AAML 17 17 0 22 Jul 2022
Modeling Quality and Machine Learning Pipelines through Extended Feature Models Giordano dÁloisio A. Marco Giovanni Stilo 18 7 0 15 Jul 2022
Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey Max Hort Zhenpeng Chen Jie M. Zhang Mark Harman Federica Sarro FaML AI4CE 33 160 0 14 Jul 2022
Guiding the retraining of convolutional neural networks against adversarial inputs Francisco Durán Silverio Martínez-Fernández Michael Felderer Xavier Franch AAML 35 1 0 08 Jul 2022
A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers Zhenpeng Chen Jie M. Zhang Federica Sarro Mark Harman FaML 21 67 0 07 Jul 2022
Do Not Take It for Granted: Comparing Open-Source Libraries for Software Development Effort Estimation Rebecca Moussa Federica Sarro 15 4 0 04 Jul 2022
Abstraction and Refinement: Towards Scalable and Exact Verification of Neural Networks Jiaxiang Liu Yunhan Xing Xiaomu Shi Fu Song Zhiwu Xu Zhong Ming 24 10 0 02 Jul 2022
Bugs in Machine Learning-based Systems: A Faultload Benchmark Mohammad Mehdi Morovati Amin Nikanjam Foutse Khomh Zhen Ming Z. Jiang 24 20 0 24 Jun 2022
Hierarchical Distribution-Aware Testing of Deep Learning Wei Huang Xingyu Zhao Alec Banks V. Cox Xiaowei Huang OOD AAML 36 10 0 17 May 2022
AEON: A Method for Automatic Evaluation of NLP Test Cases Jen-tse Huang Jianping Zhang Wenxuan Wang Pinjia He Yuxin Su Michael R. Lyu 40 23 0 13 May 2022
Evaluation Gaps in Machine Learning Practice Ben Hutchinson Negar Rostamzadeh Christina Greer Katherine A. Heller Vinodkumar Prabhakaran ELM 28 56 0 11 May 2022
Sibylvariant Transformations for Robust Text Classification Fabrice Harel-Canada Muhammad Ali Gulzar Nanyun Peng Miryung Kim AAML VLM 11 4 0 10 May 2022
DeepFD: Automated Fault Diagnosis and Localization for Deep Learning Programs Jialun Cao Meiziniu Li Xiao Chen Ming Wen Yongqiang Tian Bo Wu Shing-Chi Cheung AAML 19 40 0 04 May 2022
DIRA: Dynamic Domain Incremental Regularised Adaptation Abanoub Ghobrial Xu Zheng Darryl Hond Hamid Asgari Kerstin Eder AI4CE 26 1 0 30 Apr 2022
Tailored Uncertainty Estimation for Deep Learning Systems Joachim Sicking Maram Akila Jan David Schneider Fabian Hüger Peter Schlicht Tim Wirtz Stefan Wrobel UQCV 29 1 0 29 Apr 2022
The Risks of Machine Learning Systems Samson Tan Araz Taeihagh K. Baxter 12 5 0 21 Apr 2022
Ergo, SMIRK is Safe: A Safety Case for a Machine Learning Component in a Pedestrian Automatic Emergency Brake System Markus Borg Jens Henriksson Kasper Socha Olof Lennartsson Elias Sonnsjo Lonegren T. Bui Piotr Tomaszewski S. Sathyamoorthy Sebastian Brink M. H. Moghadam 35 23 0 16 Apr 2022
Characterizing and Understanding the Behavior of Quantized Models for Reliable Deployment Qiang Hu Yuejun Guo Maxime Cordy Xiaofei Xie Wei Ma Mike Papadakis Yves Le Traon MQ 41 1 0 08 Apr 2022
LaF: Labeling-Free Model Selection for Automated Deep Neural Network Reusing Qiang Hu Yuejun Guo Maxime Cordy Xiaofei Xie Mike Papadakis Yves Le Traon 23 5 0 08 Apr 2022
Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communications Qunying Song Markus Borg Emelie Engström H. Ardö Sergio Rico 14 10 0 30 Mar 2022
Quality Assurance of Generative Dialog Models in an Evolving Conversational Agent Used for Swedish Language Practice Markus Borg J. Bengtsson Harald Österling Alexander Hagelborn Isabella Gagner Piotr Tomaszewski 14 1 0 29 Mar 2022
NPC: Neuron Path Coverage via Characterizing Decision Logic of Deep Neural Networks Xiaofei Xie Tianlin Li Jian-Xun Wang L. Ma Qing Guo Felix Juefei Xu Yang Liu AAML 18 50 0 24 Mar 2022
What is Software Quality for AI Engineers? Towards a Thinning of the Fog Valentina Golendukhina Valentina Lenarduzzi Michael Felderer 14 14 0 23 Mar 2022
Data Smells in Public Datasets Arumoy Shome Luís Cruz A. van Deursen 17 18 0 15 Mar 2022
Dawn of the transformer era in speech emotion recognition: closing the valence gap Johannes Wagner Andreas Triantafyllopoulos H. Wierstorf Maximilian Schmitt Felix Burkhardt F. Eyben Björn W. Schuller 15 281 0 14 Mar 2022
Attacks and Faults Injection in Self-Driving Agents on the Carla Simulator -- Experience Report Niccolò Piazzesi Massimo Hong Andrea Ceccarelli AAML 16 5 0 25 Feb 2022
Testing Deep Learning Models: A First Comparative Study of Multiple Testing Techniques M. K. Ahuja A. Gotlieb Helge Spieker AAML 11 4 0 24 Feb 2022
Reinforcement Learning in Practice: Opportunities and Challenges Yuxi Li OffRL 36 9 0 23 Feb 2022
ExAIS: Executable AI Semantics Richard Schumi Jun Sun 9 6 0 20 Feb 2022
Symphony: Composing Interactive Interfaces for Machine Learning Alex Bäuerle Ángel Alexander Cabrera Fred Hohman Megan Maher Welsh David Koski Xavier Suau Titus Barik Dominik Moritz 19 55 0 18 Feb 2022
Fairness-aware Configuration of Machine Learning Libraries Saeid Tizpaz-Niari Ashish Kumar Gang Tan Ashutosh Trivedi FaML 14 47 0 13 Feb 2022
Trust in AI: Interpretability is not necessary or sufficient, while black-box interaction is necessary and sufficient Max W. Shen 25 18 0 10 Feb 2022
On Continuous Integration / Continuous Delivery for Automated Deployment of Machine Learning Models using MLOps Satvik Garg Pradyumn Pundir Geetanjali Rathee P. K. Gupta Somya Garg Saransh Ahlawat VLM 4 54 0 07 Feb 2022
Systematic Training and Testing for Machine Learning Using Combinatorial Interaction Testing Tyler Cody Erin Lanus Daniel D. Doyle Laura J. Freeman 16 24 0 28 Jan 2022
"Project smells" -- Experiences in Analysing the Software Quality of ML Projects with mllint B. V. Oort Luís Cruz B. Loni A. van Deursen 25 4 0 20 Jan 2022
Black-box Safety Analysis and Retraining of DNNs based on Feature Extraction and Clustering M. Attaoui Hazem M. Fahmy F. Pastore Lionel C. Briand AAML 16 21 0 13 Jan 2022
Security for Machine Learning-based Software Systems: a survey of threats, practices and challenges Huaming Chen Muhammad Ali Babar AAML 37 21 0 12 Jan 2022
Machine Learning Application Development: Practitioners' Insights Md Saidur Rahman Foutse Khomh Alaleh Hamidi Jinghui Cheng G. Antoniol Hironori Washizaki 14 8 0 31 Dec 2021
Silent Bugs in Deep Learning Frameworks: An Empirical Study of Keras and TensorFlow Florian Tambon Amin Nikanjam Le An Foutse Khomh G. Antoniol 17 34 0 26 Dec 2021
MDPFuzz: Testing Models Solving Markov Decision Processes Qi Pang Yuanyuan Yuan Shuai Wang 18 27 0 06 Dec 2021
Robust Active Learning: Sample-Efficient Training of Robust Deep Learning Models Yuejun Guo Qiang Hu Maxime Cordy Mike Papadakis Yves Le Traon VLM OOD 16 4 0 05 Dec 2021
Understanding Performance Problems in Deep Learning Systems Junming Cao Bihuan Chen Chao Sun Longjie Hu Shuai Wu Xin Peng 30 27 0 03 Dec 2021
Collaborative Artificial Intelligence Needs Stronger Assurances Driven by Risks Jubril Gbolahan Adigun Matteo Camilli Michael Felderer Andrea Giusti D. Matt A. Perini B. Russo A. Susi 17 5 0 01 Dec 2021
Agility in Software 2.0 -- Notebook Interfaces and MLOps with Buttresses and Rebars Markus Borg 11 13 0 28 Nov 2021
ArchRepair: Block-Level Architecture-Oriented Repairing for Deep Neural Networks Hua Qi Zhijie Wang Qing Guo Jianlang Chen Felix Juefei Xu L. Ma Jianjun Zhao AAML AI4CE 30 16 0 26 Nov 2021
Fairness Testing of Deep Image Classification with Adequacy Metrics Peixin Zhang Jingyi Wang Jun Sun Xinyu Wang VLM EGVM 11 12 0 17 Nov 2021