Title
Towards Requirements Specification for Machine-learned Perception Based on Human Performance
Abstract
The application of machine learning (ML) based perception algorithms in safety-critical systems such as autonomous vehicles have raised major safety concerns due to the apparent risks to human lives. Yet assuring the safety of such systems is a challenging task, in a large part because ML components (MLCs) rarely have clearly specified requirements. Instead, they learn their intended tasks from the training data. One of the most well-studied properties that ensure the safety of MLCs is the robustness against small changes in images. But the range of changes considered small has not been systematically defined. In this paper, we propose an approach for specifying and testing requirements for robustness based on human perception. With this approach, the MLCs are required to be robust to changes that fall within the range defined based on human perception performance studies. We demonstrate the approach on a state-of-the-art object detector.
Year
DOI
Venue
2020
10.1109/AIRE51212.2020.00014
2020 IEEE Seventh International Workshop on Artificial Intelligence for Requirements Engineering (AIRE)
Keywords
DocType
ISBN
machine learning based perception algorithms,safety-critical systems,autonomous vehicles,apparent risks,human lives,ML components,MLC,clearly specified requirements,intended tasks,testing requirements,human perception performance studies,requirements specification,machine-learned perception
Conference
978-1-7281-8353-4
Citations 
PageRank 
References 
2
0.36
0
Authors
6
Name
Order
Citations
PageRank
Boyue Caroline Hu120.36
rick salay240034.68
Krzysztof Czarnecki36064411.57
Mona Rahimi420.36
Gehan M. K. Selim51728.94
Marsha Chechik62287138.57