Paper Info
Title
Increasing Trust In Data-Driven Model Validation A Framework For Probabilistic Augmentation Of Images And Meta-Data Generation Using Application Scope Characteristics
Abstract
In recent years, interest in autonomous systems has increased. To observe their environment and interact with it, such systems need to process sensor data including camera images. State-of-the-art methods for object recognition and image segmentation rely on complex data-driven models such as convolutional neural networks. Although no final answer exists yet on how to perform safety evaluation of systems containing such models, such evaluation should comprise at least validation with realistic input data, including settings with suboptimal data quality. Because many test datasets still lack a sufficient number of representative quality deficits, we consider augmenting existing data with quality deficits as necessary. For this purpose, a novel tool framework is presented and illustrated using traffic sign recognition as a use case. The extendable approach distinguishes between augmentation at the object, context, and sensor levels. To provide realistic augmentation and meta-data for existing image datasets, known context information and conditional probabilities are processed. First applications on the GTSRB dataset show promising results. The augmentation of datasets facilitates a more rigorous investigation of how various quality deficits affect the accuracy of a model in its target application scope.
Year
DOI
Venue
2019
10.1007/978-3-030-26601-1_11
COMPUTER SAFETY, RELIABILITY, AND SECURITY, SAFECOMP 2019
Keywords
DocType
Volume
Safety, Traffic sign recognition, Data augmentation, Data quality, Application scope characteristics, Uncertainty, Convolutional Neural Networks
Conference
11698
ISSN
Citations 
PageRank 
0302-9743
0
0.34
References 
Authors
0
2
Name
Order
Citations
PageRank
Lisa Jöckel111.38
Michael Kläs2969.50