Title
Automatic semantic maps generation from lexical annotations
Abstract
The generation of semantic environment representations is still an open problem in robotics. Most of the current proposals are based on metric representations, and incorporate semantic information in a supervised fashion. The purpose of the robot is key in the generation of these representations, which has traditionally reduced the inter-usability of the maps created for different applications. We propose the use of information provided by lexical annotations to generate general-purpose semantic maps from RGB-D images. We exploit the availability of deep learning models suitable for describing any input image by means of lexical labels. Lexical annotations are more appropriate for computing the semantic similarity between images than the state-of-the-art visual descriptors. From these annotations, we perform a bottom-up clustering approach that associates each image with a different category. The use of RGB-D images allows the robot pose associated with each acquisition to be obtained, thus complementing the semantic with the metric information.
Year
DOI
Venue
2019
10.1007/s10514-018-9723-8
Autonomous Robots
Keywords
Field
DocType
Semantic map, Lexical annotations, 3D registration, RGB-D data, Deep learning
Semantic similarity,Computer vision,Open problem,Computer science,Exploit,RGB color model,Artificial intelligence,Natural language processing,Deep learning,Cluster analysis,Robot,Robotics
Journal
Volume
Issue
ISSN
43.0
3
1573-7527
Citations 
PageRank 
References 
0
0.34
31
Authors
6