Name
Abstract | ||
|---|---|---|
Semantic understanding of unstructured environments plays an essential role in the autonomous planning and execution of whole-body humanoid locomotion and manipulation tasks. We introduce a new graph-based and data-driven method for semantic representation of unknown environments based on visual sensor data streams. The proposed method extends our previous work, in which loco-manipulation scene affordances are detected in a fully unsupervised manner. We build a geometric primitive-based model of the perceived scene and assign interaction possibilities, i.e. affordances, to the individual primitives. The major contribution of this paper is the enrichment of the extracted scene representation with semantic object information through spatio-temporal fusion of primitives during the perception. To this end, we combine the primitive-based scene representation with object detection methods to identify higher semantic structures in the scene. The qualitative and quantitative evaluation of the proposed method in various experiments in simulation and on the humanoid robot ARMAR-III demonstrates the effectiveness of the approach. |
Year | Venue | Field |
|---|---|---|
2017 | 2017 IEEE-RAS 17TH INTERNATIONAL CONFERENCE ON HUMANOID ROBOTICS (HUMANOIDS) | Object detection,Data stream mining,Computer science,Simulation,Geometric primitive,Image segmentation,Human–computer interaction,Perception,Affordance,Semantics,Humanoid robot |
DocType | Citations | PageRank |
Conference | 0 | 0.34 |
References | Authors | |
0 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Markus Grotz | 1 | 3 | 3.44 |
| Peter Kaiser | 2 | 15 | 4.79 |
| Eren Erdal Aksoy | 3 | 162 | 11.36 |
| Fabian Paus | 4 | 5 | 3.47 |
| tamim asfour | 5 | 1889 | 151.86 |