Name
Title | ||
|---|---|---|
Object Detection And Pose Estimation Based On Convolutional Neural Networks Trained With Synthetic Data |
Abstract | ||
|---|---|---|
Instance-based object detection and fine pose estimation is an active research problem in computer vision. While the traditional interest-point-based approaches for pose estimation are precise, their applicability in robotic tasks relies on controlled environments and rigid objects with detailed textures. CNN-based approaches, on the other hand, have shown impressive results in uncontrolled environments for more general object recognition tasks like category-based coarse pose estimation, but the need of large datasets of fully-annotated training images makes them unfavourable for tasks like instance-based pose estimation.We present a novel approach that combines the robustness of CNNs with a fine-resolution instance-based 3D pose estimation, where the model is trained with fully-annotated synthetic training data, generated automatically from the 3D models of the objects. We propose an experimental setup in which we can carefully examine how the model trained with synthetic data performs on real images of the objects. Results show that the proposed model can be trained only with synthetic renderings of the objects' 3D models and still be successfully applied on images of the real objects, with precision suitable for robotic tasks like object grasping. Based on the results, we present more general insights about training neural models with synthetic images for application on real-world images. |
Year | DOI | Venue |
|---|---|---|
2018 | 10.1109/IROS.2018.8594379 | 2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) |
Field | DocType | ISSN |
Object detection,Computer vision,Data modeling,Convolutional neural network,Computer science,3D pose estimation,Pose,Synthetic data,Artificial intelligence,Real image,Cognitive neuroscience of visual object recognition | Conference | 2153-0858 |
Citations | PageRank | References |
1 | 0.35 | 0 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Josip Josifovski | 1 | 1 | 0.35 |
| Matthias Kerzel | 2 | 32 | 7.67 |
| Christoph Pregizer | 3 | 1 | 0.35 |
| Lukas Posniak | 4 | 1 | 0.35 |
| Stefan Wermter | 5 | 1100 | 151.62 |