Title
Depth Estimation and Semantic Segmentation from a Single RGB Image Using a Hybrid Convolutional Neural Network.
Abstract
Semantic segmentation and depth estimation are two important tasks in computer vision, and many methods have been developed to tackle them. Commonly these two tasks are addressed independently, but recently the idea of merging these two problems into a sole framework has been studied under the assumption that integrating two highly correlated tasks may benefit each other to improve the estimation accuracy. In this paper, depth estimation and semantic segmentation are jointly addressed using a single RGB input image under a unified convolutional neural network. We analyze two different architectures to evaluate which features are more relevant when shared by the two tasks and which features should be kept separated to achieve a mutual improvement. Likewise, our approaches are evaluated under two different scenarios designed to review our results versus single-task and multi-task methods. Qualitative and quantitative experiments demonstrate that the performance of our methodology outperforms the state of the art on single-task approaches, while obtaining competitive results compared with other multi-task methods.
Year
DOI
Venue
2019
10.3390/s19081795
SENSORS
Keywords
Field
DocType
depth estimation,semantic segmentation,convolutional neural networks,hybrid architecture
Pattern recognition,Convolutional neural network,Segmentation,Rgb image,Electronic engineering,RGB color model,Artificial intelligence,Engineering,Merge (version control)
Journal
Volume
Issue
ISSN
19
8
1424-8220
Citations 
PageRank 
References 
2
0.39
0
Authors
4
Name
Order
Citations
PageRank
Xiao Lin120.39
Dalila SáNchez-Escobedo2151.58
Josep R. Casas321223.34
Montse Pardàs434335.03