Title
Semantic Segmentation Leveraging Simultaneous Depth Estimation
Abstract
Semantic segmentation is one of the most widely studied problems in computer vision communities, which makes a great contribution to a variety of applications. A lot of learning-based approaches, such as Convolutional Neural Network (CNN), have made a vast contribution to this problem. While rich context information of the input images can be learned from multi-scale receptive fields by convolutions with deep layers, traditional CNNs have great difficulty in learning the geometrical relationship and distribution of objects in the RGB image due to the lack of depth information, which may lead to an inferior segmentation quality. To solve this problem, we propose a method that improves segmentation quality with depth estimation on RGB images. Specifically, we estimate depth information on RGB images via a depth estimation network, and then feed the depth map into the CNN which is able to guide the semantic segmentation. Furthermore, in order to parse the depth map and RGB images simultaneously, we construct a multi-branch encoder-decoder network and fuse the RGB and depth features step by step. Extensive experimental evaluation on four baseline networks demonstrates that our proposed method can enhance the segmentation quality considerably and obtain better performance compared to other segmentation networks.
Year
DOI
Venue
2021
10.3390/s21030690
SENSORS
Keywords
DocType
Volume
CNN, semantic segmentation, depth estimation, multi-source feature fusion
Journal
21
Issue
ISSN
Citations 
3
1424-8220
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Wenbo Sun1184.14
Zhi Gao243.49
Jinqiang Cui301.35
Bharath Ramesh400.34
Bin Zhang500.68
Ziyao Li600.68