Title
Multi-Scale and Multi-Task Deep Learning Framework for Automatic Road Extraction
Abstract
Road detection and centerline extraction from very high-resolution (VHR) remote sensing imagery are of great significance in various practical applications. Road detection and centerline extraction operations depend on each other, to a certain extent. The road detection constrains the appearance of the centerline, and the centerline enhances the linear features of the road detection. However, most of the previous works have addressed these two tasks separately and have not considered the symbiotic relationship between them, making it difficult to obtain smooth and complete roads. In this paper, a novel multi-scale and multi-task deep learning framework for automatic road extraction (MSMT-RE) is proposed to build the relationship between them and simultaneously complete the road detection and centerline extraction tasks. U-Net is selected as the basic network for multi-task learning due to its strong ability to preserve spatial details. Multi-scale feature integration is also applied in the framework to increase the robustness of the feature extraction. Meanwhile, an adaptive loss function is introduced to solve the problems of roads taking up a small percentage of the training samples, and the fact that the positive samples of the two tasks are unbalanced. Finally, experiments were conducted on two public road data sets and two large images from Google Earth, and the proposed framework was compared with other state-of-the-art deep learning-based road extraction methods, both quantitatively and qualitatively. The proposed approach outperformed all the compared methods, confirming its advantages in automatic road extraction.
Year
DOI
Venue
2019
10.1109/TGRS.2019.2926397
IEEE Transactions on Geoscience and Remote Sensing
Keywords
Field
DocType
Roads,Feature extraction,Remote sensing,Task analysis,Deep learning,Training,Labeling
Computer vision,Data set,Pattern recognition,Task analysis,Feature extraction,Robustness (computer science),Artificial intelligence,Deep learning,Mathematics
Journal
Volume
Issue
ISSN
57
11
0196-2892
Citations 
PageRank 
References 
4
0.39
0
Authors
7
Name
Order
Citations
PageRank
Xiaoyan Lu151.41
Yanfei Zhong2104490.58
Zhuo Zheng3214.61
Yanfei Liu4141.87
Ji Zhao5472.00
Ailong Ma69516.88
Jie Yang719457.20