Title
Fusion of Multiscale Convolutional Neural Networks for Building Extraction in Very High-Resolution Images.
Abstract
Extracting buildings from very high resolution (VHR) images has attracted much attention but is still challenging due to their large varieties in appearance and scale. Convolutional neural networks (CNNs) have shown effective and superior performance in automatically learning high-level and discriminative features in extracting buildings. However, the fixed receptive fields make conventional CNNs insufficient to tolerate large scale changes. Multiscale CNN (MCNN) is a promising structure to meet this challenge. Unfortunately, the multiscale features extracted by MCNN are always stacked and fed into one classifier, which make it difficult to recognize objects with different scales. Besides, the repeated sub-sampling processes lead to a blurred boundary of the extracted features. In this study, we proposed a novel parallel support vector mechanism (SVM)-based fusion strategy to take full use of deep features at different scales as extracted by the MCNN structure. We firstly designed a MCNN structure with different sizes of input patches and kernels, to learn multiscale deep features. After that, features at different scales were individually fed into different support vector machine (SVM) classifiers to produce rule images for pre-classification. A decision fusion strategy is then applied on the pre-classification results based on another SVM classifier. Finally, superpixels are applied to refine the boundary of the fused results using region-based maximum voting. For performance evaluation, the well-known International Society for Photogrammetry and Remote Sensing (ISPRS) Potsdam dataset was used in comparison with several state-of-the-art algorithms. Experimental results have demonstrated the superior performance of the proposed methodology in extracting complex buildings in urban districts.
Year
DOI
Venue
2019
10.3390/rs11030227
REMOTE SENSING
Keywords
Field
DocType
deep learning,multiscale,building extraction,VHR images,convolutional neural network
Computer vision,Convolutional neural network,Fusion,Artificial intelligence,Geology
Journal
Volume
Issue
Citations 
11
3
0
PageRank 
References 
Authors
0.34
32
6
Name
Order
Citations
PageRank
Genyun Sun114917.27
hui huang28417.04
Aizhu Zhang3629.98
Feng Li433849.66
Huimin Zhao520623.43
Hang Fu600.34