Title
Triplet-Metric-Guided Multi-Scale Attention for Remote Sensing Image Scene Classification with a Convolutional Neural Network
Abstract
Remote sensing image scene classification (RSISC) plays a vital role in remote sensing applications. Recent methods based on convolutional neural networks (CNNs) have driven the development of RSISC. However, these approaches are not adequate considering the contributions of different features to the global decision. In this paper, triplet-metric-guided multi-scale attention (TMGMA) is proposed to enhance task-related salient features and suppress task-unrelated salient and redundant features. Firstly, we design the multi-scale attention module (MAM) guided by multi-scale feature maps to adaptively emphasize salient features and simultaneously fuse multi-scale and contextual information. Secondly, to capture task-related salient features, we use the triplet metric (TM) to optimize the learning of MAM under the constraint that the distance of the negative pair is supposed to be larger than the distance of the positive pair. Notably, the MAM and TM collaboration can enforce learning a more discriminative model. As such, our TMGMA can avoid the classification confusion caused by only using the attention mechanism and the excessive correction of features caused by only using the metric learning. Extensive experiments demonstrate that our TMGMA outperforms the ResNet50 baseline by 0.47% on the UC Merced, 1.46% on the AID, and 1.55% on the NWPU-RESISC45 dataset, respectively, and achieves performance that is competitive with other state-of-the-art methods.
Year
DOI
Venue
2022
10.3390/rs14122794
REMOTE SENSING
Keywords
DocType
Volume
multi-scale attention, triplet metric, convolutional neural network, remote sensing image scene classification
Journal
14
Issue
ISSN
Citations 
12
2072-4292
0
PageRank 
References 
Authors
0.34
0
8
Name
Order
Citations
PageRank
Hong Wang178.30
Kun Gao203.04
Lei Min300.68
Yuxuan Mao400.34
Xiaodian Zhang503.38
Junwei Wang601.35
Zibo Hu700.68
Yutong Liu800.68