Title
Two-Stream Swin Transformer with Differentiable Sobel Operator for Remote Sensing Image Classification
Abstract
Remote sensing (RS) image classification has attracted much attention recently and is widely used in various fields. Different to natural images, the RS image scenes consist of complex backgrounds and various stochastically arranged objects, thus making it difficult for networks to focus on the target objects in the scene. However, conventional classification methods do not have any special treatment for remote sensing images. In this paper, we propose a two-stream swin transformer network (TSTNet) to address these issues. TSTNet consists of two streams (i.e., original stream and edge stream) which use both the deep features of the original images and the ones from the edges to make predictions. The swin transformer is used as the backbone of each stream given its good performance. In addition, a differentiable edge Sobel operator module (DESOM) is included in the edge stream which can learn the parameters of Sobel operator adaptively and provide more robust edge information that can suppress background noise. Experimental results on three publicly available remote sensing datasets show that our TSTNet achieves superior performance over the state-of-the-art (SOTA) methods.
Year
DOI
Venue
2022
10.3390/rs14061507
REMOTE SENSING
Keywords
DocType
Volume
remote sensing, scene classification, deep learning, swin transformer, feature fusion, edge detection
Journal
14
Issue
ISSN
Citations 
6
2072-4292
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Siyuan Hao100.34
Bin Wu227138.89
Kun Zhao341.78
Yuanxin Ye426.46
Wei Wang513114.16