Title
Multistage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images
Abstract
The attention mechanism can refine the extracted feature maps and boost the classification performance of the deep network, which has become an essential technique in computer vision and natural language processing. However, the memory and computational costs of the dot-product attention mechanism increase quadratically with the spatiotemporal size of the input. Such growth hinders the usage of attention mechanisms considerably in application scenarios with large-scale inputs. In this letter, we propose a linear attention mechanism (LAM) to address this issue, which is approximately equivalent to dot-product attention with computational efficiency. Such a design makes the incorporation between attention mechanisms and deep networks much more flexible and versatile. Based on the proposed LAM, we refactor the skip connections in the raw U-Net and design a multistage attention ResU-Net (MAResU-Net) for semantic segmentation from fine-resolution remote sensing images. Experiments conducted on the Vaihingen data set demonstrated the effectiveness and efficiency of our MAResU-Net. Our code is available at https://github.com/lironui/MAResU-Net.
Year
DOI
Venue
2022
10.1109/LGRS.2021.3063381
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS
Keywords
DocType
Volume
Semantics, Complexity theory, Remote sensing, Task analysis, Image segmentation, Feature extraction, Decoding, Fine-resolution remote sensing images, linear attention mechanism (LAM), semantic segmentation
Journal
19
ISSN
Citations 
PageRank 
1545-598X
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Rui Li11916.31
Jianlin Su233.76
Chenxi Duan302.03
Shunyi Zheng402.03