Title
MSAC-Net: 3D Multi-Scale Attention Convolutional Network for Multi-Spectral Imagery Pansharpening
Abstract
Pansharpening fuses spectral information from the multi-spectral image and spatial information from the panchromatic image, generating super-resolution multi-spectral images with high spatial resolution. In this paper, we proposed a novel 3D multi-scale attention convolutional network (MSAC-Net) based on the typical U-Net framework for multi-spectral imagery pansharpening. MSAC-Net is designed via 3D convolution, and the attention mechanism replaces the skip connection between the contraction and expansion pathways. Multiple pansharpening layers at the expansion pathway are designed to calculate the reconstruction results for preserving multi-scale spatial information. The MSAC-Net performance is verified on the IKONOS and QuickBird satellites' datasets, proving that MSAC-Net achieves comparable or superior performance to the state-of-the-art methods. Additionally, 2D and 3D convolution are compared, and the influences of the number of convolutions in the convolution block, the weight of multi-scale information, and the network's depth on the network performance are analyzed.
Year
DOI
Venue
2022
10.3390/rs14122761
REMOTE SENSING
Keywords
DocType
Volume
deep learning, multi-spectral image, 3D convolutional, multi-scale cost
Journal
14
Issue
ISSN
Citations 
12
2072-4292
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Erlei Zhang100.68
Yihao Fu200.68
Jun Wang333.42
Lu Liu421527.61
Kai Yu511.70
Jinye Peng628440.93