Title
Regularizing Hyperspectral and Multispectral Image Fusion by CNN Denoiser
Abstract
Hyperspectral image (HSI) and multispectral image (MSI) fusion, which fuses a low-spatial-resolution HSI (LR-HSI) with a higher resolution multispectral image (MSI), has become a common scheme to obtain high-resolution HSI (HR-HSI). This article presents a novel HSI and MSI fusion method (called as CNN-Fus), which is based on the subspace representation and convolutional neural network (CNN) denoiser, i.e., a well-trained CNN for gray image denoising. Our method only needs to train the CNN on the more accessible gray images and can be directly used for any HSI and MSI data sets without retraining. First, to exploit the high correlations among the spectral bands, we approximate the desired HR-HSI with the low-dimensional subspace multiplied by the coefficients, which can not only speed up the algorithm but also lead to more accurate recovery. Since the spectral information mainly exists in the LR-HSI, we learn the subspace from it via singular value decomposition. Due to the powerful learning performance and high speed of CNN, we use the well-trained CNN for gray image denoising to regularize the estimation of coefficients. Specifically, we plug the CNN denoiser into the alternating direction method of multipliers (ADMM) algorithm to estimate the coefficients. Experiments demonstrate that our method has superior performance over the state-of-the-art fusion methods.
Year
DOI
Venue
2021
10.1109/TNNLS.2020.2980398
IEEE Transactions on Neural Networks and Learning Systems
Keywords
DocType
Volume
Convolutional neural network (CNN),fusion,hyperspectral imaging,superresolution
Journal
32
Issue
ISSN
Citations 
3
2162-237X
5
PageRank 
References 
Authors
0.39
19
3
Name
Order
Citations
PageRank
Renwei Dian1844.65
Shutao Li219116.15
Xudong Kang3607.92