Title
Spectral Super-Resolution Using Hybrid 2d-3d Structure Tensor Attention Networks With Camera Spectral Sensitivity Prior
Abstract
With the development of deep convolutional neural networks (CNNs), spectral super-resolution (SSR) has obtained a significant improvement, which aims to recover the hyperspectral image (HSI) from a single RGB. However, the existing mapping algorithms lack of utilization of the camera spectral sensitivity (CSS) and only focus on wider or deeper architecture design, neglecting to explore the feature correlations of intermediate layers, thus preventing the representational ability of CNNs. In our paper, a novel hybrid 2D-3D structure tensor attention networks (HSTAN) with CSS prior is proposed for SSR. In specific, a structure tensor attention (STA) embedded in the residual block is invented to extract the salient high-frequency spatial details for adequate spatial feature expression. Furthermore, the CSS is firstly exploited as a prior to avoid its influence of SSR quality, based on which the reconstructed RGB can be calculated naturally through the super-resolved HSI, then the final loss incorporates the discrepancies of RGB and the HSI as a finer constraint. Experimental results demonstrate the superiority of our proposed algorithm.
Year
DOI
Venue
2020
10.1109/IGARSS39084.2020.9323553
IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM
Keywords
DocType
Citations 
SSR, HSTAN, structure tensor attention, camera spectral sensitivity prior
Conference
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Chaoxiong Wu123.06
Jiaojiao Li236.16
Rui Song3407.79
Yunsong Li438874.42