Paper Info
Title
Deep Joint Estimation Network for Satellite Video Super-Resolution With Multiple Degradations
Abstract
Super-resolution (SR) for satellite video data has been a hot research topic in the field of remote sensing video analysis. The existing satellite video SR methods assume that the blur kernel in the imaging degradation model is known. However, the blur kernel in real satellite videos is usually unknown, which inevitably results in poor performance when the true blur kernel is not consistent with a predefined blur kernel. To address this issue, this article proposes a deep joint estimation network for satellite video SR (JENSVSR), which jointly estimates blur kernels and SR frames. Specifically, JENSVSR is composed of a video SR subnetwork and a blur kernel estimation subnetwork. On one hand, the video SR subnetwork makes use of multiple video frames to generate super-resolved satellite frames. To effectively fuse information from adjacent frames, an alignment and fusion module is proposed in the feature space. On the other hand, the blur estimation subnetwork is also proposed to predict blur kernels. The two subnetworks are coupled by cross-task feature fusion modules (CTFFMs) to achieve joint estimation rather than two-step independent estimation. The performance of our proposed method is evaluated on synthetic and real satellite videos. The experimental results show that our proposed method is superior to the current state-of-the-art SR methods.
Year
DOI
Venue
2022
10.1109/TGRS.2022.3163790
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
Keywords
DocType
Volume
Kernel, Satellites, Estimation, Degradation, Image reconstruction, Spatial resolution, Convolution, Blur kernel estimation, multiple degradations, satellite video, super-resolution (SR)
Journal
60
ISSN
Citations 
PageRank 
0196-2892
0
0.34
References 
Authors
0
2
Name
Order
Citations
PageRank
Huan Liu1182.27
Yanfeng Gu274255.56