Title
When Pansharpening Meets Graph Convolution Network and Knowledge Distillation
Abstract
In this article, we propose a novel graph convolutional network (GCN) for pansharpening, defined as GCPNet, which consists of three main modules: the spatial GCN module (SGCN), the spectral band GCN module (BGCN), and the atrous spatial pyramid module (ASPM). Specifically, due to the nature of GCN, the proposed SGCN and BGCN are capable of exploring the long-range relationship between the object and the global state in the spatial and spectral aspects, which benefits pansharpened results and has not been fully investigated before. In addition, the designed ASPM is equipped with multiscale atrous convolutions and learns richer local feature information, so as to cover the objects of different sizes in satellite images. To further enhance the representation of our proposed GCPNet, asynchronous knowledge distillation is introduced to provide compact features by heterogeneous task imitation in a teacher-student paradigm. In the paradigm, the teacher network acts as a variational autoencoder to extract compact features of the ground-truth MS images. The student network, devised for pansharpening, is trained with the assistance of the teacher network to transfer the important information of the expected ground-truth MS images. Extensive experimental results on different satellite datasets demonstrate that our proposed network outperforms the state-of-the-art methods both visually and quantitatively. The source code is released at https://github.com/Keyu-Yan/GCPNet.
Year
DOI
Venue
2022
10.1109/TGRS.2022.3168192
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
Keywords
DocType
Volume
Pansharpening, Convolution, Satellites, Feature extraction, Task analysis, Knowledge engineering, Spatial resolution, Asynchronous knowledge distillation, atrous convolution, graph convolutional network (GCN), pansharpening
Journal
60
ISSN
Citations 
PageRank 
0196-2892
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Keyu Yan102.70
Man Zhou200.34
Liu Liu300.34
Chengjun Xie400.68
Danfeng Hong518333.29