Title
Deep Feature Correlation Learning for Multi-Modal Remote Sensing Image Registration
Abstract
Deep descriptors have advantages over handcrafted descriptors on local image patch matching. However, due to the complex imaging mechanism of remote sensing images and the significant differences in appearance between multi-modal images, existing deep learning descriptors are unsuitable for multi-modal remote sensing image registration directly. To solve this problem, this article proposes a deep feature correlation learning network (Cnet) for multi-modal remote sensing image registration. First, Cnet builds a feature learning network based on the deep convolutional network with the attention learning module, to enhance feature representation by focusing on meaningful features. Second, this article designs a novel feature correlation loss function for Cnet optimization. It focuses on the relative feature correlation between matching and nonmatching samples, which can improve the stability of network training and decrease the risk of overfitting. In addition, the proposed feature correlation loss with a scale factor can further enhance network training and accelerate network convergence. Extensive experimental results on image patch matching (Brown, HPatches), cross-spectral image registration (VIS-NIR), multi-modal remote sensing image registration, and single-modal remote sensing image registration have demonstrated the effectiveness and robustness of the proposed method.
Year
DOI
Venue
2022
10.1109/TGRS.2022.3187015
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
Keywords
DocType
Volume
Image registration, Remote sensing, Feature extraction, Correlation, Optimization, Training, Image matching, Attention mechanism, feature correlation, image registration, multi-modal image, remote sensing image
Journal
60
ISSN
Citations 
PageRank 
0196-2892
0
0.34
References 
Authors
0
8
Name
Order
Citations
PageRank
Dou Quan123.06
Shuang Wang231639.83
Yu Gu 000432158127.59
Ruiqi Lei400.68
Bowu Yang511.02
Shaowei Wei621.03
Biao Hou736849.04
Licheng Jiao801.01