Paper Info
Title
Siamese Networks And Multi-Scale Local Extrema Scheme For Multimodal Brain Medical Image Fusion
Abstract
Multimodal medical image fusion is an auxiliary approach to help doctors diagnose diseases accurately leveraging information enhancement technology. Up to now, none of the fusion strategies is authoritative. Exploring methods with excellent performance is still the theme of image fusion works. The local extrema scheme (LES) and convolutional neural networks (CNNs) perform remarkable in medical image fusion tasks. However, the low decomposition efficiency of the LES and the limitations of CNNs should be addressed. Therefore, a novel framework proposed by combining the local extrema scheme and a Siamese network. This paper tried to solve the mentioned issues by improving the decomposition efficiency of LES and customizing the fusion strategy. Initially, the multi-scale local extrema scheme (MSLES) is introduced to decompose the source image into a series of detailed layers and a smoothed layer. Simultaneously, an adaptive dual-channel spiking cortical model (ADCSCM) based on the image information entropy (EN) is constructed to fuse the smoothed layer, and subsequently a feasible weight allocation strategy is designed by combining the Siamese network and EN to fuse the detailed layers. Ultimately, the informative image is reconstructed with the fused smoothed layer and detailed layers. By analyzing the extensive experimental results and metrics, the proposed framework achieves better performance against other state-of-art methods.
Year
DOI
Venue
2021
10.1016/j.bspc.2021.102697
BIOMEDICAL SIGNAL PROCESSING AND CONTROL
Keywords
DocType
Volume
Medical image fusion, CNNs, Spiking cortical model, Local extrema scheme, Siamese network
Journal
68
ISSN
Citations 
PageRank 
1746-8094
2
0.36
References 
Authors
0
5
Name
Order
Citations
PageRank
zhaisheng ding131.72
Dongming Zhou223.40
Haiyan Li392.50
Ruichao Hou432.06
Yanyu Liu531.72