Name
Abstract | ||
|---|---|---|
Recently, convolutional neural networks (CNNs) have achieved impressive progress in multi-focus image fusion (MFF). However, it always fails to capture sufficient discrimination features due to the local receptive field limitations of the convolutional operator, restricting most current CNN-based methods' performance. To address this issue, by leveraging self-attention (SA) mechanism, the authors propose Siamese SA network (SSAN) for MFF. Specifically, two kinds of SA modules, position SA (PSA) and channel SA (CSA) are utilised to model the long-range dependencies across focused and defocused regions in the multi-focus image, alleviating the local receptive field limitations of convolution operators in CNN. To search a better feature representation of the input image for MFF, the captured features obtained by PSA and CSA are further merged through a learnable 1 x 1 convolution operator. The whole pipeline is in a Siamese network fashion to reduce the complexity. After training, the authors SSAN can accomplish well the fusion task with no post-processing. Experiments demonstrate that their approach outperforms other current state-of-the-art methods, not only in subjective visual perception but also in the quantitative assessment. |
Year | DOI | Venue |
|---|---|---|
2020 | 10.1049/iet-ipr.2019.0883 | IET IMAGE PROCESSING |
Keywords | DocType | Volume |
image fusion, image sensors, visual perception, image representation, image enhancement, image resolution, learning (artificial intelligence), feature extraction, image classification, convolutional neural nets, fusion task, multifocus image fusion, Siamese self-attention network, convolutional neural networks, MFF, local receptive field limitations, convolutional operator, self-attention mechanism, Siamese SA network, focused defocused regions, convolution operators, input image, captured features, CNN-based methods | Journal | 14 |
Issue | ISSN | Citations |
7 | 1751-9659 | 1 |
PageRank | References | Authors |
0.34 | 0 | 5 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Xiaopeng Guo | 1 | 13 | 1.80 |
| Lingyu Meng | 2 | 1 | 0.34 |
| liye mei | 3 | 1 | 0.68 |
| Yueyun Weng | 4 | 1 | 0.34 |
| Hengqing Tong | 5 | 1 | 0.34 |