Title
Fusion Based On Attention Mechanism And Context Constraint For Multi-Modal Brain Tumor Segmentation
Abstract
This paper presents a 3D brain tumor segmentation network from multi-sequence MRI datasets based on deep learning. We propose a three-stage network: generating constraints, fusion under constraints and final segmentation. In the first stage, an initial 3D U-Net segmentation network is introduced to produce an additional context constraint for each tumor region. Under the obtained constraint, multi-sequence MRI are then fused using an attention mechanism to achieve three single tumor region segmentations. Considering the location relationship of the tumor regions, a new loss function is introduced to deal with the multiple class segmentation problem. Finally, a second 3D U-Net network is applied to combine and refine the three single prediction results. In each stage, only 8 initial filters are used, allowing to decrease significantly the number of parameters to be estimated. We evaluated our method on BraTS 2017 dataset. The results are promising in terms of dice score, hausdorff distance, and the amount of memory required for training.
Year
DOI
Venue
2020
10.1016/j.compmedimag.2020.101811
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS
Keywords
DocType
Volume
Brain tumor segmentation, Fusion, Context constraint, Attention mechanism
Journal
86
ISSN
Citations 
PageRank 
0895-6111
0
0.34
References 
Authors
0
3
Name
Order
Citations
PageRank
Tongxue Zhou1222.94
Stéphane Canu282782.61
Ruan Su355953.00