Title
Anatomy Segmentation Evaluation With Sparse Ground Truth Data
Abstract
The performance and evaluation of segmentation algorithms will benefit from large fully annotated data sets, but the heavy workload of manual contouring is unrealistic in clinical and research practice. In this work, we propose a method of automatically creating pseudo ground truth (p-GT) segmentations of anatomical objects from given sparse manually annotated slices and utilize them to evaluate actual segmentations. Sparse slices are selected spatially evenly on the whole slice range of the target object, where one slice is selected to conduct manual annotation and the next t slices are skipped, repeating this process starting from one end of the object to its other end. A shape-based interpolation (SI) strategy and an object-specific 2D U-net based deep learning (DL) strategy are investigated to create p-GT. The largest t value where the created p-GT is considered to be not statistically significantly different from the actual ground with its natural imprecision due to variability in manually specified ground truth is determined as the optimal t for the considered object. Experiments are conducted on similar to 300 computed tomography (CT) studies involving two objects - cervical esophagus and mandible and two segmentation evaluation metrics - Dice Coefficient and average symmetric boundary distance. Results show that the DL strategy overwhelmingly outperforms the SI strategy, where similar to 95% and similar to 66-83% of manual workload can be reduced without sacrificing evaluation accuracy compared to actual ground truth data via the DL and SI strategies respectively. Furthermore, the p-GT with optimal t is able to evaluate actual segmentations with accurate metric values.
Year
DOI
Venue
2020
10.1117/12.2549327
MEDICAL IMAGING 2020: IMAGE PROCESSING
Keywords
DocType
Volume
medical image segmentation, segmentation evaluation, sparse ground truth, deep learning
Conference
11313
ISSN
Citations 
PageRank 
0277-786X
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Jieyu Li134.80
Jayaram K. Udupa22481322.29
Yubing Tong39322.73
Lisheng Wang4209.08
D. A. Torigian58121.68