Title
Effective user guidance in online interactive semantic segmentation.
Abstract
With the recent success of machine learning based solutions for automatic image parsing, the availability of reference image annotations for algorithm training is one of the major bottlenecks in medical image segmentation. We are interested in interactive semantic segmentation methods that can be used in an online fashion to generate expert segmentations. These can be used to train automated segmentation techniques or, from an application perspective, for quick and accurate tumor progression monitoring. Using simulated user interactions in a MRI glioblastoma segmentation task, we show that if the user possesses knowledge of the correct segmentation it is significantly (p <= 0.009) better to present data and current segmentation to the user in such a manner that they can easily identify falsely classified regions compared to guiding the user to regions where the classifier exhibits high uncertainty, resulting in differences of mean Dice scores between +0.070 (Whole tumor) and +0.136 (Tumor Core) after 20 iterations. The annotation process should cover all classes equally, which results in a significant (p <= 0.002) improvement compared to completely random annotations anywhere in falsely classified regions for small tumor regions such as the necrotic tumor core (mean Dice +0.151 after 20 it.) and non-enhancing abnormalities (mean Dice +0.069 after 20 it.). These findings provide important insights for the development of efficient interactive segmentation systems and user interfaces.
Year
DOI
Venue
2017
10.1117/12.2255848
Proceedings of SPIE
Keywords
Field
DocType
Glioblastoma,Segmentation,Interactive,Guided,Online
Computer vision,Scale-space segmentation,Annotation,Segmentation,Computer science,Segmentation-based object categorization,Image segmentation,Artificial intelligence,User interface,Dice,Classifier (linguistics),Machine learning
Conference
Volume
ISSN
Citations 
10134
0277-786X
1
PageRank 
References 
Authors
0.35
8
5
Name
Order
Citations
PageRank
Jens Petersen113518.12
Martin Bendszus2736.73
Jürgen Debus383.23
Sabine Heiland442.81
Klaus H. Maier-Hein536142.06