Title
Pull the Plug? Predicting If Computers or Humans Should Segment Images
Abstract
Foreground object segmentation is a critical step for many image analysis tasks. While automated methods can produce high-quality results, their failures disappoint users in need of practical solutions. We propose a resource allocation framework for predicting how best to allocate a fixed budget of human annotation effort in order to collect higher quality segmentations for a given batch of images and automated methods. The framework is based on a proposed prediction module that estimates the quality of given algorithm-drawn segmentations. We demonstrate the value of the framework for two novel tasks related to "pulling the plug" on computer and human annotators. Specifically, we implement two systems that automatically decide, for a batch of images, when to replace 1) humans with computers to create coarse segmentations required to initialize segmentation tools and 2) computers with humans to create final, fine-grained segmentations. Experiments demonstrate the advantage of relying on a mix of human and computer efforts over relying on either resource alone for segmenting objects in three diverse datasets representing visible, phase contrast microscopy, and fluorescence microscopy images.
Year
DOI
Venue
2016
10.1109/CVPR.2016.48
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Keywords
Field
DocType
fluorescence microscopy images,phase contrast microscopy images,visible images,fine-grained segmentations,human annotators,computer annotators,pulling the plug,algorithm-drawn segmentation quality estimation,prediction module,human annotation effort,resource allocation framework,image analysis,image segmentation
Phase contrast microscopy,Computer vision,Scale-space segmentation,Market segmentation,Annotation,Segmentation,Computer science,Segmentation-based object categorization,Image segmentation,Resource allocation,Artificial intelligence,Machine learning
Conference
Volume
Issue
ISSN
2016
1
1063-6919
ISBN
Citations 
PageRank 
978-1-4673-8852-8
1
0.35
References 
Authors
22
4
Name
Order
Citations
PageRank
Danna Gurari14310.61
Suyog Dutt Jain21085.48
Margrit Betke387579.80
Kristen Grauman46258326.34