Title
Interactive video segmentation using occlusion boundaries and temporally coherent superpixels
Abstract
We propose an interactive video segmentation system built on the basis of occlusion and long term spatio-temporal structure cues. User supervision is incorporated in a superpixel graph clustering framework that differs crucially from prior art in that it modifies the graph according to the output of an occlusion boundary detector. Working with long temporal intervals (up to 100 frames) enables our system to significantly reduce annotation effort with respect to state of the art systems. Even though the segmentation results are less than perfect, they are obtained efficiently and can be used in weakly supervised learning from video or for video content description. We do not rely on a discriminative object appearance model and allow extracting multiple foreground objects together, saving user time if more than one object is present. Additional experiments with unsupervised clustering based on occlusion boundaries demonstrate the importance of this cue for video segmentation and thus validate our system design.
Year
DOI
Venue
2014
10.1109/WACV.2014.6836023
Applications of Computer Vision
Keywords
Field
DocType
image segmentation,pattern clustering,spatiotemporal phenomena,video signal processing,discriminative object appearance model,interactive video segmentation system,multiple foreground object extraction,occlusion boundary detector,spatiotemporal structure cues,superpixel graph clustering framework,temporally coherent superpixels,unsupervised clustering,video content description
Computer vision,Scale-space segmentation,Pattern recognition,Segmentation,Range segmentation,Computer science,Image texture,Segmentation-based object categorization,Image segmentation,Region growing,Artificial intelligence,Minimum spanning tree-based segmentation
Conference
ISSN
Citations 
PageRank 
2472-6737
4
0.40
References 
Authors
18
4
Name
Order
Citations
PageRank
Radu Dondera140.40
Vlad I. Morariu244128.13
Yulu Wang3152.23
Larry S. Davis4142012690.83