Title
A Feature-based Approach for Dense Segmentation and Estimation of Large Disparity Motion
Abstract
We present a novel framework for motion segmentation that combines the concepts of layer-based methods and feature-based motion estimation. We estimate the initial correspondences by comparing vectors of filter outputs at interest points, from which we compute candidate scene relations via random sampling of minimal subsets of correspondences. We achieve a dense, piecewise smooth assignment of pixels to motion layers using a fast approximate graphcut algorithm based on a Markov random field formulation. We demonstrate our approach on image pairs containing large inter-frame motion and partial occlusion. The approach is efficient and it successfully segments scenes with inter-frame disparities previously beyond the scope of layer-based motion segmentation methods. We also present an extension that accounts for the case of non-planar motion, in which we use our planar motion segmentation results as an initialization for a regularized Thin Plate Spline fit. In addition, we present applications of our method to automatic object removal and to structure from motion.
Year
DOI
Venue
2006
10.1007/s11263-006-6660-3
International Journal of Computer Vision
Keywords
Field
DocType
motion segmentation,RANSAC,Markov Random Field,layer-based motion,metric labeling problem,graph cuts,periodic motion
Structure from motion,Computer vision,Thin plate spline,Motion field,Markov random field,Segmentation,Computer science,RANSAC,Artificial intelligence,Initialization,Motion estimation
Journal
Volume
Issue
ISSN
68
2
0920-5691
Citations 
PageRank 
References 
23
1.00
33
Authors
3
Name
Order
Citations
PageRank
Josh Wills11536.53
Sameer Agarwal210328478.10
Serge J. Belongie3125121010.13