Title
Joint Motion Segmentation and Background Estimation in Dynamic Scenes
Abstract
We propose a joint foreground-background mixture model (FBM) that simultaneously performs background estimation and motion segmentation in complex dynamic scenes. Our FBM consist of a set of location-specific dynamic texture (DT) components, for modeling local background motion, and set of global DT components, for modeling consistent foreground motion. We derive an EM algorithm for estimating the parameters of the FBM. We also apply spatial constraints to the FBM using an Markov random field grid, and derive a corresponding variational approximation for inference. Unlike existing approaches to background subtraction, our FBM does not require a manually selected threshold or a separate training video. Unlike existing motion segmentation techniques, our FBM can segment foreground motions over complex background with mixed motions, and detect stopped objects. Since most dynamic scene datasets only contain videos with a single foreground object over a simple background, we develop a new challenging dataset with multiple foreground objects over complex dynamic backgrounds. In experiments, we show that jointly modeling the background and foreground segments with FBM yields significant improvements in accuracy on both background estimation and motion segmentation, compared to state-of-the-art methods.
Year
DOI
Venue
2014
10.1109/CVPR.2014.54
Computer Vision and Pattern Recognition
Keywords
Field
DocType
Markov processes,image segmentation,image texture,mixture models,motion estimation,object detection,video signal processing,EM algorithm,FBM,FBM parameters estimation,Markov random field grid,background estimation,background subtraction,complex dynamic scenes,dynamic scenes,foreground-background mixture model,global DT components,inference,joint motion segmentation,local back-ground motion,location-specific dynamic texture components,motion segmentation techniques,simple background,spatial constraints,state-of-the-art methods,variational approximation,Background estimation,Dynamic texture,Motion segmentation
Background subtraction,Computer vision,Pattern recognition,Computer science,Segmentation,Markov random field,Inference,Expectation–maximization algorithm,Artificial intelligence,Grid,Mixture model
Conference
ISSN
Citations 
PageRank 
1063-6919
10
0.48
References 
Authors
18
3
Name
Order
Citations
PageRank
Adeel Mumtaz1472.42
Weichen Zhang2162.63
Antoni B. Chan3165888.09