Title
On-line EM Variants for Multivariate Normal Mixture Model in Background Learning and Moving Foreground Detection
Abstract
The unsupervised learning of multivariate mixture models from on-line data streams has attracted the attention of researchers for its usefulness in real-time intelligent learning systems. The EM algorithm is an ideal choice for iteratively obtaining maximum likelihood estimation of parameters in presumable finite mixtures, comparing to some popular numerical methods. However, the original EM is a batch algorithm that works only on fixed datasets. To endow the EM algorithm with the capability to process streaming data, two on-line variants are studied, including Titterington's method and a sufficient statistics-based method. We first prove that the two on-line EM variants are theoretically feasible for training the multivariate normal mixture model by showing that the model belongs to the exponential family. Afterward, the two on-line learning schemes for multivariate normal mixtures are applied to the problems of background learning and moving foreground detection. Experiments show that the two on-line EM variants can efficiently update the parameters of the mixture model and are capable of generating reliable backgrounds for moving foreground detection.
Year
DOI
Venue
2014
10.1007/s10851-012-0403-6
Journal of Mathematical Imaging and Vision
Keywords
Field
DocType
Multivariate normal mixture,Maximum likelihood estimation,Newton-Raphson,Fisher information matrix,On-line EM algorithm,Background learning,Foreground detection
Data stream mining,Pattern recognition,Multivariate statistics,Expectation–maximization algorithm,Exponential family,Foreground detection,Unsupervised learning,Multivariate normal distribution,Artificial intelligence,Mathematics,Mixture model
Journal
Volume
Issue
ISSN
48
1
0924-9907
Citations 
PageRank 
References 
3
0.40
13
Authors
3
Name
Order
Citations
PageRank
Dawei Li1533.77
Lihong Xu234436.70
Erik Goodman314515.19