Paper Info
Title
Learning local factor analysis versus mixture of factor analyzers with automatic model selection
Abstract
Considering Factor Analysis (FA) for each component of Gaussian Mixture Model (GMM), clustering and local dimensionality reduction can be addressed simultaneously by Mixture of Factor Analyzers (MFA) and Local Factor Analysis (LFA), which correspond to two FA parameterizations, respectively. This paper investigates the performance of Variational Bayes (VB) and Bayesian Ying-Yang (BYY) harmony learning on MFA/LFA for the problem of automatically determining the component number and the local hidden dimensionalities (i.e., the number of factors of FA in each component). Similar to the existing VB learning algorithm on MFA, we develop an alternative VB algorithm on LFA with a similar conjugate Dirichlet-Normal-Gamma (DNG) prior on all parameters of LFA. Also, the corresponding BYY algorithms are developed for MFA and LFA. A wide range of synthetic experiments shows that LFA is superior to MFA in model selection under either VB or BYY, while BYY outperforms VB reliably on both MFA and LFA. These empirical findings are consistently observed from real applications on not only face and handwritten digit images clustering, but also unsupervised image segmentation.
Year
DOI
Venue
2014
10.1016/j.neucom.2013.09.061
Neurocomputing
Keywords
Field
DocType
mixture of factor analyzers,local factor analysis,bayesian ying-yang,automatic model selection,dirichlet-normal-gamma,variational bayes
Dimensionality reduction,Pattern recognition,Model selection,Image segmentation,Artificial intelligence,Cluster analysis,Mathematics,Machine learning,Mixture model,Bayesian probability,Bayes' theorem
Journal
Volume
Issue
ISSN
139
1
0925-2312
Citations 
PageRank 
References 
3
0.39
15
Authors
4
Name
Order
Citations
PageRank
Lei Shi11106.76
Zhiyong Liu265975.59
Shikui Tu33914.25
Lei Xu43590387.32