Title
Local factor analysis with automatic model selection: a comparative study and digits recognition application
Abstract
A further investigation is made on an adaptive local factor analysis algorithm from Bayesian Ying-Yang (BYY) harmony learning, which makes parameter learning with automatic determination of both the component number and the factor number in each component. A comparative study has been conducted on simulated data sets and several real problem data sets. The algorithm has been compared with not only a recent approach called Incremental Mixture of Factor Analysers (IMoFA) but also the conventional two-stage implementation of maximum likelihood (ML) plus model selection, namely, using the EM algorithm for parameter learning on a series candidate models, and selecting one best candidate by AIC, CAIC, and BIC. Experiments have shown that IMoFA and ML-BIC outperform ML-AIC or ML-CAIC while the BYY harmony learning considerably outperforms IMoFA and ML-BIC. Furthermore, this BYY learning algorithm has been applied to the popular MNIST database for digits recognition with a promising performance.
Year
DOI
Venue
2006
10.1007/11840930_27
ICANN (2)
Keywords
Field
DocType
real problem data set,comparative study,adaptive local factor analysis,digits recognition application,best candidate,automatic model selection,factor number,parameter learning,harmony learning,component number,em algorithm,byy harmony,series candidate model,maximum likelihood,factor analysis,model selection
MNIST database,Pattern recognition,Expectation–maximization algorithm,Computer science,Minimum description length,Model selection,Artificial intelligence,Estimation theory,Adaptive algorithm,Artificial neural network,Mixture model,Machine learning
Conference
Volume
ISSN
ISBN
4132
0302-9743
3-540-38871-0
Citations 
PageRank 
References 
3
0.39
10
Authors
2
Name
Order
Citations
PageRank
Lei Shi11106.76
Lei Xu23590387.32