Title
Canonical Dual Approach to Binary Factor Analysis
Abstract
Binary Factor Analysis (BFA) is a typical problem of Independent Component Analysis (ICA) where the signal sources are binary. Parameter learning and model selection in BFA are computationally intractable because of the combinatorial complexity. This paper aims at an efficient approach to BFA. For parameter learning, an unconstrained binary quadratic programming (BQP) is reduced to a canonical dual problem with low computational complexity; for model selection, we adopt the Bayesian Ying-Yang (BYY) framework to make model selection automatically during learning. In the experiments, the proposed approach cdual shows superior performance. Another BQP approximation round is also good in model selection and is more efficient. Two other methods, greedy and enum , are more accurate in BQP but fail to compete with cdual and round in BFA. We conclude that a good optimization is essential in a learning process, but the key task of learning is not simply optimization and an over-accurate optimization may not be preferred.
Year
DOI
Venue
2009
10.1007/978-3-642-00599-2_44
ICA
Keywords
Field
DocType
efficient approach,canonical dual problem,good optimization,combinatorial complexity,independent component analysis,bqp approximation round,binary factor analysis,over-accurate optimization,parameter learning,canonical dual approach,model selection,computational complexity,quadratic program,factor analysis
Mathematical optimization,Model selection,Parameter learning,Duality (optimization),Independent component analysis,Mathematics,Bayesian probability,Computational complexity theory,Binary number,BQP
Conference
Volume
ISSN
Citations 
5441
0302-9743
1
PageRank 
References 
Authors
0.36
9
4
Name
Order
Citations
PageRank
Ke Sun116321.00
Shikui Tu23914.25
David Yang Gao317921.41
Lei Xu43590387.32