Abstract | ||
---|---|---|
Binary Factor Analysis (BFA) is a typical problem of Independent Component Analysis (ICA) where the signal sources are binary. Parameter learning and model selection in BFA are computationally intractable because of the combinatorial complexity. This paper aims at an efficient approach to BFA. For parameter learning, an unconstrained binary quadratic programming (BQP) is reduced to a canonical dual problem with low computational complexity; for model selection, we adopt the Bayesian Ying-Yang (BYY) framework to make model selection automatically during learning. In the experiments, the proposed approach cdual shows superior performance. Another BQP approximation round is also good in model selection and is more efficient. Two other methods, greedy and enum , are more accurate in BQP but fail to compete with cdual and round in BFA. We conclude that a good optimization is essential in a learning process, but the key task of learning is not simply optimization and an over-accurate optimization may not be preferred. |
Year | DOI | Venue |
---|---|---|
2009 | 10.1007/978-3-642-00599-2_44 | ICA |
Keywords | Field | DocType |
efficient approach,canonical dual problem,good optimization,combinatorial complexity,independent component analysis,bqp approximation round,binary factor analysis,over-accurate optimization,parameter learning,canonical dual approach,model selection,computational complexity,quadratic program,factor analysis | Mathematical optimization,Model selection,Parameter learning,Duality (optimization),Independent component analysis,Mathematics,Bayesian probability,Computational complexity theory,Binary number,BQP | Conference |
Volume | ISSN | Citations |
5441 | 0302-9743 | 1 |
PageRank | References | Authors |
0.36 | 9 | 4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Ke Sun | 1 | 163 | 21.00 |
Shikui Tu | 2 | 39 | 14.25 |
David Yang Gao | 3 | 179 | 21.41 |
Lei Xu | 4 | 3590 | 387.32 |