Name
Title | ||
|---|---|---|
Learning Latent Variable Models by Improving Spectral Solutions with Exterior Point Method. |
Abstract | ||
|---|---|---|
Probabilistic latent-variable models are a fundamental tool in statistics and machine learning. Despite their widespread use, identifying the parameters of basic latent variable models continues to be an extremely challenging problem. Traditional maximum likelihood-based learning algorithms find valid parameters, but suffer from high computational cost, slow convergence, and local optima. In contrast, recently developed spectral algorithms are computationally efficient and provide strong statistical guarantees, but are not guaranteed to find valid parameters. In this work, we introduce a two-stage learning algorithm for latent variable models. We first use a spectral method of moments algorithm to find a solution that is close to the optimal solution but not necessarily in the valid set of model parameters. We then incrementally refine the solution via an exterior point method until a local optima that is arbitrarily near the valid set of parameters is found. We perform several experiments on synthetic and real-world data and show that our approach is more accurate than previous work, especially when training data is limited. |
Year | Venue | Field |
|---|---|---|
2015 | UAI | Training set,Convergence (routing),Mathematical optimization,Local optimum,Computer science,Maximum likelihood,Latent variable,Artificial intelligence,Spectral method,Probabilistic logic,Machine learning |
DocType | Citations | PageRank |
Conference | 7 | 0.50 |
References | Authors | |
15 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Amirreza Shaban | 1 | 48 | 5.60 |
| Mehrdad Farajtabar | 2 | 230 | 20.70 |
| Bo Xie 0002 | 3 | 94 | 5.19 |
| Le Song | 4 | 2437 | 159.27 |
| Byron Boots | 5 | 471 | 50.73 |