Abstract | ||
---|---|---|
Our main contribution is to propose a novel model selection methodology, expectation minimization of description length (EMDL), based on the minimum description length (MDL) principle. EMDL makes a significant impact on the combinatorial scalability issue pertaining to the model selection for mixture models having types of components. A goal of such problems is to optimize types of components as well as the number of components. One key idea in EMDL is to iterate calculations of the posterior of latent variables and minimization of expected description length of both observed data and latent variables. This enables EMDL to compute the optimal model in linear time with respect to both the number of components and the number of available types of components despite the fact that the number of model candidates exponentially increases with the numbers. We prove that EMDL is compliant with the MDL principle and enjoys its statistical benefits. |
Year | DOI | Venue |
---|---|---|
2009 | 10.1007/978-3-642-05224-8_8 | ACML |
Keywords | Field | DocType |
heterogeneous components,model candidates exponentially increase,optimal model,novel model selection methodology,description length,latent variable,minimum description length,expected description length,mixture model,mdl principle,model selection,linear time model selection,linear time | Mathematical optimization,Computer science,Minimum description length,Model selection,Latent variable,Minification,Time complexity,Mixture model,Exponential growth,Scalability | Conference |
Volume | ISSN | Citations |
5828 | 0302-9743 | 1 |
PageRank | References | Authors |
0.37 | 10 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Ryohei Fujimaki | 1 | 193 | 16.93 |
Satoshi Morinaga | 2 | 288 | 46.89 |
Michinari Momma | 3 | 146 | 16.77 |
Kenji Aoki | 4 | 1 | 0.37 |
Takayuki Nakata | 5 | 65 | 6.79 |