Name
Abstract | ||
|---|---|---|
A combinatorial random variable is a discrete random variable defined over a combinatorial set (e.g., a power set of a given set). In this paper we introduce combinatorial Markov random fields (Comrafs), which are Markov random fields where some of the nodes are combinatorial random variables. We argue that Comrafs are powerful models for unsupervised and semi-supervised learning. We put Comrafs in perspective by showing their relationship with several existing models. Since it can be problematic to apply existing inference techniques for graphical models to Comrafs, we design two simple and efficient inference algorithms specific for Comrafs, which are based on combinatorial optimization. We show that even such simple algorithms consistently and significantly outperform Latent Dirichlet Allocation (LDA) on a document clustering task. We then present Comraf models for semi-supervised clustering and transfer learning that demonstrate superior results in comparison to an existing semi-supervised scheme (constrained optimization). |
Year | DOI | Venue |
|---|---|---|
2006 | 10.1007/11871842_8 | ECML |
Keywords | Field | DocType |
document clustering,semi supervised learning,latent dirichlet allocation,transfer learning,constrained optimization,random variable,combinatorial optimization | Markov process,Computer science,Theoretical computer science,Artificial intelligence,Cluster analysis,Optimization problem,Discrete mathematics,Random field,Markov chain,Combinatorial optimization,Variable-order Markov model,Graphical model,Machine learning | Conference |
Volume | ISSN | ISBN |
4212 | 0302-9743 | 3-540-45375-X |
Citations | PageRank | References |
6 | 0.51 | 11 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Ron Bekkerman | 1 | 721 | 56.55 |
| Mehran Sahami | 2 | 4138 | 556.74 |
| Erik G. Miller | 3 | 1861 | 126.56 |