Title | ||
---|---|---|
A redundancy-based measure of dissimilarity among probability distributions for hierarchical clustering criteria. |
Abstract | ||
---|---|---|
We introduce novel dissimilarity into a probabilistic clustering task to properly measure dissimilarity among multiple clusters when each cluster is characterized by a subpopulation in the mixture model. This measure of dissimilarity is called redundancy-based dissimilarity among probability distributions. From aspects of both source coding and a statistical hypothesis test, we shed light on several of the theoretical reasons for the redundancy-based dissimilarity among probability distributions being a reasonable measure of dissimilarity among clusters. We also elucidate a principle in common for the measures of redundancy-based dissimilarity and Ward's method in terms of hierarchical clustering criteria. Moreover, we show several related theorems that are significant for clustering tasks. In the experiments, properties of the measure of redundancy-based dissimilarity are examined in comparison with several other measures. |
Year | DOI | Venue |
---|---|---|
2008 | 10.1109/TPAMI.2007.1160 | IEEE Trans. Pattern Anal. Mach. Intell. |
Keywords | Field | DocType |
probabilistic clustering task,related theorem,redundancy-based dissimilarity,multiple cluster,hierarchical clustering criterion,reasonable measure,novel dissimilarity,probability distributions,probability distribution,clustering task,mixture model,hierarchical clustering criteria,redundancy-based measure,clustering,source coding,statistical hypothesis testing,ward s method,statistical testing,source code,statistical hypothesis test,image processing,image analysis,hierarchical clustering,information theory,euclidean distance,testing,statistical distributions,shape | Information theory,Hierarchical clustering,Pattern recognition,Computer science,Ward's method,Redundancy (engineering),Probability distribution,Artificial intelligence,Cluster analysis,Statistical hypothesis testing,Mixture model | Journal |
Volume | Issue | ISSN |
30 | 1 | 0162-8828 |
Citations | PageRank | References |
3 | 0.41 | 18 |
Authors | ||
2 |
Name | Order | Citations | PageRank |
---|---|---|---|
Kazunori Iwata | 1 | 80 | 29.80 |
Akira Hayashi | 2 | 51 | 9.08 |