Title
A redundancy-based measure of dissimilarity among probability distributions for hierarchical clustering criteria.
Abstract
We introduce novel dissimilarity into a probabilistic clustering task to properly measure dissimilarity among multiple clusters when each cluster is characterized by a subpopulation in the mixture model. This measure of dissimilarity is called redundancy-based dissimilarity among probability distributions. From aspects of both source coding and a statistical hypothesis test, we shed light on several of the theoretical reasons for the redundancy-based dissimilarity among probability distributions being a reasonable measure of dissimilarity among clusters. We also elucidate a principle in common for the measures of redundancy-based dissimilarity and Ward's method in terms of hierarchical clustering criteria. Moreover, we show several related theorems that are significant for clustering tasks. In the experiments, properties of the measure of redundancy-based dissimilarity are examined in comparison with several other measures.
Year
DOI
Venue
2008
10.1109/TPAMI.2007.1160
IEEE Trans. Pattern Anal. Mach. Intell.
Keywords
Field
DocType
probabilistic clustering task,related theorem,redundancy-based dissimilarity,multiple cluster,hierarchical clustering criterion,reasonable measure,novel dissimilarity,probability distributions,probability distribution,clustering task,mixture model,hierarchical clustering criteria,redundancy-based measure,clustering,source coding,statistical hypothesis testing,ward s method,statistical testing,source code,statistical hypothesis test,image processing,image analysis,hierarchical clustering,information theory,euclidean distance,testing,statistical distributions,shape
Information theory,Hierarchical clustering,Pattern recognition,Computer science,Ward's method,Redundancy (engineering),Probability distribution,Artificial intelligence,Cluster analysis,Statistical hypothesis testing,Mixture model
Journal
Volume
Issue
ISSN
30
1
0162-8828
Citations 
PageRank 
References 
3
0.41
18
Authors
2
Name
Order
Citations
PageRank
Kazunori Iwata18029.80
Akira Hayashi2519.08