Title
On a Minimal Spanning Tree Approach in the Cluster Validation Problem
Abstract
In this paper, a method for the study of cluster stability is purposed. We draw pairs of samples from the data, according to two sampling distributions. The first distribution corresponds to the high density zones of data-elements distribution. Thus it is associated with the clusters cores. The second one, associated with the cluster margins, is related to the low density zones. The samples are clustered and the two obtained partitions are compared. The partitions are considered to be consistent if the obtained clusters are similar. The resemblance is measured by the total number of edges, in the clusters minimal spanning trees, connecting points from different samples. We use the Friedman and Rafsky two sample test statistic. Under the homogeneity hypothesis, this statistic is normally distributed. Thus, it can be expected that the true number of clusters corresponds to the statistic empirical distribution which is closest to normal. Numerical experiments demonstrate the ability of the approach to detect the true number of clusters.
Year
Venue
Keywords
2009
Informatica, Lith. Acad. Sci.
clusters corresponds,total number,data-elements distribution,statistic empirical distribution,minimal spanning tr ee two sample test,distribution corresponds,cluster margin,true number,sample test statistic,sampling distribution,cluster validation,clusters core,minimal spanning tree approach,cluster validation problem,clustering,minimal spanning tree,empirical distribution
Field
DocType
Volume
Sampling distribution,Discrete mathematics,Cluster (physics),Combinatorics,Homogeneity (statistics),Empirical distribution function,Test statistic,Statistic,Spanning tree,Mathematics,Minimum spanning tree
Journal
20
Issue
ISSN
Citations 
2
0868-4952
14
PageRank 
References 
Authors
0.67
8
4
Name
Order
Citations
PageRank
Zeev Barzily1141.00
Z. Volkovich27413.19
Başak Akteke-Öztürk3140.67
Gerhard-wilhelm Weber421036.23