Title
A general stochastic clustering method for automatic cluster discovery
Abstract
Finding clusters in data is a challenging problem. Given a dataset, we usually do not know the number of natural clusters hidden in the dataset. The problem is exacerbated when there is little or no additional information except the data itself. This paper proposes a general stochastic clustering method that is a simplification of nature-inspired ant-based clustering approach. It begins with a basic solution and then performs stochastic search to incrementally improve the solution until the underlying clusters emerge, resulting in automatic cluster discovery in datasets. This method differs from several recent methods in that it does not require users to input the number of clusters and it makes no explicit assumption about the underlying distribution of a dataset. Our experimental results show that the proposed method performs better than several existing methods in terms of clustering accuracy and efficiency in majority of the datasets used in this study. Our theoretical analysis shows that the proposed method has linear time and space complexities, and our empirical study shows that it can accurately and efficiently discover clusters in large datasets in which many existing methods fail to run.
Year
DOI
Venue
2011
10.1016/j.patcog.2011.04.001
Pattern Recognition
Keywords
Field
DocType
automatic cluster detection,general stochastic,large datasets,basic solution,empirical study,clustering accuracy,recent method,existing method,ant-based clustering,clustering,nature-inspired ant-based clustering approach,challenging problem,automatic cluster discovery,space complexity,linear time
Data mining,Cluster (physics),Fuzzy clustering,Correlation clustering,Computer science,Signal classification,Artificial intelligence,Cluster analysis,Time complexity,Machine learning,Empirical research
Journal
Volume
Issue
ISSN
44
10-11
Pattern Recognition
Citations 
PageRank 
References 
11
0.55
29
Authors
3
Name
Order
Citations
PageRank
Swee Chuan Tan1957.21
Kai Ming Ting21572130.09
Shyh Wei Teng315121.02