Title
Efficient Quality Threshold Clustering for Parallel Architectures
Abstract
Quality Threshold Clustering (QTC) is an algorithm for partitioning data, in fields such as biology, where clustering of large data-sets can aid scientific discovery. Unlike other clustering algorithms, QTC does not require knowing the number of clusters a priori, however, its perceived need for high computing power often makes it an unattractive choice. This paper presents a thorough study of QTC. We analyze the worst case complexity of the algorithm and discuss methods to reduce it by trading memory for computation. We also demonstrate how the expected running time of QTC is affected by the structure of the input data. We describe how QTC can be parallelized, and discuss implementation details of our thread-parallel, GPU, and distributed memory implementations of the algorithm. We demonstrate the efficiency of our implementations through experimental data. We show how data sets with tens of thousands of elements can be clustered in a matter of minutes in a modern GPU, and seconds in a small scale cluster of multi-core CPUs, or multiple GPUs. Finally, we discuss how user selected parameters, as well as algorithmic and implementation choices, affect performance.
Year
DOI
Venue
2012
10.1109/IPDPS.2012.99
Parallel & Distributed Processing Symposium
Keywords
Field
DocType
computational complexity,distributed memory systems,graphics processing units,multi-threading,parallel architectures,pattern clustering,QTC,clustering algorithms,distributed memory implementations,large data-sets clustering,multicore CPU,multiple GPU,parallel architectures,partitioning data,quality threshold clustering,running time,scientific discovery,small scale cluster,thread-parallel,user selected parameters,worst case complexity,GPU,QT-clustering,complexity,distributed,multi-core
Algorithm design,Computer science,Parallel computing,Distributed memory,Memory management,Graphics processing unit,Cluster analysis,Worst-case complexity,Multi-core processor,Computational complexity theory,Distributed computing
Conference
ISSN
ISBN
Citations 
1530-2075
978-1-4673-0975-2
4
PageRank 
References 
Authors
0.50
5
3
Name
Order
Citations
PageRank
Anthony Danalis156331.51
Collin McCurdy242727.04
Vetter, Jeffrey32383186.44