Title
A user-centric dynamic cluster partitioning approach for HPC service optimization
Abstract
In this paper, we study how resources within a large high performance computing (HPC) cluster can be dynamically partitioned to optimize client utility for multiple service classes. We model service effectiveness using both perceived service quality and resources required. Using empirical data obtained from A*STAR Computational Resource Center (A*CRC), we analyze how quality metrics and statistical characteristics of HPC jobs affect user satisfaction. We derive the optimal number of processors required to achieve the maximal overall client utility in M/G/1 based clusters. Based on measured job characteristics, we propose a statistics-based client utility optimization (SCUO) algorithm, which dynamically partitions the cluster into resource groups serving different service classes. Simulations show that our proposed algorithm is able to achieve better performance with both higher client utility and higher job admission rates.
Year
DOI
Venue
2009
10.1109/PCCC.2009.5403803
IPCCC
Keywords
Field
DocType
optimisation,multiple service classes,pattern clustering,quality metrics,user-centric dynamic cluster partitioning approach,a*star computational resource center,statistical analysis,service effectiveness,high performance computing cluster,statistics-based client utility optimization,statistical characteristics,clustering algorithms,data models
Data modeling,Cluster (physics),Service quality,Supercomputer,Computer science,Computer network,Cluster analysis,Computational resource,Distributed computing,User-centered design,Statistical analysis
Conference
ISSN
ISBN
Citations 
1097-2641
978-1-4244-5737-3
1
PageRank 
References 
Authors
0.48
15
3
Name
Order
Citations
PageRank
Xiaorong Li111310.80
Terence Hung2293.82
sharad singhal31211150.87