Title | ||
---|---|---|
Performance Evaluation of A Load Self-Balancing Method for Heterogeneous Metadata Server Cluster Using Trace-Driven and Synthetic Workload Simulation |
Abstract | ||
---|---|---|
In cluster-based storage systems, the metadata server cluster must be able to adaptively distribute responsibility for metadata to maintain high system performance and long-term load balance, due to workload skew and metadata servers' heterogeneity. In this paper, we describe a simple and adaptive metadata load management scheme, called self-balancing uniform (SBU) randomization, to efficiently and continually adapt the metadata distribution to current demands in heterogeneous metadata server cluster. We implement our system within a discrete event driven simulation environment, along with two other systems, simple randomization (SR) and performance aware distribution (PAD) to serve as points of comparison, and evaluate the performance of our SBU algorithms against SR and PAD algorithms by both a trace workload and a synthetic workload. Simulation results verify that our SBU algorithm achieves load self-balance, provides consistent response latencies and resource utilization. Simulation results also indicate that SR cannot cope with skew and heterogeneity and PAD requires a larger shared state to achieve optimal performance. |
Year | DOI | Venue |
---|---|---|
2007 | 10.1109/IPDPS.2007.370595 | international parallel and distributed processing symposium |
Keywords | DocType | Volume |
discrete event simulation,resource utilization,trace-driven workload simulation,network operating systems,discrete event driven simulation environment,storage management,heterogeneous metadata server cluster,resource allocation,cluster-based storage systems,performance aware distribution,file servers,consistent response latencies,load self-balancing uniform randomization method,workstation clusters,meta data,synthetic workload simulation,system performance,computer simulation,strontium,clustering algorithms,storage system,load balance,computer science,computational modeling | Conference | null |
Issue | ISBN | Citations |
null | 1-4244-0910-1 | 0 |
PageRank | References | Authors |
0.34 | 20 | 3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Bin Cai | 1 | 0 | 0.34 |
Changsheng Xie | 2 | 25 | 6.27 |
Guangxi Zhu | 3 | 437 | 49.06 |