Name
Abstract | ||
|---|---|---|
Size-based policies have been shown in the literature to effectively balance load and improve performance in cluster environments. Size-based policies assign jobs to servers based on the job size and their performance improvements are an outcome of separating "short" from "long" jobs, by avoiding having short jobs waiting behind long jobs for service. In this paper, we present evidence that performance improvements due to this separation quickly vanish if the arrival process to the cluster is autocorrelated. Based on our observations, we devise a new size-based policy called {\DEqAL} that still strives to separate jobs to servers according to job size but this separation is now biased by an effort to reduce performance loss due to autocorrelation in the arrival flows of jobs that are directed to each server. As a result of this bias, all servers may not be equally utilized (i.e., load in the system may be "unbalanced"), but performance benefits become significant. {\DEqAL} can be used on-line as it does not assume any a priori knowledge of the incoming workload. Extensive simulations show the effectiveness of {\DEqAL} under autocorrelated and uncorrelated arrival streams and illustrate that the policy successfully self-adjusts the degree of load unbalancing based on monitored performance measures. |
Year | DOI | Venue |
|---|---|---|
2008 | 10.1109/TPDS.2007.70775 | IEEE Trans. Parallel Distrib. Syst. |
Keywords | Field | DocType |
performance improvement,arrival flow,performance loss,arrival process,performance benefit,autocorrelated flows,size-based policy,performance-guided load,uncorrelated arrival stream,cluster environment,monitored performance measure,job size,distribution functions,autocorrelation,internet,system performance,distributed architecture,degradation,regression analysis,distribution function,a priori knowledge,load balance,resource allocation | Load management,Workload,Load balancing (computing),Computer science,A priori and a posteriori,Server,Real-time computing,Resource allocation,Autocorrelation,Distributed computing,The Internet | Journal |
Volume | Issue | ISSN |
19 | 5 | 1045-9219 |
Citations | PageRank | References |
9 | 0.58 | 19 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Qi Zhang | 1 | 414 | 22.77 |
| Ningfang Mi | 2 | 664 | 47.66 |
| Alma Riska | 3 | 683 | 48.63 |
| Evgenia Smirni | 4 | 1857 | 161.97 |