Name
Title | ||
|---|---|---|
A dynamic and adaptive load balancing strategy for parallel file system with large-scale I/O servers |
Abstract | ||
|---|---|---|
Many solutions have been proposed to tackle the load imbalance issue of parallel file systems. However, all these solutions either adopt centralized algorithms, or lack considerations for both the network transmission and the tradeoff between benefits and side-effects of each dynamic file migration. Therefore, existing solutions will be prohibitively inefficient in large-scale parallel file systems. To address this problem, this paper presents SALB, a dynamic and adaptive load balancing algorithm which is totally based on a distributed architecture. To be also aware of the network transmission, SALB on the one hand adopts an adaptively adjusted load collection threshold in order to reduce the message exchanges for load collection, and on the other hand it employs an on-line load prediction model with a view to reducing the decision delay caused by the network transmission latency. Moreover, SALB employs an optimization model for selecting the migration candidates so as to balance the benefits and the side-effects of each dynamic file migration. Extensive experiments are conducted to prove the effectiveness of SALB. The results show that SALB achieves an optimal performance not only on the mean response time but also on the resource utilization among the schemes for comparison. The simulation results also indicate that SALB is able to deliver high scalability. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1016/j.jpdc.2012.05.006 | J. Parallel Distrib. Comput. |
Keywords | Field | DocType |
migration candidate,parallel file system,large-scale parallel file system,o server,load imbalance issue,adaptive load,on-line load prediction model,network transmission,adaptively adjusted load collection,load collection,dynamic file migration | Mean and predicted response,File system,Network Load Balancing Services,Load balancing (computing),Computer science,Parallel computing,Server,Input/output,Adaptive algorithm,Distributed computing,Scalability | Journal |
Volume | Issue | ISSN |
72 | 10 | 0743-7315 |
Citations | PageRank | References |
15 | 0.65 | 44 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Bin Dong | 1 | 17 | 1.07 |
| Xiuqiao Li | 2 | 51 | 5.74 |
| Qimeng Wu | 3 | 17 | 1.71 |
| Limin Xiao | 4 | 107 | 28.51 |
| Li Ruan | 5 | 123 | 25.10 |