Name
Abstract | ||
|---|---|---|
Distributed and parallel computing environments are becoming cheap and commonplace. The availability of large numbers of CPUýs makes it possible to process more data at higher speeds. Stream-processing systems are also becoming more important, as broad classes of applications require results in real-time. Since load can vary in unpredictable ways, exploiting the abundant processor cycles requires effective dynamic load distribution techniques. Although load distribution has been extensively studied for the traditional pull-based systems, it has not yet been fully studied in the context of push-based continuous query processing. In this paper, we present a correlation based load distribution algorithm that aims at avoiding overload and minimizing end-to-end latency by minimizing load variance and maximizing load correlation. While finding the optimal solution for such a problem is NP-hard, our greedy algorithm can find reasonable solutions in polynomial time. We present both a global algorithm for initial load distribution and a pair-wise algorithm for dynamic load migration. |
Year | DOI | Venue |
|---|---|---|
2005 | 10.1109/ICDE.2005.53 | ICDE |
Keywords | Field | DocType |
borealis stream processor,dynamic load migration,initial load distribution,effective dynamic load distribution,global algorithm,load distribution algorithm,load distribution,greedy algorithm,load variance,dynamic load distribution,pair-wise algorithm,load correlation,real time systems,resource allocation,real time,polynomials,parallel computer,stream processing,distributed databases,np hard problem,data processing,parallel processing,distributed computing environment,greedy algorithms,fluctuations | Estimation of distribution algorithm,Latency (engineering),Dynamic load testing,Computer science,Greedy algorithm,Resource allocation,Distributed database,Stream processing,Time complexity,Distributed computing | Conference |
ISSN | ISBN | Citations |
1084-4627 | 0-7695-2285-8 | 135 |
PageRank | References | Authors |
5.26 | 15 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Ying Xing | 1 | 1371 | 71.63 |
| Stanley B. Zdonik | 2 | 9186 | 1660.15 |
| Jeong-Hyon Hwang | 3 | 1300 | 63.91 |