Name
Abstract | ||
|---|---|---|
Applying real-time, cost-effective Complex Event processing CEP in the cloud has been an important goal in recent years. Distributed Stream Processing Systems DSPS have been widely adopted by major computing companies such as Facebook and Twitter for performing scalable event processing in streaming data. However, dynamically balancing the load of the DSPS' components can be particularly challenging due to the high volume of data, the components' state management needs, and the low latency processing requirements. Systems should be able to cope with these challenges and adapt to dynamic and unpredictable load changes in real-time. Our approach makes the following contributions: i we formulate the load balancing problem in distributed CEP systems as an instance of the job-shop scheduling problem, and ii we present a novel framework that dynamically balances the load of CEP engines in real-time and adapts to sudden changes in the volume of streaming data by exploiting two balancing policies. Our detailed experimental evaluation using data from the Twitter social network indicates the benefits of our approach in the system's throughput. |
Year | DOI | Venue |
|---|---|---|
2016 | 10.1007/978-3-319-39577-7_14 | DAIS |
Field | DocType | Volume |
Job shop scheduling,Computer science,Load balancing (computing),Complex event processing,Real-time computing,Latency (engineering),Throughput,Stream processing,Scalability,Cloud computing,Distributed computing | Conference | 9687 |
ISSN | Citations | PageRank |
0302-9743 | 4 | 0.38 |
References | Authors | |
16 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Nikos Zacheilas | 1 | 79 | 9.40 |
| Nikolas Zygouras | 2 | 14 | 2.01 |
| Nikolaos Panagiotou | 3 | 4 | 1.06 |
| Vana Kalogeraki | 4 | 1686 | 124.40 |
| Dimitrios Gunopulos | 5 | 7171 | 715.85 |