Name
Abstract | ||
|---|---|---|
When users submit new queries to a distributed stream processing system (DSPS), a query planner must allocate physical resources, such as CPU cores, memory and network bandwidth, from a set of hosts to queries. Allocation decisions must provide the correct mix of resources required by queries, while achieving an efficient overall allocation to scale in the number of admitted queries. By exploiting overlap between queries and reusing partial results, a query planner can conserve resources but has to carry out more complex planning decisions. In this paper, we describe SQPR, a query planner that targets DSPSs in data centre environments with heterogeneous resources. SQPR models query admission, allocation and reuse as a single constrained optimisation problem and solves an approximate version to achieve scalability. It prevents individual resources from becoming bottlenecks by re-planning past allocation decisions and supports different allocation objectives. As our experimental evaluation in comparison with a state-of-the-art planner shows SQPR makes efficient resource allocation decisions, even with a high utilisation of resources, with acceptable overheads. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.1109/ICDE.2011.5767851 | ICDE |
Keywords | Field | DocType |
query admission,efficient resource allocation decision,state-of-the-art planner,new query,different allocation objective,stream query planning,query planner,past allocation decision,allocation decision,efficient overall allocation,sqpr model,planning,digital signal processing,stream processing,resource management,optimization,bandwidth,distributed processing,resource manager,resource allocation | Resource management,Computer science,Reuse,Planner,Resource allocation,Stream processing,Data center,Multi-core processor,Database,Distributed computing,Scalability | Conference |
ISSN | Citations | PageRank |
1084-4627 | 25 | 0.99 |
References | Authors | |
22 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Evangelia Kalyvianaki | 1 | 260 | 12.31 |
| Wolfram Wiesemann | 2 | 416 | 21.96 |
| Quang Hieu Vu | 3 | 542 | 24.63 |
| Daniel Kuhn | 4 | 559 | 32.80 |
| Peter Pietzuch | 5 | 1869 | 106.77 |