Name
Abstract | ||
|---|---|---|
With an increase in the number of monitoring sensors deployed on physical infrastructures, there is a corresponding increase in data volumes that need to be processed. Data measured or collected by sensors is typically processed at destination or "in-transit" (i.e. from data capture to delivery to a user). When such data are processed in-transit over a shared distributed computing infrastructure, it is useful to provide elastic computational capability which can be adapted based on processing requirements and demand. Where Service Level Agreements (SLAs) have been pre-agreed, such available computational capacity needs to be shared in such a way that any Quality of Service related constraints in such SLAs are not violated. This is particularly challenging for time critical applications and with highly variable and unpredictable rates of data generation (e.g. in Smart Grid applications where energy usage patterns may change unpredictably). Previously, we proposed a Reference net based architectural model for supporting QoS for multiple concurrent data streams being processed (prior to delivery to a user) over a shared infrastructure. In this paper, we describe a practical realisation of this architecture using the Open Nebula Cloud platform. We consider our infrastructure to be composed of a number of nodes, each of which has multiple processing units and data buffers. We utilize the "token bucket" model for regulating, on a per stream basis, the data injection rate into each node. We subsequently demonstrate how a streaming pipeline can be supported and managed using a dynamic control strategy at each node. |
Year | DOI | Venue |
|---|---|---|
2014 | 10.1109/CCGrid.2014.50 | Cluster, Cloud and Grid Computing |
Keywords | DocType | ISSN |
cloud computing,data handling,public domain software,quality of service,sensors,OpenNebula-based shared clouds,concurrent data streams,data buffers,data generation,data injection rate,data volumes,dynamic control strategy,elastic computational capability,in-transit data processing,monitoring sensors,multiple processing units,quality of service,reference net based architectural model,service level agreements,shared distributed computing infrastructure,smart grid applications,streaming pipeline,token bucket model,smart metering,stream processing,token-bucket rate adaptation | Conference | 2376-4414 |
Citations | PageRank | References |
0 | 0.34 | 3 |
Authors | ||
9 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Rafael Tolosana-Calasanz | 1 | 166 | 18.52 |
| J. A. Bañares | 2 | 87 | 8.80 |
| Omer F. Rana | 3 | 2181 | 229.52 |
| CongDuc Pham | 4 | 232 | 33.56 |
| Erotokritos Xydas | 5 | 1 | 1.02 |
| Charalampos E. Marmaras | 6 | 1 | 0.68 |
| Panagiotis Papadopoulos | 7 | 30 | 8.42 |
| Liana Cipcigan | 8 | 8 | 3.57 |
| Tolosana-Calasanz, R. | 9 | 0 | 0.34 |