Paper Info
Title
Resource management for bursty streams on multi-tenancy cloud environments.
Abstract
The number of applications that need to process data continuously over long periods of time has increased significantly over recent years. The emerging Internet of Things and Smart Cities scenarios also confirm the requirement for real time, large scale data processing. When data from multiple sources are processed over a shared distributed computing infrastructure, it is necessary to provide some Quality of Service (QoS) guarantees for each data stream, specified in a Service Level Agreement (SLA). SLAs identify the price that a user must pay to achieve the required QoS, and the penalty that the provider will pay the user in case of QoS violation. Assuming maximization of revenue as a Cloud provider’s objective, then it must decide which streams to accept for storage and analysis; and how many resources to allocate for each stream. When the real-time requirements demand a rapid reaction, dynamic resource provisioning policies and mechanisms may not be useful, since the delays and overheads incurred might be too high. Alternatively, idle resources that were initially allocated for other streams could be re-allocated, avoiding subsequent penalties. In this paper, we propose a system architecture for supporting QoS for concurrent data streams to be composed of self-regulating nodes. Each node features an envelope process for regulating and controlling data access and a resource manager to enable resource allocation, and selective SLA violations, while maximizing revenue. Our resource manager, based on a shared token bucket, enables: (i) the re-distribution of unused resources amongst data streams; and (ii) a dynamic re-allocation of resources to streams likely to generate greater profit for the provider. We extend previous work by providing a Petri-net based model of system components, and we evaluate our approach on an OpenNebula-based Cloud infrastructure.
Year
DOI
Venue
2016
10.1016/j.future.2015.03.012
Future Generation Computer Systems
Keywords
Field
DocType
Data stream processing,Cloud computing,Profit-based resource management,SLA management,Admission control,QoS provisioning
Resource management,Token bucket,Data stream mining,Computer science,Service-level agreement,Computer network,Quality of service,Real-time computing,Provisioning,Resource allocation,Distributed computing,Cloud computing
Journal
Volume
ISSN
Citations 
55
0167-739X
10
PageRank 
References 
Authors
0.49
34
4
Name
Order
Citations
PageRank
Rafael Tolosana-Calasanz116618.52
J. A. Bañares2878.80
CongDuc Pham323233.56
Omer F. Rana42181229.52