Paper Info
Title
Tax-Based Mechanisms for Resource Scaling-Out of Stream Big Data Analytics
Abstract
Cloud-based big data platforms provide physical resources for a variety of applications to analyze all forms of data. For the stream big data analytics, a participated task always needs to scale out resources when its input data increases steeply. Typically, the resource scaling out can be achieved by increasing the parallelism degree of the platform based on the experience. However, the resource scaling-out of each task produces additional cost not only from itself but also from other competitive tasks, which brings about great challenges to ensure the efficient utilization of resources. To solve this problem systematically, we consider the resource scaling-out problem as a non-cooperative game and formulate a total cost model including a risk function and a task execution time function. The total cost of resource scaling-out reflects the influence of topology structure for the benefit of a participated task. Hence, two economic classic tax-based incentive policies: Pivotal Mechanism and Externality Mechanism are applied, to stimulate the participation of tasks. We make simulations in different scenarios including node degree and different characteristics of tasks. The simulations results show that our resource scaling-out mechanism can achieve a better performance close to social optimality.
Year
DOI
Venue
2017
10.1109/PDCAT.2017.00018
2017 18th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT)
Keywords
Field
DocType
big data,stream processing,game,incentive mechanism
Incentive,Computer science,Externality,Execution time,Big data,Scaling,Total cost,Cloud computing,Scalability,Distributed computing
Conference
ISBN
Citations 
PageRank 
978-1-5386-3152-2
0
0.34
References 
Authors
17
5
Name
Order
Citations
PageRank
Xiaoyuan Fu1142.88
J. Wang247995.23
Qi Qi321056.01
Jianxin Liao445782.08
Tonghong Li514121.89