Title
Elastic resource provisioning for scientific workflow scheduling in cloud under budget and deadline constraints.
Abstract
With the popularization and development of cloud computing, lots of scientific computing applications are conducted in cloud environments. However, current application scenario of scientific computing is also becoming increasingly dynamic and complicated, such as unpredictable submission times of jobs, different priorities of jobs, deadlines and budget constraints of executing jobs. Thus, how to perform scientific computing efficiently in cloud has become an urgent problem. To address this problem, we design an elastic resource provisioning and task scheduling mechanism to perform scientific workflow jobs in cloud. The goal of this mechanism is to complete as many high-priority workflow jobs as possible under budget and deadline constraints. This mechanism consists of four steps: job preprocessing, job admission control, elastic resource provisioning and task scheduling. We perform the evaluation with four kinds of real scientific workflow jobs under different budget constraints. We also consider the uncertainties of task runtime estimations, provisioning delays, and failures in evaluation. The results show that in most cases our mechanism achieves a better performance than other mechanisms. In addition, the uncertainties of task runtime estimations, VM provisioning delays, and task failures do not have major impact on the mechanism's performance.
Year
DOI
Venue
2016
10.1007/s10586-015-0530-0
Cluster Computing
Keywords
Field
DocType
Cloud,Scientific workflow,Elastic scaling,Resource provisioning,Task scheduling,Budget-constraint,Deadline-constraint
Budget constraint,Admission control,Scheduling (computing),Computer science,Provisioning,Real-time computing,Preprocessor,Workflow,Workflow management system,Cloud computing,Distributed computing
Journal
Volume
Issue
ISSN
19
1
1386-7857
Citations 
PageRank 
References 
12
0.54
19
Authors
5
Name
Order
Citations
PageRank
Jiyuan Shi1192.38
Junzhou Luo21257153.97
Fang Dong320235.44
Zhang Jinghui4337.47
Junxue Zhang5193.37