Paper Info
Title
A Dynamic Hybrid Resource Provisioning Approach for Running Large-Scale Computational Applications on Cloud Spot and On-Demand Instances
Abstract
Testing and executing large-scale computational applications in public clouds is becoming prevalent due to cost saving, elasticity, and scalability. However, how to increase the reliability and reduce the cost to run large-scale applications in public clouds is still a big challenge. In this paper, we analyzed the pricing schemes of Amazon Elastic Compute Cloud (EC2) and found the disturbance effect that the price of the spot instances can be heavily affected due to the large number of spot instances required. We proposed a dynamic approach which schedules and runs large-scale computational applications on a dynamic pool of cloud computational instances. We use hybrid instances, including both on-demand instances for high priority tasks and backup, and spot instances for normal computational tasks so as to further reduce the cost without significantly increasing the completion time. Our proposed method takes the dynamic pricing of cloud instances into consideration, and it reduces the cost and tolerates the failures for running large-scale applications in public clouds. We conducted experimental tests and an agent based Scalable complex System modeling for Sustainable city (S3) application is used to evaluate the scalability, reliability and cost saving. The results show that our proposed method is robust and highly flexible for researchers and users to further reduce cost in real practice.
Year
DOI
Venue
2013
10.1109/ICPADS.2013.117
ICPADS
Keywords
Field
DocType
dynamic hybrid resource provisioning,ec2,cloud computational instances,cloud computational instance,scheduling,program testing,disturbance effect,spot instance,cost analysis,cost saving,cloud spot,normal computational task,large-scale computational applications,dynamic approach,dynamic hybrid resource provisioning approach,cloud computing,on-demand instances,large-scale computational application,fault tolerance,agent based scalable complex system modeling for sustainable city,running large-scale computational applications,large-scale application,amazon elastic compute cloud,reliability,software fault tolerance,public clouds,resource provisioning,pricing schemes,s3 application,workflow scheduling,public cloud,dynamic pricing,software agents,pricing,dynamic pool,spot price,cost reduction
Spot contract,Dynamic pricing,Computer science,Provisioning,Real-time computing,Schedule,Cost reduction,Backup,Distributed computing,Cloud computing,Scalability
Conference
ISSN
Citations 
PageRank 
1521-9097
5
0.40
References 
Authors
24
8
Name
Order
Citations
PageRank
Sifei Lu1344.44
Xiaorong Li211310.80
Long Wang3173.27
Henry Kasim472.23
Henry Palit5514.16
Terence Hung6293.82
Erika Fille Tupas Legara750.40
Gary Lee850.40