Paper Info
Title
CAP3: A Cloud Auto-Provisioning Framework for Parallel Processing Using On-Demand and Spot Instances
Abstract
Cloud computing has drawn increasing attention from the scientific computing community due to its ease of use, elasticity, and relatively low cost. Because a high-performance computing (HPC) application is usually resource demanding, without careful planning, it can incur a high monetary expense even in Cloud. We design a tool called CAP3 (Cloud Auto-Provisioning framework for Parallel Processing) to help a user minimize the expense of running an HPC application in Cloud, while meeting the user-specified job deadline. Given an HPC application, CAP3 automatically profiles the application, builds a model to predict its performance, and infers a proper cluster size that can finish the job within its deadline while minimizing the total cost. To further reduce the cost, CAP3 intelligently chooses the Cloud's reliable on-demand instances or low-cost spot instances, depending on whether the remaining time is tight in meeting the application's deadline. Experiments on Amazon EC2 show that the execution strategy given by CAP3 is cost-effective, by choosing a proper cluster size and a proper instance type (on-demand or spot).
Year
DOI
Venue
2013
10.1109/CLOUD.2013.41
IEEE CLOUD
Keywords
Field
DocType
amazon ec2,parallel processing,spot instances,hpc application,cloud auto-provisioning framework for parallel processing,spot instance,high-performance computing,proper instance type,cloud computing,total cost minimization,on-demand instances,low-cost spot instances,user-specified job deadline,scientific computing community,parallel scientific application,total cost,cap3 tool,virtual cluster,cluster size,proper cluster size,cloud auto-provisioning framework,low cost,provisioning
On demand,Computer science,Usability,Parallel processing,Real-time computing,Provisioning,Utility computing,Total cost,Cloud testing,Cloud computing,Distributed computing
Conference
ISSN
ISBN
Citations 
2159-6182
978-0-7695-5028-2
21
PageRank 
References 
Authors
0.79
17
5
Name
Order
Citations
PageRank
He Huang1422.54
Liqiang Wang270356.71
Byung Chul Tak319213.69
Long Wang4210.79
Chunqiang Tang5128775.09