Paper Info
Title
A Testing Engine for High-Performance and Cost-Effective Workflow Execution in the Cloud.
Abstract
While pursuing high performance and cost effectiveness for directed acyclic graph (DAG)-structured scientific workflow executions in the cloud, it is critical to identify appropriate resource instances and their quantity. This paper presents a testing engine that employs a resource-selection heuristic, which statically analyzes the DAG structure to guide the selection of resource instances, how many and which ones. The testing engine combines the heuristic with two platform-independent DAG-scheduling policies, the Area-oriented DAG-scheduling heuristic (AO) and the Locally-Optimal heuristic (L-OPT), to perform extensive validation assessments. The testing engine ensures the realism of these assessments by modeling the performance variability of the cloud platform using real traces. The testing engine also enables cost-effectiveness analysis that guides users to select a small set of instance candidates that provide performance-cost trade off. Our empirical results show that the pairing of the resource-selection heuristic with AO scheduling policy is a powerful method for cost-effective DAG-structured workflow execution in the cloud.
Year
DOI
Venue
2015
10.1109/ICPP.2015.94
ICPP
Keywords
Field
DocType
Newark
Workflow technology,Heuristic,Scheduling (computing),Computer science,Parallel computing,Directed acyclic graph,Workflow engine,Workflow,Workflow management system,Distributed computing,Cloud computing
Conference
ISSN
Citations 
PageRank 
0190-3918
2
0.37
References 
Authors
23
3
Name
Order
Citations
PageRank
vivek k pallipuram1283.77
Trilce Estrada212018.27
michela taufer335253.04