Name
Abstract | ||
|---|---|---|
SUMMARY Workflows are widely used in applications that require coordinated use of computational resources. Workflow definition languages typically abstract over some aspects of the way in which a workflow is to be executed, such as the level of parallelism to be used or the physical resources to be deployed. As a result, a workflow management system has the responsibility of establishing how best to execute a workflow given the available resources. The Pegasus workflow management system compiles abstract workflows into concrete execution plans, and has been widely used in large-scale e-Science applications. This paper describes an extension to Pegasus whereby resource allocation decisions are revised during workflow evaluation, in the light of feedback on the performance of jobs at runtime. The contributions of this paper include: (i) a description of how adaptive processing has been retrofitted to an existing workflow management system; (ii) a scheduling algorithm that allocates resources based on runtime performance; and (iii) an experimental evaluation of the resulting infrastructure using grid middleware over clusters. Copyright © 2009 John Wiley & Sons, Ltd. |
Year | DOI | Venue |
|---|---|---|
2009 | 10.1002/cpe.v21:16 | Concurrency and Computation: Practice & Experience - Special Issue: 3rd International Workshop on Workflow Management and Applications in Grid Environments (WaGe2008) |
Keywords | Field | DocType |
workflow evaluation,existing workflow management system,allocates resource,adaptive processing,workflow definition language,experimental evaluation,abstract workflows,adaptive workflow processing,workflow management system,john wiley,runtime performance,pegasus workflow management system,middleware,scheduling,engines,scheduling algorithm,grid,resource management,concrete,parallel processing,feedback,resource allocation,pervasive computing,adaptive control | Workflow technology,Workflow Management Coalition,Computer science,Windows Workflow Foundation,Resource allocation,XPDL,Workflow engine,Workflow management system,Workflow,Distributed computing | Journal |
Volume | Issue | ISBN |
21 | 16 | 978-0-7695-3177-9 |
Citations | PageRank | References |
42 | 1.60 | 22 |
Authors | ||
6 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Kevin Lee | 1 | 340 | 27.53 |
| Norman W. Paton | 2 | 3059 | 359.26 |
| Rizos Sakellariou | 3 | 1679 | 129.85 |
| Ewa Deelman | 4 | 5948 | 420.48 |
| Alvaro A. A. Fernandes | 5 | 904 | 77.71 |
| Gaurang Mehta | 6 | 2355 | 168.62 |