Abstract | ||
---|---|---|
Scientific applications are often structured as workflows that execute a series of distributed software modules to analyze large data sets. Such workflows are typically constructed using general-purpose scripting languages to coordinate the execution of the various modules and to exchange data sets between them. While such scripts provide a cost-effective approach for simple workflows, as the workflow structure becomes complex and evolves, the scripts quickly become complex and difficult to modify. This makes them a major barrier to easily and quickly deploying new algorithms and exploiting new, scalable hardware platforms. In this paper, we describe the MeDICi Workflow technology that is specifically designed to reduce the complexity of workflow application development, and to efficiently handle data intensive workflow applications. MeDICi integrates standard component-based and service-based technologies, and employs an efficient integration mechanism to ensure large data sets can be efficiently processed. We illustrate the use of MeDICi with a climate data processing example that we have built, and describe some of the new features we are creating to further enhance MeDICi Workflow applications. |
Year | DOI | Venue |
---|---|---|
2009 | 10.1007/978-3-642-02414-6_14 | CBSE |
Keywords | Field | DocType |
medici workflow application,medici workflow technology,workflow application development,large data set,data intensive workflow application,simple workflows,climate data,new algorithm,new feature,data intensive scientific workflow,scripting language,data processing,cost effectiveness,middleware,application development | Middleware,Workflow technology,Software engineering,Computer science,Windows Workflow Foundation,Workflow application,Workflow engine,Workflow,Workflow management system,Scripting language | Conference |
Volume | ISSN | Citations |
5582 | 0302-9743 | 7 |
PageRank | References | Authors |
0.59 | 14 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Ian Gorton | 1 | 1488 | 134.37 |
Jared Chase | 2 | 7 | 0.59 |
Adam Wynne | 3 | 68 | 9.41 |
Justin Almquist | 4 | 42 | 5.88 |
Alan Chappell | 5 | 77 | 12.16 |