Title
Services + Components = Data Intensive Scientific Workflow Applications with MeDICi
Abstract
Scientific applications are often structured as workflows that execute a series of distributed software modules to analyze large data sets. Such workflows are typically constructed using general-purpose scripting languages to coordinate the execution of the various modules and to exchange data sets between them. While such scripts provide a cost-effective approach for simple workflows, as the workflow structure becomes complex and evolves, the scripts quickly become complex and difficult to modify. This makes them a major barrier to easily and quickly deploying new algorithms and exploiting new, scalable hardware platforms. In this paper, we describe the MeDICi Workflow technology that is specifically designed to reduce the complexity of workflow application development, and to efficiently handle data intensive workflow applications. MeDICi integrates standard component-based and service-based technologies, and employs an efficient integration mechanism to ensure large data sets can be efficiently processed. We illustrate the use of MeDICi with a climate data processing example that we have built, and describe some of the new features we are creating to further enhance MeDICi Workflow applications.
Year
DOI
Venue
2009
10.1007/978-3-642-02414-6_14
CBSE
Keywords
Field
DocType
medici workflow application,medici workflow technology,workflow application development,large data set,data intensive workflow application,simple workflows,climate data,new algorithm,new feature,data intensive scientific workflow,scripting language,data processing,cost effectiveness,middleware,application development
Middleware,Workflow technology,Software engineering,Computer science,Windows Workflow Foundation,Workflow application,Workflow engine,Workflow,Workflow management system,Scripting language
Conference
Volume
ISSN
Citations 
5582
0302-9743
7
PageRank 
References 
Authors
0.59
14
5
Name
Order
Citations
PageRank
Ian Gorton11488134.37
Jared Chase270.59
Adam Wynne3689.41
Justin Almquist4425.88
Alan Chappell57712.16