Title
Autonomic streaming pipeline for scientific workflows
Abstract
Interest in data streaming within scientific workflow has increased significantly over the recent years—mainly due to the emergence of data-driven applications. Such applications can include data streaming from sensors and data coupling between scientific simulations. To support resource management to enact such streaming-based workflow, autonomic computing techniques for transmission have been combined with in-transit processing, so that data elements may be processed in advance, enroute, prior to arrival at the destination. We propose the integration of an autonomic data streaming service (ADSS) with in-transit processing into a workflow specification. This integration may imply that the associated runtime resource allocation is dependent on environmental conditions and can change for different enactments of the same workflow. In our proposal, our workflow specifications are independent of the constraints imposed by the resource allocation. We express our solutions in terms of Reference nets. We also implement an ADSS utilizing a timed Reference net simulation for predicting future states of the ADSS. There are two advantages: the Reference net which implements the ADSS and the timed model are coincident, and second, token distribution obtained from the Petri net implementation can be utilized to better understand the demand for particular types of resources in the system. Copyright © 2011 John Wiley & Sons, Ltd.
Year
DOI
Venue
2011
10.1002/cpe.1744
Concurrency and Computation: Practice and Experience
Keywords
DocType
Volume
scientific workflows,resource allocation,workflow specification,associated runtime resource allocation,data element,autonomic data,scientific workflow,in-transit processing,Reference net,streaming-based workflow,data coupling
Journal
23
Issue
ISSN
Citations 
16
1532-0626
14
PageRank 
References 
Authors
0.73
20
3
Name
Order
Citations
PageRank
Rafael Tolosana-Calasanz116618.52
José A. Bañares2516.59
Omer F. Rana32181229.52