Title
A workflow runtime environment for manycore parallel architectures
Abstract
We introduce a new Manycore Workflow Runtime Environment (MWRE) to efficiently enact traditional scientific workflows on modern manycore computing architectures. In contrast to existing engines that enact workflows acting as external services, MWRE is compiler-based and translates workflows specified in the XML-based Interoperable Workflow Intermediate Representation (IWIR) into an equivalent C++-based program. This program efficiently enacts the workflow as a stand-alone executable by means of a new callback mechanism that resolves dependencies, transfers data, and handles composite activities. Experimental results on a number of real-world workflows demonstrate that MWRE clearly outperforms existing Java-based workflow engines designed for distributed (Grid/Cloud) computing infrastructures in terms of enactment time, is generally better than an existing script-based engine for manycore architectures (Swift), and sometimes gets even close to an artificial baseline implementation of the workflows in the standard OpenMP language for shared memory systems.
Year
DOI
Venue
2015
10.1016/j.future.2017.02.029
Future Generation Comp. Syst.
Keywords
Field
DocType
Scientific workflows,Manycores,Workflow execution plan,Full-ahead scheduling
Workflow technology,Computer science,Windows Workflow Foundation,Callback,Workflow engine,Workflow management system,Workflow,Operating system,Database,Distributed computing,Cloud computing,Executable
Conference
Volume
ISSN
Citations 
75
0167-739X
6
PageRank 
References 
Authors
0.44
23
3
Name
Order
Citations
PageRank
Matthias Janetschek1281.89
Radu Prodan22314152.27
shajulin benedict36913.68