Title
Dynamic Provisioning and Execution of HPC Workflows Using Python.
Abstract
High-performance computing (HPC) workflows over the last several decades have proven to assist in the understanding of scientific phenomena and the production of better products, more quickly, and at reduced cost. However, HPC workflows are difficult to implement and use for a variety of reasons. In this paper, we describe the development of the Python-based cumulus, which addresses many of these barriers. cumulus is a platform for the dynamic provisioning and execution of HPC workflows. cumulus provides the infrastructure needed to build applications that leverage traditional or Cloud-based HPC resources in their workflows. Finally, we demonstrate the use of cumulus in both web and desktop simulation applications, as well as in an Apache Spark-based analysis application.
Year
DOI
Venue
2016
10.1109/PyHPC.2016.11
PyHPC@SC
Keywords
DocType
ISBN
dynamic HPC workflow provisioning,dynamic HPC workflow execution,high-performance computing workflows,scientific phenomena,Python-based cumulus,cloud-based HPC resources,desktop simulation,Web simulation,Apache Spark-based analysis application
Conference
978-1-5090-5221-9
Citations 
PageRank 
References 
1
0.41
0
Authors
6
Name
Order
Citations
PageRank
Chris Harris130.78
Patrick O'Leary2291.99
Michael Grauer310.41
Aashish Chaudhary410.41
Chris Kotfila510.41
Robert M. O'Bara610.41