Paper Info
Title
Container Orchestration for Scientific Workflows
Abstract
Recently, Linux container technology has been gaining attention as it promises to transform the way software is developed and deployed. The portability and ease of deployment makes Linux containers an ideal technology to be used in scientific workflow platforms. AWE/Shock is a scalable data analysis platform designed to execute data intensive scientific workflows. Recently we introduced Skyport, an extension to AWE/Shock, that uses Docker container technology to orchestrate and automate the deployment of individual workflow tasks onto the worker machines. The installation of software in independent execution environments for each task reduces complexity and offers an elegant solution to installation problems such as library version conflicts. The systematic use of isolated execution environments for workflow tasks also offers a convenient and simple mechanism to reproduce scientific results.
Year
DOI
Venue
2015
10.1109/IC2E.2015.87
IC2E
Field
DocType
Citations 
Workflow technology,Software deployment,Computer science,Software,Software portability,Workflow engine,Workflow,Orchestration (computing),Operating system,Scalability
Conference
2
PageRank 
References 
Authors
0.39
2
5
Name
Order
Citations
PageRank
Wolfgang Gerlach1817.03
Wei Tang220.39
Andreas Wilke331423.84
Dan Olson420.39
Folker Meyer548451.83