Name
Abstract | ||
|---|---|---|
Scientific experiments can be modeled as Workflows. Such Workflows are usually computing-and data-intensive, demanding the use of High-Performance Computing environments such as clusters, grids, and clouds. This latter offers the advantage of elasticity, which allows for increasing and/or decreasing the number of Virtual Machines (VMs) on demand. Workflows are typically managed using Scientific Workflow Management Systems (SWfMS). Many existing SWfMSs offer support for cloud-based execution. Each SWfMS has its own scheduler that follows a well-defined cost function. However, such cost functions must consider the characteristics of a dynamic environment, such as live migrations and/or performance fluctuations, which are far from trivial to model. This paper proposes a novel scheduling strategy, named ReASSIgN, based on Reinforcement Learning (RL). By relying on an RL technique, one may assume that there is an optimal (or sub-optimal) solution for the scheduling problem, and aims at learning the best scheduling based on previous executions in the absence of a mathematical model of the environment. For this, an extension of a well-known workflow simulator WorkflowSim is proposed to implement an RL strategy for scheduling workflows. Once the scheduling plan is generated, the workflow is executed in the cloud using SciCumulus SWfMS. We conducted a thorough evaluation of the proposed scheduling strategy using a real astronomy workflow. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1109/IPDPSW.2019.00134 | 2019 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) |
Keywords | Field | DocType |
Scientific Workflow, Reinforcement Learning, Cloud | Job shop scheduling,Virtual machine,Computer science,Scheduling (computing),Schedule,Workflow management system,Workflow,Reinforcement learning,Distributed computing,Cloud computing | Conference |
ISSN | ISBN | Citations |
2164-7062 | 978-1-7281-3511-3 | 1 |
PageRank | References | Authors |
0.35 | 19 | 5 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| André Nascimento | 1 | 1 | 0.35 |
| Victor Olimpio | 2 | 1 | 0.35 |
| Vítor Silva | 3 | 97 | 10.41 |
| Aline Paes | 4 | 40 | 13.64 |
| Daniel de Oliveira | 5 | 617 | 59.87 |