Title
A Highly Scalable Decentralized Scheduler of Tasks with Deadlines
Abstract
Scheduling of tasks in distributed environments, like cloud and grid computing platforms, using deadlines to provide quality of service is a challenging problem. The few existing proposals suffer from scalability limitations, because they try to manage full knowledge of the system state. To our knowledge, there is no implementation yet that reaches scales of a hundred thousand nodes. In this paper, we present a fully decentralized scheduler, that aggregates information about the availability of the execution nodes throughout the network and uses it to allocate tasks to those nodes that are able to finish them in time. Through simulation, we show that our scheduler is able to operate on different scenarios, from many-task applications in cloud computing sites to volunteer computing projects. Simulations on networks of up to a hundred thousand nodes show very competitive performance, reaching allocation times of under a second and very low overhead in low latency gigabit networks.
Year
DOI
Venue
2011
10.1109/Grid.2011.17
Grid Computing
Keywords
Field
DocType
cloud computing,knowledge management,scheduling,cloud computing platform,cloud computing sites,distributed environment,gigabit network,grid computing platform,knowledge management,many-task application,quality of service,scalable decentralized scheduler,task scheduling,volunteer computing project,Distributed architectures,Distributed systems,Scheduling and task partitioning
Resource management,Gigabit,Grid computing,Computer science,Scheduling (computing),Quality of service,Real-time computing,Latency (engineering),Cloud computing,Scalability,Distributed computing
Conference
ISSN
ISBN
Citations 
1550-5510
978-1-4577-1904-2
4
PageRank 
References 
Authors
0.37
18
2
Name
Order
Citations
PageRank
Javier Celaya1363.03
Unai Arronategui2356.92