Title
A task routing approach to large-scale scheduling
Abstract
Scheduling many tasks in environments of millions of unreliable nodes is a challenging problem. To our knowledge, no work in the literature has proposed a solution that also supports many policies with very different objectives. In this paper, we present a decentralized scheduling model that overcomes these problems. A hierarchical network overlay supports a scalable resource discovery and allocation scheme. It uses aggregated information to route tasks to the most suitable execution nodes, and is easily extensible to provide very different scheduling policies. For this paper, we implemented a policy that just allocates tasks to idle nodes, a policy that minimizes the global makespan and a policy that fulfills deadline requirements. With thorough simulation tests, we conclude that our model allocates any number of tasks to several million nodes in just a few seconds, with very low overhead and high resilience. Meanwhile, policies with different objectives implemented on our model perform almost as well as their centralized counterpart.
Year
DOI
Venue
2013
10.1016/j.future.2012.12.009
Future Generation Comp. Syst.
Keywords
Field
DocType
large-scale scheduling,different objective,allocates task,decentralized scheduling model,centralized counterpart,different scheduling policy,challenging problem,allocation scheme,fulfills deadline requirement,global makespan,aggregated information,distributed systems,scheduling,network protocols
Job shop scheduling,Fair-share scheduling,Scheduling (computing),Computer science,Real-time computing,Dynamic priority scheduling,Earliest deadline first scheduling,Overlay network,Communications protocol,Distributed computing,Scalability
Journal
Volume
Issue
ISSN
29
5
0167-739X
Citations 
PageRank 
References 
8
0.53
56
Authors
2
Name
Order
Citations
PageRank
Javier Celaya1363.03
Unai Arronategui2356.92