Title
Use of run time predictions for automatic co-allocation of multi-cluster resources for iterative parallel applications
Abstract
Metaschedulers co-allocate resources by requesting a fixed number of processors and usage time for each cluster. These static requests, defined by users, limit the initial scheduling and prevent rescheduling of applications to other resource sets. It is also difficult for users to estimate application execution times, especially on heterogeneous environments. To overcome these problems, metaschedulers can use performance predictions for automatic resource selection. This paper proposes a resource co-allocation technique with rescheduling support based on performance predictions for multi-cluster iterative parallel applications. Iterative applications have been used to solve a variety of problems in science and engineering, including large-scale computations based on the asynchronous model more recently. We performed experiments using an iterative parallel application, which consists of benchmark multiobjective problems, with both synchronous and asynchronous communication models on Grid’5000. The results show run time predictions with an average error of 7% and prevention of up to 35% and 57% of run time overestimations to support rescheduling for synchronous and asynchronous models, respectively. The performance predictions require no application source code access. One of the main findings is that as the asynchronous model masks communication and computation, it requires no network information to predict execution times. By using our co-allocation technique, metaschedulers become responsible for run time predictions, process mapping, and application rescheduling; releasing the user from these burden tasks.
Year
DOI
Venue
2011
10.1016/j.jpdc.2011.05.007
Journal of Parallel and Distributed Computing
Keywords
Field
DocType
Rescheduling,Resource co-allocation,Grid Computing,Metascheduling,Parallel computing,Performance prediction,Run time estimates,Quality-of-service,Asynchronous communication
Asynchronous communication,Grid computing,Source code,Scheduling (computing),Computer science,Parallel computing,Quality of service,Performance prediction,Distributed computing,Computation
Journal
Volume
Issue
ISSN
71
10
0743-7315
Citations 
PageRank 
References 
5
0.45
34
Authors
5
Name
Order
Citations
PageRank
Marco A. S. Netto128413.16
Christian Vecchiola267746.45
Michael Kirley363956.77
Carlos A. Varela440531.84
Rajkumar Buyya5232081340.23