Title
Performance Comparison of Coscheduling Algorithms for Non-Dedicated Clusters Through a Generic Framework
Abstract
In this paper, we address several key issues in designing coscheduling algorithms for clusters. First, we propose a generic framework for deploying coscheduling techniques by providing a reusable and dynamically loadable kernel module. Second, we implement several communication-driven coscheduling algorithms [dynamic coscheduling (DCS), spin block (SB) and periodic boost (PB)] on a 16- node Linux cluster using the above framework. Third, with exhaustive experimentation using mixed workloads, we observe that unlike PB, which provided the best performance on a Solaris platform, the SB scheme outperforms all other techniques on a Linux platform. Finally, we investigate the impact of several job placement strategies, multiprogramming level (MPL), communication intensity and CPU and I/O intensive jobs on the performance of these coscheduling schemes. The experimental results show that the blocking-based coscheduling scheme (SB) has better tolerance to system workload variation compared with the spin-based schemes (DCS and PB), and overall, the blocking-based coscheduling scheme seems a better choice for non-dedicated Linux clusters.
Year
DOI
Venue
2007
10.1177/1094342006074868
IJHPCA
Keywords
Field
DocType
node linux cluster,blocking-based coscheduling scheme,non-dedicated linux cluster,generic framework,linux platform,non-dedicated clusters,coscheduling algorithm,dynamic coscheduling,coscheduling scheme,performance comparison,coscheduling technique,coscheduling algorithms,spin-based scheme,sb scheme,distributed application,linux cluster
Cluster (physics),Computer science,Coscheduling,Scheduling (computing),Parallel computing,Algorithm,Computer multitasking,Loadable kernel module,Computer cluster,Operating system
Journal
Volume
Issue
ISSN
21
1
1094-3420
Citations 
PageRank 
References 
2
0.39
17
Authors
5
Name
Order
Citations
PageRank
Gyu Sang Choi112120.20
Saurabh Agarwal216211.26
Jin-ha Kim332918.78
Chita R. Das4103859.34
Andy B. Yoo51679.33