Name
Title | ||
|---|---|---|
Flexible CoScheduling: Mitigating Load Imbalance and Improving Utilization of Heterogeneous Resources |
Abstract | ||
|---|---|---|
Fine-grained parallel applications require all their processes to run simultaneously on distinct processors to achieve good efficiency. This is typically accomplished by space slicing, wherein nodes are dedicated for the duration of the run, or by gang scheduling, wherein time slicing is coordinated across processors. Both schemes suffer from fragmentation, whereprocessors are left idle because jobs cannot be packed with perfect efficiency. Obviously, this leads to reduced utilization and sub-optimal performance. Flexible coscheduling (FCS) solves this problem by monitoring each job's granularity and communication activity, and using gang scheduling only for those jobs that require it. Processes from other jobs, which can be scheduled without any constraints, are used as filler to reduce fragmentation. In addition, inefficiencies due to load imbalance and hardware heterogeneity are also reduced because the classification is done on a per-process basis. FCS has been fully implemented as part of the STORM resource manager, and shown to be competitive with gang scheduling and implicit coscheduling. |
Year | DOI | Venue |
|---|---|---|
2003 | 10.1109/IPDPS.2003.1213191 | IPDPS |
Keywords | Field | DocType |
parallel architectures,resource allocation,workstation clusters,STORM resource manager,cluster computing,communication activity,fine-grained parallel applications,flexible coscheduling,gang scheduling,hardware heterogeneity,heterogeneous clusters,heterogeneous resources utilization,job scheduling,load balancing,load imbalance,parallel architectures,space slicing,time slicing | Resource management,Computer science,Coscheduling,Idle,Slicing,Parallel computing,Gang scheduling,Fragmentation (computing),Resource allocation,Granularity,Distributed computing | Conference |
ISBN | Citations | PageRank |
0-7695-1926-1 | 30 | 1.41 |
References | Authors | |
11 | 4 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Eitan Frachtenberg | 1 | 1060 | 85.08 |
| Dror G. Feitelson | 2 | 3997 | 381.74 |
| Fabrizio Petrini | 3 | 2050 | 165.82 |
| Juan Fernandez | 4 | 269 | 23.17 |