Name
Abstract | ||
|---|---|---|
Job scheduling on production supercomputers is complicated by diverse demands of system administrators and amorphous characteristics of workloads. Specifically, various scheduling goals such as queuing efficiency and system utilization are usually conflicting and thus need to be balanced. Also, changing workload characteristics often impact the effectiveness of the deployed scheduling policies. Thus it is challenging to design a versatile scheduling policy that is effective in all circumstances. In this paper, we propose a novel job scheduling strategy to balance diverse scheduling goals and mitigate the impact of workload characteristics. First, we introduce metric-aware scheduling, which enables the scheduler to balance competing scheduling goals represented by different metrics such as job waiting time, fairness, and system utilization. Second, we design a scheme to dynamically adjust scheduling policies based on feedback information of monitored metrics at runtime. We evaluate our design using real workloads from supercomputer centers. The results demonstrate that our scheduling mechanism can significantly improve system performance in a balanced, sustainable fashion. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1016/j.parco.2013.08.007 | Parallel Computing |
Keywords | Field | DocType |
scheduling mechanism,workload characteristic,novel job scheduling strategy,metric-aware scheduling,job scheduling,system utilization,versatile scheduling policy,diverse scheduling goal,production supercomputers,sustainable job scheduling,scheduling goal,various scheduling goal,resource management | Lottery scheduling,Fixed-priority pre-emptive scheduling,Fair-share scheduling,Computer science,Parallel computing,Two-level scheduling,Rate-monotonic scheduling,Dynamic priority scheduling,Earliest deadline first scheduling,Round-robin scheduling,Distributed computing | Journal |
Volume | Issue | ISSN |
39 | 12 | 0167-8191 |
Citations | PageRank | References |
3 | 0.38 | 21 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Wei Tang | 1 | 152 | 10.65 |
| Dongxu Ren | 2 | 9 | 1.18 |
| Zhiling Lan | 3 | 818 | 54.25 |
| Narayan Desai | 4 | 319 | 29.73 |