Title
Flux: A Next-Generation Resource Management Framework for Large HPC Centers
Abstract
Resource and job management software is crucial to High Performance Computing (HPC) for efficient application execution. However, current systems and approaches can no longer keep up with the challenges large HPC centers are facing due to ever-increasing system scales, resource and workload diversity, interplays between various resources (e.g., between compute clusters and a global file system), and complexity of resource constraints such as strict power budgeting. To address this gap, we propose Flux, an extensible job and resource management framework specifically designed to deal with the requirements of next-generation HPC centers. Flux targets an entire computing facility as one common pool of diverse sets of resources, enabling the facility to accommodate site-wide constraints (e.g., for power limits). Yet, its scalable and distributed design still offers scalable and effective scheduling strategies. This paper details the design of Flux and describes and evaluates our initial prototyping effort of the key run-time components. Our results show that our run- time prototype provides strong and predictable scalability.
Year
DOI
Venue
2014
10.1109/ICPPW.2014.15
International Conference on Parallel Processing Workshops
Field
DocType
ISSN
Resource management,Global file system,Supercomputer,Workload,Computer science,Scheduling (computing),Parallel computing,Human resource management system,Resource allocation,Distributed computing,Scalability
Conference
1530-2016
Citations 
PageRank 
References 
8
0.57
16
Authors
6
Name
Order
Citations
PageRank
Dong H. Ahn1384.21
Jim Garlick2171.43
Mark Grondona3171.43
Don Lipari4151.06
Becky Springmeyer5171.43
Martin Schulz616719.77