Paper Info
Title
Design and implementation of a scalable membership service for supercomputer resiliency-aware runtime
Abstract
As HPC systems and applications get bigger and more complex, we are approaching an era in which resiliency and run-time elasticity concerns become paramount. We offer a building block for an alternative resiliency approach in which computations will be able to make progress while components fail, in addition to enabling a dynamic set of nodes throughout a computation lifetime. The core of our solution is a hierarchical scalable membership service providing eventual consistency semantics. An attribute replication service is used for hierarchy organization, and is exposed to external applications. Our solution is based on P2P technologies and provides resiliency and elastic runtime support at ultra large scales. Resulting middleware is general purpose while exploiting HPC platform unique features and architecture. We have implemented and tested this system on BlueGene/P with Linux, and using worst-case analysis, evaluated the service scalability as effective for up to 1M nodes.
Year
DOI
Venue
2013
10.1007/978-3-642-40047-6_37
Euro-Par
Keywords
DocType
Volume
hpc system,alternative resiliency approach,supercomputer resiliency-aware runtime,building block,service scalability,hierarchical scalable membership service,hpc platform,computation lifetime,p2p technology,resulting middleware,attribute replication service
Conference
8097
ISSN
Citations 
PageRank 
0302-9743
2
0.37
References 
Authors
22
4
Name
Order
Citations
PageRank
Yoav Tock129215.20
Benjamin Mandler2101.62
José E. Moreira32282230.26
Terry Jones4818.20