Paper Info
Title
EReinit: Scalable and efficient fault-tolerance for bulk-synchronous MPI applications: EReinit: Scalable and efficient fault-tolerance for bulk-synchronous MPI applications
Abstract
Scientists from many different fields have been developing Bulk-Synchronous MPI applications to simulate and study a wide variety of scientific phenomena. Since failure rates are expected to increase in larger-scale future HPC systems, providing efficient fault-tolerance mechanisms for this class of applications is paramount. The global-restart model has been proposed to decrease the time of failure recovery in Bulk-Synchronous applications by allowing a fast reinitialization of MPI. However, the current implementations of this model have several drawbacks: they lack efficiency; their scalability have not been shown; and they require the use of the MPI profiling interface, which precludes the use of tools. In this paper, we present EReinit, an implementation of the global-restart model that addresses these problems. Our key idea and optimization is the co-design of basic fault-tolerance mechanisms such as failure detection, notification, and recovery between MPI and the resource manager in contrast to current approaches on which these mechanisms are implemented in MPI only. We demonstrate EReinit in three HPC programs and show that it is up to four times more efficient than existing solutions at 4,096 processes.
Year
DOI
Venue
2020
10.1002/cpe.4863
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE
Keywords
DocType
Volume
fault tolerance,high-performance computing,MPI,resilience
Journal
32.0
Issue
ISSN
Citations 
SP3.0
1532-0626
1
PageRank 
References 
Authors
0.36
21
7
Name
Order
Citations
PageRank
Sourav Chakraborty138149.27
Ignacio Laguna223924.56
Murali Krishna Emani3373.73
Mohror, Kathryn455336.10
Dhabaleswar K. Panda55366446.70
Martin Schulz62227129.64
Hari Subramoni746650.51