Title
Overhead of a decentralized gossip algorithm on the performance of HPC applications
Abstract
Gossip algorithms can provide online information about the availability and the state of the resources in supercomputers. These algorithms require minimal computing and storage capabilities at each node and when properly tuned, they are not expected to overload the nodes or the network that connects these nodes. These properties make gossip interesting for future exascale systems. This paper examines the overhead of a decentralized gossip algorithm on the performance of parallel MPI applications running on up to 8192 nodes of an IBM BlueGene/Q supercomputer. The applications that were used in the experiments include PTRANS and MPI-FFT from the HPCC benchmark suite as well as the coupled weather and cloud simulation model COSMO-SPECS+FD4. In most cases, no gossip overhead was observed when the gossip messages were sent at intervals of 256ms or more. As expected, the overhead that is observed at higher rates is sensitive to the communication pattern of the application and the amount of gossip information being circulated.
Year
DOI
Venue
2014
10.1145/2612262.2612271
ROSS@ICS
Keywords
Field
DocType
Benchmarking, cluster management, gossip algorithm, high performance computing
IBM,Suite,Gossip algorithms,Supercomputer,Computer science,Gossip,Gossip protocol,Cloud simulation,Benchmarking,Distributed computing
Conference
Citations 
PageRank 
References 
2
0.37
14
Authors
6
Name
Order
Citations
PageRank
E. Levy1222.24
Amnon Barak2590119.00
Amnon Shiloh310524.32
Matthias Lieber423715.12
Carsten Weinhold5263.18
Hermann Härtig668664.40