Title
Reducing Synchronization Overhead Through Bundled Communication
Abstract
OpenSHMEM provides a one-sided communication interface that allows for asynchronous, one-sided communication operations on data stored in a partitioned global address space. While communication in this model is efficient, synchronizations must currently be achieved through collective barriers or one-sided updates of sentinel locations in the global address space. These synchronization mechanisms can over-synchronize, or require additional communication operations, respectively, leading to high overheads. We propose a SHMEM extension that utilizes capabilities present in most high performance interconnects (e.g. communication events) to bundle synchronization information together with communication operations. Using this approach, we improve ping-pong latency for small messages by a factor of two, and demonstrate significant improvement to synchronization-heavy communication patterns, including all-to-all and pipelined parallel stencil communication.
Year
DOI
Venue
2014
10.1007/978-3-319-05215-1_12
OpenSHMEM
Field
DocType
Citations 
Asynchronous communication,Synchronization,Computer science,Latency (engineering),Stencil,Parallel programming model,Partitioned global address space,SHMEM,Bundle,Distributed computing
Conference
6
PageRank 
References 
Authors
0.68
8
6
Name
Order
Citations
PageRank
James Dinan128521.84
Clement Cole260.68
Gabriele Jost327423.76
Stan Smith471.08
Keith D. Underwood584777.39
Robert W. Wisniewski6130877.88