Paper Info
Title
Efficient Algorithms for Collective Operations with Notified Communication in Shared Windows
Abstract
Collective operations are commonly used in various parts of scientific applications. Especially in strong scaling scenarios collective operations can negatively impact the overall applications performance: while the load per rank here decreases with increasing core counts, time spent in e.g. barrier operations will increase logarithmically with the core count. In this article, we develop novel algorithmic solutions for collective operations -- such as Allreduce and Allgather(V) -- by leveraging notified communication in shared windows. To this end, we have developed an extension of GASPI which enables all ranks participating in a shared window to observe the entire notified communication targeted at the window. By exploring benefits of this extension, we deliver high performing implementations of Allreduce and Allgather(V) on Intel and Cray clusters. These implementations clearly achieve 2x-4x performance improvements compared to the best performing MPI implementations for various data distributions.
Year
DOI
Venue
2018
10.1109/PAW-ATM.2018.00006
2018 IEEE/ACM Parallel Applications Workshop, Alternatives To MPI (PAW-ATM)
Keywords
Field
DocType
Synchronization,Art,Buffer storage,Standards,Arrays,Programming,Periodic structures
Synchronization,Computer science,Parallel computing,Implementation
Conference
ISBN
Citations 
PageRank 
978-1-7281-0224-5
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Muhammed Abdullah Al Ahad100.34
Christian Simmendinger2173.95
Roman Iakymchuk3325.98
Erwin Laure436944.71
Stefano Markidis520728.78