Title
Efficient implementation of reduce-scatter in MPI
Abstract
We discuss the efficient implementation of a collective operation called reduce-scatter , which is defined in the MPI standard. The reduce-scatter is equivalent to the combination of a reduction on vectors of length n with a scatter of the resulting n -vector to all processors. We describe the implementation issues and the performance characterization of two recently proposed algorithms for the reduce-scatter that have been proven to be highly efficient in theory under the assumption of fully connected parallel system. A performance comparison with existing mainstream implementations of the operation is presented which confirms the practical advantage of the new algorithms. Experiments show that the two algorithms have different characteristics which make them complementary in providing a performance gain over standard algorithms. Our study has been carried out on two different platforms: an SP2 and a Myrinet interconnected cluster of Pentium PRO. However, most of the results reported here are not specific for either MPI or the platforms used, and they hold in general for any message passing programming system.
Year
DOI
Venue
2003
10.1016/S1383-7621(03)00059-6
Parallel, Distributed and Network-Based Processing
Keywords
DocType
Volume
mpi,parallel algorithms,collective communication primitives,performance characterization,parallel systems,parallel algorithm,message passing
Journal
49
Issue
ISSN
ISBN
3
Journal of Systems Architecture
0-7695-1444-8
Citations 
PageRank 
References 
10
1.29
16
Authors
3
Name
Order
Citations
PageRank
Massimo Bernaschi150464.27
Giulio Iannello241446.75
Mario Lauria362895.12