Title
Efficient Layering for High Speed Communication: Fast Messages 2.x
Abstract
We describe our experience designing, implementing, and evaluating two generations of our high performance communication library, Fast Messages (FM) for Myrinet. In FM 1.x, we designed a simple interface and provided guarantees of reliable and in-order delivery, and flow control. While this was a significant improvement over previous systems, it was not enough. Layering MPI atop FM 1.x showed that only about 20\% of the FM 1.x bandwidth could be delivered to higher level communication APIs. Our second generation communication layer, FM 2.0, addresses the identified problems, providing gather-scatter, interlayer scheduling, receiver flow control, as well as some convenient API features which simplify programming. FM 2.x can deliver 70-90\% to higher level APIs such as MPI. This is especially impressive as the absolute bandwidths delivered have increased nearly fourfold to 70 MB/s. We describe general issues encountered in matching two communication layers, and our solutions as embodied in FM 2.x.
Year
DOI
Venue
1998
10.1109/HPDC.1998.709943
HPDC
Keywords
Field
DocType
application program interfaces,local area networks,processor scheduling,software libraries,70 MB/s,API,Fast Messages 2.x,MPI layering,Myrinet,bandwidth,efficient layering,gather-scatter feature,high performance communication library,high speed communication,interlayer scheduling,programming,receiver flow control
Scheduling (computing),Computer science,Layering,Real-time computing,Flow control (data),Bandwidth (signal processing),Local area network,Message passing,Myrinet,Distributed computing,Communications protocol
Conference
ISSN
ISBN
Citations 
1082-8907
0-8186-8579-4
40
PageRank 
References 
Authors
5.21
18
3
Name
Order
Citations
PageRank
Mario Lauria162895.12
Scott Pakin21098134.55
Andrew A. Chien33696405.97