Title
Scalable message passing in Panda
Abstract
To provide high performance for applications with a wide variety of i/o requirements and to support many different parallel platforms, the design of a parallel i/o system must provide for efficient utilization of available bandwidth both for disk traffic and for message passing. In this paper we discuss the message-passing scalability of the server-directed i/o architecture of Panda, a library for synchronized i/o of multidimensional arrays on parallel platforms. We show how to improve i/o performance in situations where messagepassing is a bottleneck, by combining the server-directed i/o strategy for highly efficient use of available disk bandwidth with new mechanisms to minimize internal communication and computation overhead in Panda. We present experimental results that show that with these improvements, Panda will provide high i/o performance for a wider range of applications, such as applications running with slow interconnects, applications performing i/o operations on large numbers of arrays, or applications that require drastic data rearrangements as data are moved between memory and disk (e.g., array transposition). We also argue that in the future, the improved approach to message-passing will allow Panda to support applications that are not closely synchronized or that run in heterogeneous environments.
Year
DOI
Venue
1996
10.1145/236017.236042
IOPADS
Keywords
Field
DocType
scalable message,message passing
Computer science,Operating system,Message passing,Scalability,Distributed computing
Conference
ISBN
Citations 
PageRank 
0-89791-813-4
6
2.18
References 
Authors
10
6
Name
Order
Citations
PageRank
Y. Chen162.18
Marianne Winslett23519744.78
K. E. Seamons314512.02
S. Kuo4504.66
Y. Cho5838.35
M. Subramaniam662.18