Name
Abstract | ||
|---|---|---|
The nature of highly parallelized parallel file access which often consists of lots of fine grain, non-contiguous I/O requests, can degrade the I/O performance severely. To tackle this problem, a novel technique to maximize the bandwidth of the MPI-IO is proposed. This proposed technique is utilize a ring communication topology. This technique is implemented as an ADIO device of ROMIO, named Catwalk-ROMIO, and evaluated. The evaluation shows that Catwalk-ROMIO utilizing only one disk can exhibit comparable performance with parallel files systems, PVFS2 and Lustre, utilizing several file servers and disks. The evaluation also shows that Catwalk-ROMIO performance is almost independent from file access patterns, in contrast to the performance of parallel file systems performing only well with collective I/O. Catwalk-ROMIO only requires TCP/IP network for the ring communication topology and one file server which are common in HPC clusters without any additional cost. Thus, Catwalk-ROMIO is considered to be a very cost-effective MPI-IO implementation. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.1109/ICPADS.2011.40 | Parallel and Distributed Systems |
Keywords | Field | DocType |
IP networks,file servers,message passing,multiprocessing systems,parallel processing,telecommunication network topology,ADIO device,Catwalk-ROMIO,HPC clusters,Lustre,MPI-IO,PVFS2,TCP/IP network,file access patterns,file server,highly parallelized parallel file access,noncontiguous IO requests,parallel file systems,parallel files systems,ring communication topology,COTS,MPI-IO,Parallel File System | Virtual file system,SSH File Transfer Protocol,File Control Block,Global Namespace,Self-certifying File System,Computer science,Parallel computing,Device file,Unix file types,File system fragmentation,Operating system,Distributed computing | Conference |
ISSN | ISBN | Citations |
1521-9097 | 978-1-4577-1875-5 | 1 |
PageRank | References | Authors |
0.41 | 7 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Atsushi Hori | 1 | 150 | 23.37 |
| Keiji Yamamoto | 2 | 4 | 1.21 |
| Yutaka Ishikawa | 3 | 1449 | 188.06 |