Paper Info
Title
Multithreaded Two-Phase I/O: Improving Collective MPI-IO Performance on a Lustre File System
Abstract
ROMIO, a representative MPI-IO implementation, has been widely used in recent large-scale parallel computations. The two-phase I/O optimization scheme of ROMIO improves I/O performance for non-contiguous access patterns, however, this scheme still has room to improve performance to make it suitable for recent data-intensive computing. We propose overlapping data exchange operations with file I/O operations by using a multithreaded scheme to achieve further I/O throughput improvement. We show up to 60% improvement by the multithreaded two-phase I/O relative to the original two-phase I/O in performance evaluation of collective write operations on a Lustre file system of a Linux PC cluster.
Year
DOI
Venue
2014
10.1109/PDP.2014.46
Parallel, Distributed and Network-Based Processing
Keywords
Field
DocType
Linux,application program interfaces,message passing,multi-threading,optimisation,Linux PC cluster,Lustre file system,ROMIO,collective MPI-IO performance,data-intensive computing,multithreaded two-phase I/O optimization scheme,overlapping data exchange operations,performance evaluation,representative MPI-IO implementation,MPI-IO,ROMIO,collective I/O,multithreading,two-phase I/O
Multithreading,Data exchange,Computer science,Parallel computing,Input/output,Lustre (file system),Throughput,Operating system,Message passing,Distributed computing,Computation
Conference
ISSN
Citations 
PageRank 
1066-6192
3
0.42
References 
Authors
6
4
Name
Order
Citations
PageRank
Tsujita, Y.130.42
Yoshinaga, K.230.76
Hori, A.3898.71
Mikiko Sato42211.53