Paper Info
Title
Improving Parallel I/O Performance Using Multithreaded Two-Phase I/O With Processor Affinity Management
Abstract
I/O has been one of the performance bottlenecks in parallel computing. Using a parallel I/O API such as MPI-IO is one effective approach to improve parallel computing performance. The most popular MPI-IO implementation, ROMIO, utilizes two-phase I/O technique for collective I/O for non-contiguous access patterns. Furthermore, such two-phase I/O is frequently used in application oriented parallel I/O libraries such as HDF5 through an MPI-IO interface layer. Therefore performance improvement in the two-phase I/O may have a big impact in improving I/O performance in parallel computing. We report enhancements of the two-phase I/O by using Pthreads in order to improve I/O performance in this paper. The enhancements include overlapping scheme between file I/O and data exchanges by multithreaded operations and the processor affinity for threads dedicated for file I/O and data exchanges. We show performance advantages of the optimized two-phase I/O with an appropriate processor affinity management relative to the original two-phase I/O in parallel I/O throughput evaluation of HDF5.
Year
DOI
Venue
2013
10.1007/978-3-642-55224-3_67
PARALLEL PROCESSING AND APPLIED MATHEMATICS (PPAM 2013), PT I
Keywords
Field
DocType
MPI-IO, HDF5, Two-phase I/O, Multithreaded I/O, Processor affinity management
Hierarchical Data Format,Computer science,Parallel computing,Input/output,Thread (computing),POSIX Threads,Processor affinity,Throughput,Parallel I/O,Distributed computing,Performance improvement
Conference
Volume
ISSN
Citations 
8384
0302-9743
0
PageRank 
References 
Authors
0.34
7
6
Name
Order
Citations
PageRank
Yuichi Tsujita16212.62
Kazumi Yoshinaga262.68
Atsushi Hori311.06
Mikiko Sato42211.53
Mitaro Namiki59720.69
Yutaka Ishikawa61449188.06