Paper Info
Title
Implementation and Evaluation of File Write-Back and Prefetching for MPI-IO Over GPFS
Abstract
In this paper we present the implementation of an open-source MPI-IO interface for the General Parallel File System (GPFS). Our solution includes the design and implementation of GPFS-based write-back and prefetching modules, which have been integrated in ROMIO. A collective file write strategy based on GPFS data-shipping, and a view-based collective I/O mechanism, relying on GPFS mechanisms, are at the core of the novel optimizations proposed in this paper. View-based collective I/O includes a thread-based flushing method implementing a write-back policy for latency hiding, and a prefetching method, based on GPFS hints, to increase small read access performance. Performance evaluations show that our implementation achieves high-performance and hides the latency of file accesses through the combination of view-based collective file accesses, and the overlapping of computation, communication and I/O. This is especially true for collective and small-size access patterns, which are very frequent in parallel scientific applications.
Year
DOI
Venue
2010
10.1177/1094342009359015
IJHPCA
Keywords
Field
DocType
o mechanism,gpfs-based write-back,gpfs data-shipping,file access,latency hiding,performance evaluation,collective file,file write-back,view-based collective file access,gpfs mechanism,gpfs hint,parallel programming,parallel systems,distributed file system
Write strategy,File system,Self-certifying File System,Computer science,Latency (engineering),Parallel computing,Thread (computing),Unix file types,Parallel I/O,Operating system,Distributed computing,Computation
Journal
Volume
Issue
ISSN
24
1
1094-3420
Citations 
PageRank 
References 
4
0.48
30
Authors
5
Name
Order
Citations
PageRank
Javier Garcia Blas1313.23
Florin Isaila223424.01
Jesus Carretero323929.04
David E. Singh419123.13
Felix Garcia-Carballeira511211.32