Title
A collective I/O implementation based on inspector---executor paradigm
Abstract
In this paper, we present a novel multiple phase I/O collective technique for generic block-cyclic distributions. The I/O technique is divided into two stages: inspector and executor. During the inspector stage, the communication pattern is computed and the required datatypes are automatically generated. This information is used during the executor stage in performing the communication and file accesses. The two stages are decoupled, so that for repetitive file access patterns, the computations from the inspector stage can be performed once and reused several times by the executor. This strategy allows to amortize the inspector cost over several I/O operations. In this paper, we evaluate the performance of multiple phase I/O collective technique and we compare it with other state of the art approaches. Experimental results show that for small access granularities, our method outperforms in the large majority of cases other parallel I/O optimizations techniques.
Year
DOI
Venue
2007
10.1007/s11227-008-0200-6
The Journal of Supercomputing
Keywords
DocType
Volume
o technique,multiple phase,inspector cost,o operation,o optimizations technique,o implementation,communication pattern,executor stage,executor paradigm,inspector stage,o collective technique,novel multiple phase
Conference
47
Issue
ISSN
Citations 
1
1573-0484
4
PageRank 
References 
Authors
0.41
16
4
Name
Order
Citations
PageRank
David E. Singh119123.13
Florin Isaila223424.01
Juan C. Pichel38810.62
Jesús Carretero455269.87