Abstract | ||
---|---|---|
We describe the design and implementation of an application-level parallel I/O (PIO) library for the reading and writing of distributed arrays to several common scientific data formats. PIO provides the flexibility to control the number of I/O tasks through data rearrangement to an I/O friendly decomposition. This flexibility enables reductions in per task memory usage and improvements in disk I/O performance versus a serial I/O approach. We illustrate the impact various features within PIO have on memory usage and disk I/O bandwidth on a Cray XT5 system. |
Year | DOI | Venue |
---|---|---|
2012 | 10.1177/1094342011428143 | IJHPCA |
Keywords | Field | DocType |
o performance,o library,common scientific data format,o task,o bandwidth,memory usage,earth system model,application-level parallel,task memory usage,o friendly decomposition,cray xt5 system,o approach,parallel computer,system modeling,scientific data | Earth system science,Computer science,Parallel computing,Theoretical computer science,Bandwidth (signal processing),Cray XT5,NetCDF,Parallel I/O,Earth system modeling | Journal |
Volume | Issue | ISSN |
26 | 1 | 1094-3420 |
Citations | PageRank | References |
14 | 1.05 | 12 |
Authors | ||
7 |
Name | Order | Citations | PageRank |
---|---|---|---|
John M. Dennis | 1 | 241 | 39.70 |
Jim Edwards | 2 | 77 | 4.61 |
Ray Loy | 3 | 14 | 1.05 |
Robert Jacob | 4 | 70 | 5.64 |
Arthur A. Mirin | 5 | 130 | 15.38 |
Anthony P. Craig | 6 | 74 | 6.10 |
Mariana Vertenstein | 7 | 84 | 7.17 |