Title
An application-level parallel I/O library for Earth system models
Abstract
We describe the design and implementation of an application-level parallel I/O (PIO) library for the reading and writing of distributed arrays to several common scientific data formats. PIO provides the flexibility to control the number of I/O tasks through data rearrangement to an I/O friendly decomposition. This flexibility enables reductions in per task memory usage and improvements in disk I/O performance versus a serial I/O approach. We illustrate the impact various features within PIO have on memory usage and disk I/O bandwidth on a Cray XT5 system.
Year
DOI
Venue
2012
10.1177/1094342011428143
IJHPCA
Keywords
Field
DocType
o performance,o library,common scientific data format,o task,o bandwidth,memory usage,earth system model,application-level parallel,task memory usage,o friendly decomposition,cray xt5 system,o approach,parallel computer,system modeling,scientific data
Earth system science,Computer science,Parallel computing,Theoretical computer science,Bandwidth (signal processing),Cray XT5,NetCDF,Parallel I/O,Earth system modeling
Journal
Volume
Issue
ISSN
26
1
1094-3420
Citations 
PageRank 
References 
14
1.05
12
Authors
7
Name
Order
Citations
PageRank
John M. Dennis124139.70
Jim Edwards2774.61
Ray Loy3141.05
Robert Jacob4705.64
Arthur A. Mirin513015.38
Anthony P. Craig6746.10
Mariana Vertenstein7847.17