Paper Info
Title
High Performance I/O
Abstract
Parallelisation, serial optimisation, compiler tuning, and many more techniques are used to optimise and improve the performance scaling of parallel programs. One area which is frequently not optimised is file I/O. This is because it is often not considered to be key to the performance of a program and also because it is traditionally difficult to optimise and very machine specific. However, in the current era of Peta- and Exascale computing it is no longer possible to ignore I/O performance as it can significantly limit the scaling of many codes when executing on very large numbers of processors or cores. Furthermore, as producing data is the main purpose of most simulation codes any work that can be undertaken to provide improved performance of I/0 can be applicable to a very large range of simulation codes, and provide them with improved functionality (i.e. the ability to produce more data).This paper describes some of the issues surrounding I/O, the technology that is commonly deployed to provide I/O on HPC machines and the software libraries available to programmers to undertake I/O. The performance of all these aspects of I/O on arange of HPC systems were investigated by the authors and a represented in this paper to motivate the discussions in the paper.
Year
DOI
Venue
2011
10.1109/PDP.2011.16
PDP
Keywords
Field
DocType
o performance,large range,hpc system,high performance,improved performance,exascale computing,large number,improved functionality,simulation code,performance scaling,hpc machine,optimization,hardware,hdf5,hpc,netcdf,natural sciences,servers,computer model,computational modeling,lustre,i o
Exascale computing,Hierarchical Data Format,Computer science,Server,Parallel computing,Compiler,Input/output,Software,NetCDF,Scaling,Distributed computing
Conference
ISSN
Citations 
PageRank 
1066-6192
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Adrian Jackson1107.31
Fiona Reid200.34
Joachim Hein321.15
Alejandro Soba454.59
Xavier Sáez531.80