Title
Flexible and efficient parallel I/O for large-scale multi-component simulations
Abstract
In this paper, we discuss our experience of providing high performance parallel I/O for a large-scale, on-going, multi-disciplinary simulation project for solid propellant rockets. We describe the performance and data management issues observed in this project and present our solutions, including (1) support for relatively fine-grained distribution of irregular datasets in parallel I/O, (2) a flexible data management facility for inter-module communication, and (3) two schemes to overlap computation with I/O. Performance results obtained from both development and production platforms show that our I/O optimizations can dramatically reduce the simulation's visible I/O cost, as well as the number of disk files, and significantly improve the overall performance. Meanwhile, our data management facility helps to provide simulation developers with simple user interfaces for parallel I/O.
Year
DOI
Venue
2003
10.1109/IPDPS.2003.1213462
IPDPS
Keywords
Field
DocType
irregular datasets,solid propellant rockets,parallel programming,user interfaces,aerospace computing,rockets,multi-disciplinary simulation project,data management issue,simulation developer,aerospace simulation,flexible data management,flexible data management facility,data management facility,high performance parallel,fine-grained distribution,parallel i/o,overall performance,performance result,o optimizations,performance evaluation,o cost,inter-module communication,large-scale multi-component simulations,data management,performance,production,propulsion,concurrent computing,distributed computing,project management,solid modeling,cost function,computational modeling
Propellant,Computer science,Parallel computing,Parallel I/O,User interface,Data management,Aerospace simulation,Distributed computing,Computation
Conference
ISSN
ISBN
Citations 
1530-2075
0-7695-1926-1
5
PageRank 
References 
Authors
0.56
15
4
Name
Order
Citations
PageRank
Xiaosong Ma1111768.36
Xiangmin Jiao232731.80
Michael T. Campbell3283.09
Marianne Winslett43519744.78