Name
Title | ||
|---|---|---|
Profiling and Improving I/O Performance of a Large-Scale Climate Scientific Application |
Abstract | ||
|---|---|---|
Exascale computing systems are soon to emerge, which will pose great challenges on the huge gap between computing and I/O performance. Many large-scale scientific applications play an important role in our daily life. The huge amounts of data generated by such applications require highly parallel and efficient I/O management policies. In this paper, we adopt a mission-critical scientific application, GEOS-5, as a case to profile and analyze the communication and I/O issues that are preventing applications from fully utilizing the underlying parallel storage systems. Through in-detail architectural and experimental characterization, we observe that current legacy I/O schemes incur significant network communication overheads and are unable to fully parallelize the data access, thus degrading applications' I/O performance and scalability. To address these inefficiencies, we redesign its I/O framework along with a set of parallel I/O techniques to achieve high scalability and performance. Evaluation results on the NASA discover cluster show that our optimization of GEOS- 5 with ADIOS has led to significant performance improvements compared to the original GEOS-5 implementation. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1109/ICCCN.2013.6614174 | ICCCN |
Keywords | Field | DocType |
geos-5 implementation,goddard earth observing system model version 5,large-scale climate scientific application,geophysics computing,nasa,parallel storage system,parallel architectures,input-output programs,mission-critical scientific application,adios,network communication overheads,i-o management policies,parallel memories,parallel machines,policies,profiling,climate | Exascale computing,Computer science,Profiling (computer programming),Network communication,Input/output,Data access,Scalability,Overhead (business),Distributed computing | Conference |
ISBN | Citations | PageRank |
978-1-4673-5774-6 | 11 | 0.56 |
References | Authors | |
17 | 11 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Zhuo Liu | 1 | 118 | 16.03 |
| Bin Wang | 2 | 120 | 8.13 |
| Teng Wang | 3 | 336 | 42.78 |
| Yuan Tian | 4 | 158 | 15.89 |
| Cong Xu | 5 | 50 | 4.38 |
| Yandong Wang | 6 | 342 | 18.88 |
| Weikuan Yu | 7 | 1042 | 77.40 |
| Carlos A. Cruz | 8 | 11 | 0.56 |
| Shujia Zhou | 9 | 216 | 17.50 |
| Tom Clune | 10 | 20 | 1.79 |
| Scott Klasky | 11 | 1547 | 99.00 |