Name
Abstract | ||
|---|---|---|
The technology advances made in supercomputers and high performance computing clusters over the past few years have been tremendous. Clusters are the most common solution for high performance computing at the present time. In this kind of systems, an important subject is the parallel I/O subsystem design. Parallel file systems (GPFS, PVFS, Lustre, etc) have been the solution used to obtain high performance I/O. Parallel file systems increase performance by distributing data file across several I/O nodes. However, cluster's size is increasing continuously, specially for compute nodes, becoming the I/O nodes in a possible bottleneck of the system. In this paper, we propose a new architecture that solves the problem pointed out before: new hierarchical I/O architecture based on parallel I/O proxies. Those I/O proxies execute on the compute nodes offering an intermediate parallel file system between the applications and the storage system of the cluster. That architecture reduces the load on the I/O nodes increasing the global performance. This paper shows the design of the proposed solution and a preliminary evaluation, using a cluster located in the Stuttgart HLRS center. |
Year | DOI | Venue |
|---|---|---|
2006 | 10.1007/11751649_12 | ICCSA (5) |
Keywords | Field | DocType |
parallel file system,o architecture,global performance,large scale cluster,o subsystem design,high performance computing cluster,o node,o proxy,high performance computing,high performance,intermediate parallel file system,new i,storage system | Bottleneck,File system,Supercomputer,Parallel algorithm,Computer science,Computer data storage,Server,Parallel computing,Input/output,Data file | Conference |
Volume | ISSN | ISBN |
3984 | 0302-9743 | 3-540-34079-3 |
Citations | PageRank | References |
2 | 0.38 | 13 |
Authors | ||
6 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| L. M. Sánchez García | 1 | 2 | 0.38 |
| Florin Isaila | 2 | 234 | 24.01 |
| Félix García Carballeira | 3 | 70 | 14.00 |
| Jesús Carretero Pérez | 4 | 8 | 1.18 |
| rolf rabenseifner | 5 | 746 | 50.04 |
| Panagiotis A. Adamidis | 6 | 125 | 23.44 |