Abstract | ||
---|---|---|
Today's cluster computers suffer from slow I/O, which slows down I/O-intensive applications. We show that fast disk I/O can be achieved by operating a parallel file system over fast networks such as Myrinet or Gigabit Ethernet. In this paper, we demonstrate how the ParaStation3 communication system helps speed-up the performance of parallel I/O on clusters using the open source paral- lel virtual file system (PVFS) as testbed and production system. We will describe the set-up of PVFS on the Alpha-Linux-Cluster-Engine (ALiCE) located at Wup- pertal University, Germany. Benchmarks on ALiCE achieve write-performances of up to 1 GB/s from a 32-processor compute-partition to a 32-processor PVFS I/O- partition, outperforming known benchmark results for PVFS on the same network by more than a factor of 2. Read-performance from buffer-cache reaches up to 2.2 GB/s. Our benchmarks are giant, I/O-intensive eigenmode problems from lat- tice quantum chromodynamics, demonstrating stability and performance of PVFS over Parastation in large-scale production runs. |
Year | Venue | Keywords |
---|---|---|
2003 | Clinical Orthopaedics and Related Research | parallel file system,cluster computing,parastation,lattice qcd,communication system,linux cluster,production system,quantum chromodynamics |
Field | DocType | Volume |
Cluster (physics),File system,Virtual file system,Computer science,Parallel computing,Communications system,Testbed,Gigabit Ethernet,Parallel I/O,Myrinet,Distributed computing | Journal | cs.DC/0303 |
Citations | PageRank | References |
0 | 0.34 | 3 |
Authors | ||
8 |
Name | Order | Citations | PageRank |
---|---|---|---|
Thomas Düssel | 1 | 0 | 0.34 |
Norbert Eicker | 2 | 32 | 7.06 |
Florin Isaila | 3 | 234 | 24.01 |
Thomas Lippert | 4 | 0 | 0.34 |
Thomas Moschny | 5 | 37 | 4.18 |
Hartmut Neff | 6 | 0 | 0.68 |
Klaus Schilling | 7 | 17 | 7.27 |
Walter F. Tichy | 8 | 2546 | 438.90 |