Title
Fast Parallel I/O on Cluster Computers
Abstract
Today's cluster computers suffer from slow I/O, which slows down I/O-intensive applications. We show that fast disk I/O can be achieved by operating a parallel file system over fast networks such as Myrinet or Gigabit Ethernet. In this paper, we demonstrate how the ParaStation3 communication system helps speed-up the performance of parallel I/O on clusters using the open source paral- lel virtual file system (PVFS) as testbed and production system. We will describe the set-up of PVFS on the Alpha-Linux-Cluster-Engine (ALiCE) located at Wup- pertal University, Germany. Benchmarks on ALiCE achieve write-performances of up to 1 GB/s from a 32-processor compute-partition to a 32-processor PVFS I/O- partition, outperforming known benchmark results for PVFS on the same network by more than a factor of 2. Read-performance from buffer-cache reaches up to 2.2 GB/s. Our benchmarks are giant, I/O-intensive eigenmode problems from lat- tice quantum chromodynamics, demonstrating stability and performance of PVFS over Parastation in large-scale production runs.
Year
Venue
Keywords
2003
Clinical Orthopaedics and Related Research
parallel file system,cluster computing,parastation,lattice qcd,communication system,linux cluster,production system,quantum chromodynamics
Field
DocType
Volume
Cluster (physics),File system,Virtual file system,Computer science,Parallel computing,Communications system,Testbed,Gigabit Ethernet,Parallel I/O,Myrinet,Distributed computing
Journal
cs.DC/0303
Citations 
PageRank 
References 
0
0.34
3
Authors
8
Name
Order
Citations
PageRank
Thomas Düssel100.34
Norbert Eicker2327.06
Florin Isaila323424.01
Thomas Lippert400.34
Thomas Moschny5374.18
Hartmut Neff600.68
Klaus Schilling7177.27
Walter F. Tichy82546438.90