Title
A novel model for synthesizing parallel I/O workloads in scientific applications
Abstract
One of the challenging issues in performance evaluation of parallel storage systems through synthetic-trace-driven simulation is to accurately characterize the I/O demands of data-intensive scientific applications. This paper analyzes several I/O traces collected from different distributed systems and concludes that correlations in parallel I/O inter-arrival times are inconsistent, either with little correlation or with evident and abundant correlations. Thus conventional Poisson or Markov arrival processes are inappropriate to model I/O arrivals in some applications. Instead, a new and generic model based on the alpha-stable process is proposed and validated in this paper to accurately model parallel I/O burstiness in both workloads with little and strong correlations. This model can be used to generate reliable synthetic I/O sequences in simulation studies. Experimental results presented in this paper show that this model can capture the complex I/O behaviors of real storage systems more accurately and faithfully than conventional models, particularly for the burstiness characteristics in the parallel I/O workloads.
Year
DOI
Venue
2008
10.1109/CLUSTR.2008.4663778
CLUSTER
Keywords
Field
DocType
i/o demand,parallel processing,parallel i/o workload,parallel storage system,distributed memory systems,data-intensive scientific application,synthetic-trace-driven simulation,parallel i/o burstiness,distributed system,physics,stochastic processes,stable process,storage system,benchmark testing,computational modeling,correlation,predictive models,mathematical model
Computer science,Parallel computing,Markov chain,Parallel processing,Stochastic process,Real-time computing,Burstiness,Poisson distribution,Parallel I/O,Distributed memory systems,Benchmark (computing)
Conference
ISSN
ISBN
Citations 
1552-5244 E-ISBN : 978-1-4244-2640-9
978-1-4244-2640-9
8
PageRank 
References 
Authors
0.49
16
4
Name
Order
Citations
PageRank
Dan Feng11845188.16
Qiang Zou2507.71
Hong Jiang32137157.96
Yifeng Zhu451335.33