Paper Info
Title
A cost-aware region-level data placement scheme for hybrid parallel I/O systems
Abstract
Parallel I/O systems represent the most commonly used engineering solution to mitigate the performance mismatch between CPU and disk performance; however, parallel I/O systems are application dependent and may not work well for certain data access requests. New emerging solid state drives (SSD) are able to deliver better performance but incur a high monetary cost. While SSDs cannot always replace HDDs, the hybrid SSD-HDD approach uniquely addresses common performance issues in parallel I/O systems. The performance of hybrid SSD-HDD architecture depends on the utilization of the SSD and scheduling of data placement. In this paper, we propose a cost-aware region-level (CARL) data placement scheme for hybrid parallel I/O systems. CARL divides large files into several small regions, calculates the region costs according to the data access patterns, and selectively places regions with high access costs onto the SSD-based file servers. We have implemented CARL under MPI-IO and the PVFS2 parallel file system environment. Experimental results of representative benchmarks show that CARL is both feasible and able to improve I/O performance significantly.
Year
DOI
Venue
2013
10.1109/CLUSTER.2013.6702615
CLUSTER
Keywords
Field
DocType
parallel i/o system,parallel processing,pvfs2 parallel file system environment,application program interfaces,ssd,ssd-based file servers,cpu performance,hard disc drives,carl data placement scheme,hybrid parallel i-o systems,input-output systems,input-output programs,message passing interface,hybrid ssd-hdd approach,cost-aware region-level data placement scheme,data placement scheduling,solid state drive,mpi-io,message passing,i/o middleware,disk performance,solid state drives
File system,File server,I/O scheduling,Computer science,Scheduling (computing),Parallel computing,Input/output,Real-time computing,Solid-state drive,Parallel I/O,Data access,Distributed computing
Conference
ISSN
Citations 
PageRank 
1552-5244
17
0.64
References 
Authors
16
5
Name
Order
Citations
PageRank
Shuibing He110920.45
Xian-he Sun21987182.64
Bo Feng3512.96
Xin Huang4170.98
Kun Feng5344.32