Paper Info
Title
Enhancing hybrid parallel file system through performance and space-aware data layout.
Abstract
Hybrid parallel file systems PFSs, which consist of solid-state drive servers SServer and hard disk drive servers HServer, have recently attracted growing attention. Compared to a traditional HServer, an SServer consistently provides improved storage performance but lacks storage space. However, most current data layout schemes do not consider the differences in performance and space between heterogeneous servers and may significantly degrade the performance of the hybrid PFSs. In this article, we propose performance and space-aware PSA scheme, a novel data layout scheme, which maximizes the hybrid PFSs' performance by applying adaptive varied-size file stripes. PSA dispatches data on heterogeneous file servers not only based on storage performance but also storage space. We have implemented PSA within OrangeFS, a popular PFS in the high-performance computing domain. Our extensive experiments with representative benchmarks, including IOR, HPIO, MPI-TILE-IO, and BTIO, show that PSA provides superior I/O throughput than the default and performance-aware file data layout schemes.
Year
DOI
Venue
2016
10.1177/1094342016631610
IJHPCA
Keywords
Field
DocType
Parallel I, O system, parallel file system, data layout, solid-state drive, hybrid I, O system
File server,File system,Data layout,Computer science,Parallel computing,Server,Solid-state drive,Throughput,Operating system,Distributed computing
Journal
Volume
Issue
ISSN
30
4
1094-3420
Citations 
PageRank 
References 
0
0.34
10
Authors
5
Name
Order
Citations
PageRank
Shuibing He110920.45
Yan Liu200.68
Yang Wang3839.61
Xian-he Sun41987182.64
Huang Chuanhe56110.92